Orbiter History

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 10 out of 60 is failed (threshold=3) [....X....X...............X..X.........XX.........X.XX.X.....] duration: 209.951135ms remote: "tcp:136.0.77.2:443" response headers: Content-Length=423 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=185F3AFB7EA3A7A1 X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:47:11 GMT Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=8tjmSuZMkvh Accept-Ranges=bytes target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-26 05:51:20 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F3AFB7EA3A7A1</RequestId><HostId></HostId></Error>" Duration: 209.979288ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 16 out of 60 is failed (threshold=3) [......XX.X.X.XX....X..X...XX.XXX..........X..XX.............] duration: 658.729728ms FAIL (2025-08-26 05:51:12 UTC) operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 26 05:40:50.174916229 (13h37m5.400099286s) [upload=11948]: Starting upload Aug 26 05:40:50.174950314 (13h37m5.400133371s) [upload=11948]: Done starting upload Aug 26 05:40:50.174991591 (13h37m5.400174638s) [upload=11948]: Uploading segments... Aug 26 05:40:50.175014524 (13h37m5.400197571s) [upload=11948]: Got next segment. Inline: true Aug 26 05:40:50.175017720 (13h37m5.400200767s) [upload=11948]: Waiting for error group managing segments... Aug 26 05:40:50.175043148 (13h37m5.400226195s) [upload=11948]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:40:50.175046144 (13h37m5.400229191s) [upload=11948]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:40:50.175048268 (13h37m5.400231315s) [upload=11948]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:41:09.312511333 (13h37m24.53769439s) [upload=11948]: Done uploading segments... Aug 26 05:41:09.312532192 (13h37m24.537715249s) [upload=11948]: Upload finished. err: <nil> Duration:* 658.761218ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 8 out of 60 is failed (threshold=3) [......X.X..X.............XX...............XX........X.......] duration: 1.097633984s FAIL (2025-08-26 05:51:10 UTC) operation error S3: GetObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 185F3AEE3B34C493, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled) Duration: 1.097671404s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 19 out of 60 is failed (threshold=3) [....X.X.XX.XXXXX....X..X...X...X......X..XX.X.......XX......] duration: 960.097664ms FAIL (2025-08-26 05:50:53 UTC) operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 26 05:46:28.652260030 (13h42m43.877443077s) [upload=12031]: Starting upload Aug 26 05:46:28.652309312 (13h42m43.87749236s) [upload=12031]: Done starting upload Aug 26 05:46:28.652384173 (13h42m43.87756722s) [upload=12031]: Uploading segments... Aug 26 05:46:28.652505932 (13h42m43.877688979s) [upload=12031]: Got next segment. Inline: false Aug 26 05:46:28.652541158 (13h42m43.877724205s) [upload=12031]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:46:28.652544514 (13h42m43.877727551s) [upload=12031]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:46:40.061445530 (13h42m55.286628608s) [seg_pos={0 0}, upload=12031]: Begin upload segment... Aug 26 05:46:40.061488060 (13h42m55.286671137s) [seg_pos={0 0}, upload=12031]: Done begin upload segment. Aug 26 05:46:40.061554374 (13h42m55.286737452s) [noise=true , address=45.91.116.7:4010 , piece_id=FH277WUIQEUP5HUFCO534CCX5APWHIKG7V7QSIYBKLNP43ULPN7Q, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.061611752 (13h42m55.286794849s) [noise=true , address=45.91.116.13:4155 , piece_id=NHY7PPHPYITMIDCFDHOBBHGWZXGOOUHPUNSMPEU4DVH5XCZCBY3A, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.062021513 (13h42m55.2872046s) [noise=true , address=45.91.116.12:4227 , piece_id=AVRMTCXUZCZKO7ADTQHFSPVSMDOTGCP5QIVSS73P27JG7TWZIOMQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.062468782 (13h42m55.2876519s) [noise=true , address=45.91.116.8:4047 , piece_id=E66WZM7JPHLX5DC6HIYJS6PIVUIVN75KRLW66CHVPZEQUB7RHHNA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.062534026 (13h42m55.287717103s) [noise=true , address=104.36.82.14:4221 , piece_id=GO4OPUXGJDX5IMH52JBQIIH4TOLOUCR5PQKVR2N4BUEOXNV5LLFQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.063015901 (13h42m55.288198978s) [noise=true , address=104.36.82.3:4767 , piece_id=URSW43FTPDWCPL2TMRGZZTDESJDGBARFPYEW43WE7OHNDD75JF3Q, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.063369004 (13h42m55.288552091s) [noise=true , address=45.91.116.11:4117 , piece_id=A3ZS3F2HM26OC4AT3ZXQCE4VUA7S77ACXYABZ4K5DZU5ZHASK7MA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.063410292 (13h42m55.28859338s) [noise=true , address=45.91.116.4:4940 , piece_id=3MVHQWYSPY7PCF3ZFT7BUAN62XYFENEEOA3B3LDGTM6HL3BI42ZQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.063862080 (13h42m55.289045158s) [noise=true , address=77.90.31.13:4627 , piece_id=LE6PYVEVSAVB7JMKR3MJSHFP2ZTJMLTWSVX2WS2DMVKWKOM4TKZA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.064200546 (13h42m55.289383624s) [noise=true , address=104.36.82.2:4729 , piece_id=HDVV3RUIKIXMW6TKHJJVXDDK75MGT6FMDWTSBBL54MXY6M6CETEA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.064299062 (13h42m55.289482139s) [noise=true , address=45.91.116.5:4297 , piece_id=AFE5WDDJLDOI56R57TNEX7AHXMOR4EDINRMBCLG6BODWKKA7BOTQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.064693774 (13h42m55.289876851s) [noise=true , address=77.90.31.16:4735 , piece_id=QBSRWDX6MKEAF3FBJ2ZPBRDRNDVJYR5UV5NAEGZGDK2NSWFHRLZA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.064967658 (13h42m55.290150735s) [noise=true , address=104.36.82.2:4732 , piece_id=2XHPT7TCG4P6ID3VYBIA4T5MLDKJFJIKIDQRDNVNLC6L2TCDNYXA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.065182031 (13h42m55.290365109s) [noise=true , address=45.91.116.5:4299 , piece_id=UI5RNMFCDMEEVW2AI5NCQBMS4IULHKTWRM4GA6Q2GXWN7NCFHUHQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.065678393 (13h42m55.290861481s) [noise=true , address=104.36.82.7:4911 , piece_id=KVBWTVBSMJRTDLSUU2BL2OVB3SW4DMDBBD2JM7VMKEQCZGDU7JHQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.066367499 (13h42m55.291550586s) [noise=true , address=77.90.31.21:4878 , piece_id=DWQ5MI6AF7FF655CC3UBNUU35Y3VJCGFOPLQ2FLJBIWXMBU4DLYQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.166559082 (13h42m55.391742129s) [upload=12031]: Next returned nil segment Aug 26 05:46:40.166572948 (13h42m55.391755995s) [upload=12031]: Waiting for error group managing segments... Aug 26 05:46:40.173665544 (13h42m55.398848592s) [noise=true , address=45.91.116.5:4299 , piece_id=UI5RNMFCDMEEVW2AI5NCQBMS4IULHKTWRM4GA6Q2GXWN7NCFHUHQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.174842136 (13h42m55.400025202s) [noise=true , address=45.91.116.8:4047 , piece_id=E66WZM7JPHLX5DC6HIYJS6PIVUIVN75KRLW66CHVPZEQUB7RHHNA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.175255342 (13h42m55.400438389s) [noise=true , address=77.90.31.16:4735 , piece_id=QBSRWDX6MKEAF3FBJ2ZPBRDRNDVJYR5UV5NAEGZGDK2NSWFHRLZA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.175557269 (13h42m55.400740356s) [noise=true , address=45.91.116.5:4297 , piece_id=AFE5WDDJLDOI56R57TNEX7AHXMOR4EDINRMBCLG6BODWKKA7BOTQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.175698043 (13h42m55.400881081s) [noise=true , address=45.91.116.11:4117 , piece_id=A3ZS3F2HM26OC4AT3ZXQCE4VUA7S77ACXYABZ4K5DZU5ZHASK7MA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.176056869 (13h42m55.401239935s) [noise=true , address=45.91.116.12:4227 , piece_id=AVRMTCXUZCZKO7ADTQHFSPVSMDOTGCP5QIVSS73P27JG7TWZIOMQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.176475945 (13h42m55.401659012s) [noise=true , address=77.90.31.21:4878 , piece_id=DWQ5MI6AF7FF655CC3UBNUU35Y3VJCGFOPLQ2FLJBIWXMBU4DLYQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.177490372 (13h42m55.402673449s) [noise=true , address=77.90.31.13:4627 , piece_id=LE6PYVEVSAVB7JMKR3MJSHFP2ZTJMLTWSVX2WS2DMVKWKOM4TKZA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.177539725 (13h42m55.402722771s) [noise=true , address=45.91.116.13:4155 , piece_id=NHY7PPHPYITMIDCFDHOBBHGWZXGOOUHPUNSMPEU4DVH5XCZCBY3A, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.178099717 (13h42m55.403282794s) [noise=true , address=45.91.116.7:4010 , piece_id=FH277WUIQEUP5HUFCO534CCX5APWHIKG7V7QSIYBKLNP43ULPN7Q, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.181059919 (13h42m55.406242966s) [noise=true , address=104.36.82.14:4221 , piece_id=GO4OPUXGJDX5IMH52JBQIIH4TOLOUCR5PQKVR2N4BUEOXNV5LLFQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.182162520 (13h42m55.407345598s) [noise=true , address=104.36.82.7:4911 , piece_id=KVBWTVBSMJRTDLSUU2BL2OVB3SW4DMDBBD2JM7VMKEQCZGDU7JHQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.184028706 (13h42m55.409211784s) [noise=true , address=45.91.116.4:4940 , piece_id=3MVHQWYSPY7PCF3ZFT7BUAN62XYFENEEOA3B3LDGTM6HL3BI42ZQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.184040439 (13h42m55.409223505s) [seg_pos={0 0}, upload=12031]: Segment reached optimal threshold of 13 pieces. Aug 26 05:46:40.184230777 (13h42m55.409413854s) [noise=true , address=104.36.82.3:4767 , piece_id=URSW43FTPDWCPL2TMRGZZTDESJDGBARFPYEW43WE7OHNDD75JF3Q, seg_pos={0 0}, upload=12031]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Aug 26 05:46:40.184361141 (13h42m55.409544208s) [noise=true , address=104.36.82.2:4729 , piece_id=HDVV3RUIKIXMW6TKHJJVXDDK75MGT6FMDWTSBBL54MXY6M6CETEA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: expected piece hash; context canceled; EOF Aug 26 05:46:40.184450850 (13h42m55.409633898s) [noise=true , address=104.36.82.2:4732 , piece_id=2XHPT7TCG4P6ID3VYBIA4T5MLDKJFJIKIDQRDNVNLC6L2TCDNYXA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.184476368 (13h42m55.409659416s) [seg_pos={0 0}, upload=12031]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Aug 26 05:46:40.184580183 (13h42m55.40976323s) [upload=12031]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:46:40.184585603 (13h42m55.40976865s) [upload=12031]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:46:47.044131312 (13h43m2.2693144s) [upload=12031]: Done uploading segments... Aug 26 05:46:47.044152874 (13h43m2.269335951s) [upload=12031]: Upload finished. err: <nil> Duration: 960.121648ms core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 11 out of 60 is failed (threshold=3) [....X.....XX.XX....XX.................X...XX........X.......] duration: 144.525759ms remote: "tcp:45.38.24.2:443" response headers: Content-Type=application/xml Server=Storj X-Amz-Request-Id=185F3AEE0EB33B6A X-Request-Id=McQuPBREAb1 X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:46:14 GMT Accept-Ranges=bytes Content-Length=433 Content-Security-Policy=block-all-mixed-content Vary=Origin target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-26 05:50:53 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F3AEE0EB33B6A</RequestId><HostId></HostId></Error>" Duration: 144.543993ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 10 out of 60 is failed (threshold=3) [.......XX.X.X.X.....X..X......................X.....X..X....] duration: 750.697745ms FAIL (2025-08-26 05:50:51 UTC) operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== O4JMKFA5RN4IQN2CRCW5VBPYXLMYFOX3VA7ICGQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.337676887 (13h43m30.562859964s) [noise=true , address=77.90.31.15:4717 , piece_id=5I67NYFJRZT7ORPYPVSJA56BB4LYVB3WUQOE7ZXFFHTCHMI2TYVQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.338323312 (13h43m30.563506388s) [noise=true , address=104.36.82.44:4890 , piece_id=NYLN3X5UXITCKCFZ6E2WIGI7WZV7USAFIEMUNESNBYU4BVOKAW5Q, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.340398391 (13h43m30.565581469s) [noise=true , address=79.127.205.245:4220 , piece_id=FPXMKCW6YUM5CGTJ27UUGSXZE7VZ6MS542O3H4NYHAKYPM5U4OFQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.340778866 (13h43m30.565961953s) [noise=true , address=104.36.82.60:4365 , piece_id=IOYRFBESQVMDVOEH677WCO6CDSU6LOMQOZQOMMXT2QSEAXDRLFWA, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.341147428 (13h43m30.566330505s) [noise=true , address=79.127.205.246:4284 , piece_id=EC3P5P5T2ODWFBH4VQ3666AR3TSW3LJZKZU7P2UFB76V22RD5VQQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.341604627 (13h43m30.566787705s) [noise=true , address=104.36.82.11:4128 , piece_id=QIDJJMBP36RUA4XXQ2Q2HDF2R4DW53A222OEQEWA2AMX6RSQCVFA, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.341967629 (13h43m30.567150706s) [noise=true , address=77.90.31.18:4821 , piece_id=RSEEETAXPX2UNFT3NAGVQIDD6HZXMX2BRHMKMTVXPNWVXKFVSYXQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.342312617 (13h43m30.567495705s) [noise=true , address=45.91.116.6:4002 , piece_id=42SYNFZV4JY4CHJ4KHGEPLK5BY3PVIII66CTFE4I4SAJLVELULYQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.342682082 (13h43m30.56786516s) [noise=true , address=104.36.82.5:4848 , piece_id=YPQNRHC7BMQET4FH3IOP3WVAY6D3H5FCVJSSIYWL6KAJ43GFPDWA, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.343107501 (13h43m30.568290578s) [noise=true , address=79.127.219.47:4065 , piece_id=J774Z6CPOJBLVO4KC2ODC2FMFRG5LQYLHL2LFQF3AR4SWD2CD6BQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.343696528 (13h43m30.568879605s) [noise=true , address=104.36.82.23:4466 , piece_id=U6DXP2ADNBE657QXHKT633JIV66ROOTRQKF4B7OAJTVDOV3CRLUA, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.347700131 (13h43m30.572883208s) [noise=true , address=104.36.82.11:4140 , piece_id=BA5JUOEPAD4TNNCFEHMQ5KO3CDJJ5L56GDXZMT6VIGGBXCETBYGQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.353294242 (13h43m30.578477318s) [noise=true , address=79.127.205.234:4619 , piece_id=KURMGY53IW7WE6SMXSLZDFDMO6SSSILYL66NBM54LRPAZ3HVZXQA, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.357005705 (13h43m30.582188852s) [noise=true , address=104.36.82.50:4017 , piece_id=VXMNPE5WHITPQP7LQUDAEYAN6LYYWPWIR6BTE2FJXECSXKQAHVWQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.360097525 (13h43m30.585280602s) [noise=true , address=64.49.13.154:4934 , piece_id=KDCFYU63FXZ4BHOYEGGO5VC6M3KC7JMERNSY5F24HM7TWJ2PRVHA, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.360718501 (13h43m30.585901589s) [noise=true , address=77.90.31.16:4752 , piece_id=FKJQ66EGGM57CJOCPKD4V4K4YGWGRQJTFVA5JK2YZBOUFO2KFQDA, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.363118261 (13h43m30.588301337s) [noise=true , address=77.90.31.19:4855 , piece_id=NCMORUSZ6XAEPRPT4YPXHWIZGP5BVLWCDCNBTOC7ECK6QMU22WFQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.442534509 (13h43m30.667717586s) [upload=12041]: Next returned nil segment Aug 26 05:47:15.442550258 (13h43m30.667733345s) [upload=12041]: Waiting for error group managing segments... Aug 26 05:47:15.451182057 (13h43m30.676365164s) [noise=true , address=77.90.31.18:4821 , piece_id=RSEEETAXPX2UNFT3NAGVQIDD6HZXMX2BRHMKMTVXPNWVXKFVSYXQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.452462604 (13h43m30.677645681s) [noise=true , address=79.127.219.47:4065 , piece_id=J774Z6CPOJBLVO4KC2ODC2FMFRG5LQYLHL2LFQF3AR4SWD2CD6BQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.454260442 (13h43m30.679443529s) [noise=true , address=45.91.116.6:4002 , piece_id=42SYNFZV4JY4CHJ4KHGEPLK5BY3PVIII66CTFE4I4SAJLVELULYQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.455280057 (13h43m30.680463144s) [noise=true , address=77.90.31.15:4717 , piece_id=5I67NYFJRZT7ORPYPVSJA56BB4LYVB3WUQOE7ZXFFHTCHMI2TYVQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.456937692 (13h43m30.682120769s) [noise=true , address=104.36.82.5:4848 , piece_id=YPQNRHC7BMQET4FH3IOP3WVAY6D3H5FCVJSSIYWL6KAJ43GFPDWA, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.457694363 (13h43m30.68287745s) [noise=true , address=104.36.82.11:4128 , piece_id=QIDJJMBP36RUA4XXQ2Q2HDF2R4DW53A222OEQEWA2AMX6RSQCVFA, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.458098192 (13h43m30.68328127s) [noise=true , address=104.36.82.11:4140 , piece_id=BA5JUOEPAD4TNNCFEHMQ5KO3CDJJ5L56GDXZMT6VIGGBXCETBYGQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.458479239 (13h43m30.683662315s) [noise=true , address=104.36.82.23:4466 , piece_id=U6DXP2ADNBE657QXHKT633JIV66ROOTRQKF4B7OAJTVDOV3CRLUA, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.458886112 (13h43m30.684069199s) [noise=true , address=104.36.82.44:4890 , piece_id=NYLN3X5UXITCKCFZ6E2WIGI7WZV7USAFIEMUNESNBYU4BVOKAW5Q, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.459042417 (13h43m30.684225493s) [noise=true , address=104.36.82.50:4017 , piece_id=VXMNPE5WHITPQP7LQUDAEYAN6LYYWPWIR6BTE2FJXECSXKQAHVWQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.459511177 (13h43m30.684694254s) [noise=true , address=104.36.82.60:4365 , piece_id=IOYRFBESQVMDVOEH677WCO6CDSU6LOMQOZQOMMXT2QSEAXDRLFWA, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.468110394 (13h43m30.693293461s) [noise=true , address=77.90.31.19:4855 , piece_id=NCMORUSZ6XAEPRPT4YPXHWIZGP5BVLWCDCNBTOC7ECK6QMU22WFQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.620114931 (13h43m30.845298009s) [noise=true , address=79.127.201.215:4349 , piece_id=5KA4X7E475FZVO4JMKFA5RN4IQN2CRCW5VBPYXLMYFOX3VA7ICGQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.663559442 (13h43m30.888742509s) [noise=true , address=77.90.31.16:4752 , piece_id=FKJQ66EGGM57CJOCPKD4V4K4YGWGRQJTFVA5JK2YZBOUFO2KFQDA, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.663591131 (13h43m30.888774198s) [seg_pos={0 0}, upload=12041]: Segment reached optimal threshold of 14 pieces. Aug 26 05:47:15.663955185 (13h43m30.889138262s) [noise=true , address=79.127.205.245:4220 , piece_id=FPXMKCW6YUM5CGTJ27UUGSXZE7VZ6MS542O3H4NYHAKYPM5U4OFQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123xj8bTNShfvqNJh3mSvM6V4TeXQoxFHR5TKELoUKTJJTzDyjD): protocol: write tcp 5.161.89.252:33592->79.127.205.245:4220: use of closed network connection; write tcp 5.161.89.252:33592->79.127.205.245:4220: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:33592->79.127.205.245:4220: use of closed network connection Aug 26 05:47:15.663980523 (13h43m30.88916359s) [noise=true , address=79.127.205.246:4284 , piece_id=EC3P5P5T2ODWFBH4VQ3666AR3TSW3LJZKZU7P2UFB76V22RD5VQQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 5.161.89.252:61910->79.127.205.246:4284: use of closed network connection; write tcp 5.161.89.252:61910->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:61910->79.127.205.246:4284: use of closed network connection Aug 26 05:47:15.664038241 (13h43m30.889221308s) [noise=true , address=64.49.13.154:4934 , piece_id=KDCFYU63FXZ4BHOYEGGO5VC6M3KC7JMERNSY5F24HM7TWJ2PRVHA, seg_pos={0 0}, upload=12041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: read tcp 5.161.89.252:62488->64.49.13.154:4934: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 26 05:47:15.664095149 (13h43m30.889278225s) [noise=true , address=79.127.205.234:4619 , piece_id=KURMGY53IW7WE6SMXSLZDFDMO6SSSILYL66NBM54LRPAZ3HVZXQA, seg_pos={0 0}, upload=12041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 5.161.89.252:33526->79.127.205.234:4619: use of closed network connection; write tcp 5.161.89.252:33526->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:33526->79.127.205.234:4619: use of closed network connection Aug 26 05:47:15.664159890 (13h43m30.889342967s) [seg_pos={0 0}, upload=12041]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 26 05:47:15.664249217 (13h43m30.889432295s) [upload=12041]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:47:15.664255018 (13h43m30.889438096s) [upload=12041]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:47:26.126651265 (13h43m41.351834322s) [upload=12041]: Done uploading segments... Aug 26 05:47:26.126673085 (13h43m41.351856142s) [upload=12041]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 750.717892ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 17 out of 60 is failed (threshold=3) [....XX.XX..XXX....XX......XX..XX....X............XXX........] duration: 693.749768ms FAIL (2025-08-26 05:50:38 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 693.773092ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 19 out of 60 is failed (threshold=3) [.....X.X.XX.XXXXX....X..X...X...X......X..XX.X.......XX.....] duration: 2.591692641s FAIL (2025-08-26 05:50:35 UTC) operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 26 05:46:28.652260030 (13h42m43.877443077s) [upload=12031]: Starting upload Aug 26 05:46:28.652309312 (13h42m43.87749236s) [upload=12031]: Done starting upload Aug 26 05:46:28.652384173 (13h42m43.87756722s) [upload=12031]: Uploading segments... Aug 26 05:46:28.652505932 (13h42m43.877688979s) [upload=12031]: Got next segment. Inline: false Aug 26 05:46:28.652541158 (13h42m43.877724205s) [upload=12031]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:46:28.652544514 (13h42m43.877727551s) [upload=12031]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:46:40.061445530 (13h42m55.286628608s) [seg_pos={0 0}, upload=12031]: Begin upload segment... Aug 26 05:46:40.061488060 (13h42m55.286671137s) [seg_pos={0 0}, upload=12031]: Done begin upload segment. Aug 26 05:46:40.061554374 (13h42m55.286737452s) [noise=true , address=45.91.116.7:4010 , piece_id=FH277WUIQEUP5HUFCO534CCX5APWHIKG7V7QSIYBKLNP43ULPN7Q, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.061611752 (13h42m55.286794849s) [noise=true , address=45.91.116.13:4155 , piece_id=NHY7PPHPYITMIDCFDHOBBHGWZXGOOUHPUNSMPEU4DVH5XCZCBY3A, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.062021513 (13h42m55.2872046s) [noise=true , address=45.91.116.12:4227 , piece_id=AVRMTCXUZCZKO7ADTQHFSPVSMDOTGCP5QIVSS73P27JG7TWZIOMQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.062468782 (13h42m55.2876519s) [noise=true , address=45.91.116.8:4047 , piece_id=E66WZM7JPHLX5DC6HIYJS6PIVUIVN75KRLW66CHVPZEQUB7RHHNA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.062534026 (13h42m55.287717103s) [noise=true , address=104.36.82.14:4221 , piece_id=GO4OPUXGJDX5IMH52JBQIIH4TOLOUCR5PQKVR2N4BUEOXNV5LLFQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.063015901 (13h42m55.288198978s) [noise=true , address=104.36.82.3:4767 , piece_id=URSW43FTPDWCPL2TMRGZZTDESJDGBARFPYEW43WE7OHNDD75JF3Q, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.063369004 (13h42m55.288552091s) [noise=true , address=45.91.116.11:4117 , piece_id=A3ZS3F2HM26OC4AT3ZXQCE4VUA7S77ACXYABZ4K5DZU5ZHASK7MA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.063410292 (13h42m55.28859338s) [noise=true , address=45.91.116.4:4940 , piece_id=3MVHQWYSPY7PCF3ZFT7BUAN62XYFENEEOA3B3LDGTM6HL3BI42ZQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.063862080 (13h42m55.289045158s) [noise=true , address=77.90.31.13:4627 , piece_id=LE6PYVEVSAVB7JMKR3MJSHFP2ZTJMLTWSVX2WS2DMVKWKOM4TKZA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.064200546 (13h42m55.289383624s) [noise=true , address=104.36.82.2:4729 , piece_id=HDVV3RUIKIXMW6TKHJJVXDDK75MGT6FMDWTSBBL54MXY6M6CETEA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.064299062 (13h42m55.289482139s) [noise=true , address=45.91.116.5:4297 , piece_id=AFE5WDDJLDOI56R57TNEX7AHXMOR4EDINRMBCLG6BODWKKA7BOTQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.064693774 (13h42m55.289876851s) [noise=true , address=77.90.31.16:4735 , piece_id=QBSRWDX6MKEAF3FBJ2ZPBRDRNDVJYR5UV5NAEGZGDK2NSWFHRLZA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.064967658 (13h42m55.290150735s) [noise=true , address=104.36.82.2:4732 , piece_id=2XHPT7TCG4P6ID3VYBIA4T5MLDKJFJIKIDQRDNVNLC6L2TCDNYXA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.065182031 (13h42m55.290365109s) [noise=true , address=45.91.116.5:4299 , piece_id=UI5RNMFCDMEEVW2AI5NCQBMS4IULHKTWRM4GA6Q2GXWN7NCFHUHQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.065678393 (13h42m55.290861481s) [noise=true , address=104.36.82.7:4911 , piece_id=KVBWTVBSMJRTDLSUU2BL2OVB3SW4DMDBBD2JM7VMKEQCZGDU7JHQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.066367499 (13h42m55.291550586s) [noise=true , address=77.90.31.21:4878 , piece_id=DWQ5MI6AF7FF655CC3UBNUU35Y3VJCGFOPLQ2FLJBIWXMBU4DLYQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.166559082 (13h42m55.391742129s) [upload=12031]: Next returned nil segment Aug 26 05:46:40.166572948 (13h42m55.391755995s) [upload=12031]: Waiting for error group managing segments... Aug 26 05:46:40.173665544 (13h42m55.398848592s) [noise=true , address=45.91.116.5:4299 , piece_id=UI5RNMFCDMEEVW2AI5NCQBMS4IULHKTWRM4GA6Q2GXWN7NCFHUHQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.174842136 (13h42m55.400025202s) [noise=true , address=45.91.116.8:4047 , piece_id=E66WZM7JPHLX5DC6HIYJS6PIVUIVN75KRLW66CHVPZEQUB7RHHNA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.175255342 (13h42m55.400438389s) [noise=true , address=77.90.31.16:4735 , piece_id=QBSRWDX6MKEAF3FBJ2ZPBRDRNDVJYR5UV5NAEGZGDK2NSWFHRLZA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.175557269 (13h42m55.400740356s) [noise=true , address=45.91.116.5:4297 , piece_id=AFE5WDDJLDOI56R57TNEX7AHXMOR4EDINRMBCLG6BODWKKA7BOTQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.175698043 (13h42m55.400881081s) [noise=true , address=45.91.116.11:4117 , piece_id=A3ZS3F2HM26OC4AT3ZXQCE4VUA7S77ACXYABZ4K5DZU5ZHASK7MA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.176056869 (13h42m55.401239935s) [noise=true , address=45.91.116.12:4227 , piece_id=AVRMTCXUZCZKO7ADTQHFSPVSMDOTGCP5QIVSS73P27JG7TWZIOMQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.176475945 (13h42m55.401659012s) [noise=true , address=77.90.31.21:4878 , piece_id=DWQ5MI6AF7FF655CC3UBNUU35Y3VJCGFOPLQ2FLJBIWXMBU4DLYQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.177490372 (13h42m55.402673449s) [noise=true , address=77.90.31.13:4627 , piece_id=LE6PYVEVSAVB7JMKR3MJSHFP2ZTJMLTWSVX2WS2DMVKWKOM4TKZA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.177539725 (13h42m55.402722771s) [noise=true , address=45.91.116.13:4155 , piece_id=NHY7PPHPYITMIDCFDHOBBHGWZXGOOUHPUNSMPEU4DVH5XCZCBY3A, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.178099717 (13h42m55.403282794s) [noise=true , address=45.91.116.7:4010 , piece_id=FH277WUIQEUP5HUFCO534CCX5APWHIKG7V7QSIYBKLNP43ULPN7Q, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.181059919 (13h42m55.406242966s) [noise=true , address=104.36.82.14:4221 , piece_id=GO4OPUXGJDX5IMH52JBQIIH4TOLOUCR5PQKVR2N4BUEOXNV5LLFQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.182162520 (13h42m55.407345598s) [noise=true , address=104.36.82.7:4911 , piece_id=KVBWTVBSMJRTDLSUU2BL2OVB3SW4DMDBBD2JM7VMKEQCZGDU7JHQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.184028706 (13h42m55.409211784s) [noise=true , address=45.91.116.4:4940 , piece_id=3MVHQWYSPY7PCF3ZFT7BUAN62XYFENEEOA3B3LDGTM6HL3BI42ZQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.184040439 (13h42m55.409223505s) [seg_pos={0 0}, upload=12031]: Segment reached optimal threshold of 13 pieces. Aug 26 05:46:40.184230777 (13h42m55.409413854s) [noise=true , address=104.36.82.3:4767 , piece_id=URSW43FTPDWCPL2TMRGZZTDESJDGBARFPYEW43WE7OHNDD75JF3Q, seg_pos={0 0}, upload=12031]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Aug 26 05:46:40.184361141 (13h42m55.409544208s) [noise=true , address=104.36.82.2:4729 , piece_id=HDVV3RUIKIXMW6TKHJJVXDDK75MGT6FMDWTSBBL54MXY6M6CETEA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: expected piece hash; context canceled; EOF Aug 26 05:46:40.184450850 (13h42m55.409633898s) [noise=true , address=104.36.82.2:4732 , piece_id=2XHPT7TCG4P6ID3VYBIA4T5MLDKJFJIKIDQRDNVNLC6L2TCDNYXA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.184476368 (13h42m55.409659416s) [seg_pos={0 0}, upload=12031]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Aug 26 05:46:40.184580183 (13h42m55.40976323s) [upload=12031]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:46:40.184585603 (13h42m55.40976865s) [upload=12031]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:46:47.044131312 (13h43m2.2693144s) [upload=12031]: Done uploading segments... Aug 26 05:46:47.044152874 (13h43m2.269335951s) [upload=12031]: Upload finished. err: <nil> Duration: 2.591748588s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 19 out of 60 is failed (threshold=3) [.XX....X..X.XX....X..X..X..X.......XX.....XXXXX.....XX......] duration: 627.763375ms FAIL (2025-08-26 05:50:35 UTC) operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 627.788212ms core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 8 out of 60 is failed (threshold=3) [.......X.X..X.............XX...............XX........X......] duration: 1.310256424s FAIL (2025-08-26 05:50:35 UTC) operation error S3: GetObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 185F3AEE3B34C493, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled) Duration: 1.310273046s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 5 out of 60 is failed (threshold=6) [...X..X....X....X.......................X...................] duration: 208.758349ms remote: "tcp:136.0.77.2:443" response headers: Access-Control-Allow-Methods=GET, HEAD X-Request-Id=ZFwx4y7eAxE Content-Type=text/html; charset=utf-8 Accept-Ranges=bytes Access-Control-Allow-Headers=* Access-Control-Allow-Origin=* Date=Tue, 26 Aug 2025 05:38:38 GMT target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt FAIL (2025-08-26 05:50:31 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error \| Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error \| Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error \| Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY" Duration: 208.782644ms edge linksharing bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 10 out of 60 is failed (threshold=3) [.....X....X...............X..X.........XX.........X.XX.X....] duration: 229.042729ms remote: "tcp:136.0.77.2:443" response headers: Content-Length=423 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=185F3AFB7EA3A7A1 X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:47:11 GMT Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=8tjmSuZMkvh Accept-Ranges=bytes target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-26 05:50:30 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F3AFB7EA3A7A1</RequestId><HostId></HostId></Error>" Duration: 229.070772ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 16 out of 60 is failed (threshold=3) [.......XX.X.X.XX....X..X...XX.XXX..........X..XX............] duration: 951.348774ms FAIL (2025-08-26 05:50:29 UTC) operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 26 05:40:50.174916229 (13h37m5.400099286s) [upload=11948]: Starting upload Aug 26 05:40:50.174950314 (13h37m5.400133371s) [upload=11948]: Done starting upload Aug 26 05:40:50.174991591 (13h37m5.400174638s) [upload=11948]: Uploading segments... Aug 26 05:40:50.175014524 (13h37m5.400197571s) [upload=11948]: Got next segment. Inline: true Aug 26 05:40:50.175017720 (13h37m5.400200767s) [upload=11948]: Waiting for error group managing segments... Aug 26 05:40:50.175043148 (13h37m5.400226195s) [upload=11948]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:40:50.175046144 (13h37m5.400229191s) [upload=11948]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:40:50.175048268 (13h37m5.400231315s) [upload=11948]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:41:09.312511333 (13h37m24.53769439s) [upload=11948]: Done uploading segments... Aug 26 05:41:09.312532192 (13h37m24.537715249s) [upload=11948]: Upload finished. err: <nil> Duration:* 951.373821ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 8 out of 60 is failed (threshold=3) [.........X.X..XX.....X...................X.........XX.......] duration: 891.894412ms FAIL (2025-08-26 05:50:28 UTC) operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:46:19.122249242 (13h42m34.347432309s) [upload=12027]: Starting upload Aug 26 05:46:19.122336606 (13h42m34.347519673s) [upload=12027]: Done starting upload Aug 26 05:46:19.122389295 (13h42m34.347572352s) [upload=12027]: Uploading segments... Aug 26 05:46:19.122426304 (13h42m34.347609352s) [upload=12027]: Got next segment. Inline: true Aug 26 05:46:19.122431003 (13h42m34.34761406s) [upload=12027]: Waiting for error group managing segments... Aug 26 05:46:19.122482891 (13h42m34.347665938s) [upload=12027]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:46:19.122487078 (13h42m34.347670135s) [upload=12027]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:46:19.122489442 (13h42m34.3476725s) [upload=12027]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:46:30.124196038 (13h42m45.349379106s) [upload=12027]: Done uploading segments... Aug 26 05:46:30.124211648 (13h42m45.349394705s) [upload=12027]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration:* 891.95778ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 18 out of 60 is failed (threshold=3) [.......XXX....XXX......X....X...X......XX.X.XX....XX.XX.....] duration: 1.428156346s FAIL (2025-08-26 05:50:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.428181374s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 11 out of 60 is failed (threshold=3) [.....X.....XX.XX....XX.................X...XX........X......] duration: 224.988013ms remote: "tcp:45.38.24.2:443" response headers: Content-Type=application/xml Server=Storj X-Amz-Request-Id=185F3AEE0EB33B6A X-Request-Id=McQuPBREAb1 X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:46:14 GMT Accept-Ranges=bytes Content-Length=433 Content-Security-Policy=block-all-mixed-content Vary=Origin target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-26 05:50:16 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F3AEE0EB33B6A</RequestId><HostId></HostId></Error>" Duration: 225.004705ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 17 out of 60 is failed (threshold=3) [.....XX.XX..XXX....XX......XX..XX....X............XXX.......] duration: 1.328036244s FAIL (2025-08-26 05:50:16 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.328055551s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 16 out of 60 is failed (threshold=3) [........XX.X.X.XX....X..X...XX.XXX..........X..XX...........] duration: 506.29545ms FAIL (2025-08-26 05:50:08 UTC) operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 26 05:40:50.174916229 (13h37m5.400099286s) [upload=11948]: Starting upload Aug 26 05:40:50.174950314 (13h37m5.400133371s) [upload=11948]: Done starting upload Aug 26 05:40:50.174991591 (13h37m5.400174638s) [upload=11948]: Uploading segments... Aug 26 05:40:50.175014524 (13h37m5.400197571s) [upload=11948]: Got next segment. Inline: true Aug 26 05:40:50.175017720 (13h37m5.400200767s) [upload=11948]: Waiting for error group managing segments... Aug 26 05:40:50.175043148 (13h37m5.400226195s) [upload=11948]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:40:50.175046144 (13h37m5.400229191s) [upload=11948]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:40:50.175048268 (13h37m5.400231315s) [upload=11948]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:41:09.312511333 (13h37m24.53769439s) [upload=11948]: Done uploading segments... Aug 26 05:41:09.312532192 (13h37m24.537715249s) [upload=11948]: Upload finished. err: <nil> Duration:* 506.314487ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 29 out of 60 is failed (threshold=3) [..XXXXXXXX.XX.......X..XX.XXXXXXX.....XX..X.XXX......XX.X...] duration: 2.995998275s FAIL (2025-08-26 05:50:07 UTC) operation: Commit uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 2.996018164s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 19 out of 60 is failed (threshold=3) [..XX....X..X.XX....X..X..X..X.......XX.....XXXXX.....XX.....] duration: 637.309652ms FAIL (2025-08-26 05:50:05 UTC) operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 637.331342ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 10 out of 60 is failed (threshold=3) [........XX.X.X.X.....X..X......................X.....X..X...] duration: 966.229117ms FAIL (2025-08-26 05:50:01 UTC) operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== O4JMKFA5RN4IQN2CRCW5VBPYXLMYFOX3VA7ICGQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.337676887 (13h43m30.562859964s) [noise=true , address=77.90.31.15:4717 , piece_id=5I67NYFJRZT7ORPYPVSJA56BB4LYVB3WUQOE7ZXFFHTCHMI2TYVQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.338323312 (13h43m30.563506388s) [noise=true , address=104.36.82.44:4890 , piece_id=NYLN3X5UXITCKCFZ6E2WIGI7WZV7USAFIEMUNESNBYU4BVOKAW5Q, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.340398391 (13h43m30.565581469s) [noise=true , address=79.127.205.245:4220 , piece_id=FPXMKCW6YUM5CGTJ27UUGSXZE7VZ6MS542O3H4NYHAKYPM5U4OFQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.340778866 (13h43m30.565961953s) [noise=true , address=104.36.82.60:4365 , piece_id=IOYRFBESQVMDVOEH677WCO6CDSU6LOMQOZQOMMXT2QSEAXDRLFWA, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.341147428 (13h43m30.566330505s) [noise=true , address=79.127.205.246:4284 , piece_id=EC3P5P5T2ODWFBH4VQ3666AR3TSW3LJZKZU7P2UFB76V22RD5VQQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.341604627 (13h43m30.566787705s) [noise=true , address=104.36.82.11:4128 , piece_id=QIDJJMBP36RUA4XXQ2Q2HDF2R4DW53A222OEQEWA2AMX6RSQCVFA, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.341967629 (13h43m30.567150706s) [noise=true , address=77.90.31.18:4821 , piece_id=RSEEETAXPX2UNFT3NAGVQIDD6HZXMX2BRHMKMTVXPNWVXKFVSYXQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.342312617 (13h43m30.567495705s) [noise=true , address=45.91.116.6:4002 , piece_id=42SYNFZV4JY4CHJ4KHGEPLK5BY3PVIII66CTFE4I4SAJLVELULYQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.342682082 (13h43m30.56786516s) [noise=true , address=104.36.82.5:4848 , piece_id=YPQNRHC7BMQET4FH3IOP3WVAY6D3H5FCVJSSIYWL6KAJ43GFPDWA, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.343107501 (13h43m30.568290578s) [noise=true , address=79.127.219.47:4065 , piece_id=J774Z6CPOJBLVO4KC2ODC2FMFRG5LQYLHL2LFQF3AR4SWD2CD6BQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.343696528 (13h43m30.568879605s) [noise=true , address=104.36.82.23:4466 , piece_id=U6DXP2ADNBE657QXHKT633JIV66ROOTRQKF4B7OAJTVDOV3CRLUA, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.347700131 (13h43m30.572883208s) [noise=true , address=104.36.82.11:4140 , piece_id=BA5JUOEPAD4TNNCFEHMQ5KO3CDJJ5L56GDXZMT6VIGGBXCETBYGQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.353294242 (13h43m30.578477318s) [noise=true , address=79.127.205.234:4619 , piece_id=KURMGY53IW7WE6SMXSLZDFDMO6SSSILYL66NBM54LRPAZ3HVZXQA, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.357005705 (13h43m30.582188852s) [noise=true , address=104.36.82.50:4017 , piece_id=VXMNPE5WHITPQP7LQUDAEYAN6LYYWPWIR6BTE2FJXECSXKQAHVWQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.360097525 (13h43m30.585280602s) [noise=true , address=64.49.13.154:4934 , piece_id=KDCFYU63FXZ4BHOYEGGO5VC6M3KC7JMERNSY5F24HM7TWJ2PRVHA, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.360718501 (13h43m30.585901589s) [noise=true , address=77.90.31.16:4752 , piece_id=FKJQ66EGGM57CJOCPKD4V4K4YGWGRQJTFVA5JK2YZBOUFO2KFQDA, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.363118261 (13h43m30.588301337s) [noise=true , address=77.90.31.19:4855 , piece_id=NCMORUSZ6XAEPRPT4YPXHWIZGP5BVLWCDCNBTOC7ECK6QMU22WFQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.442534509 (13h43m30.667717586s) [upload=12041]: Next returned nil segment Aug 26 05:47:15.442550258 (13h43m30.667733345s) [upload=12041]: Waiting for error group managing segments... Aug 26 05:47:15.451182057 (13h43m30.676365164s) [noise=true , address=77.90.31.18:4821 , piece_id=RSEEETAXPX2UNFT3NAGVQIDD6HZXMX2BRHMKMTVXPNWVXKFVSYXQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.452462604 (13h43m30.677645681s) [noise=true , address=79.127.219.47:4065 , piece_id=J774Z6CPOJBLVO4KC2ODC2FMFRG5LQYLHL2LFQF3AR4SWD2CD6BQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.454260442 (13h43m30.679443529s) [noise=true , address=45.91.116.6:4002 , piece_id=42SYNFZV4JY4CHJ4KHGEPLK5BY3PVIII66CTFE4I4SAJLVELULYQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.455280057 (13h43m30.680463144s) [noise=true , address=77.90.31.15:4717 , piece_id=5I67NYFJRZT7ORPYPVSJA56BB4LYVB3WUQOE7ZXFFHTCHMI2TYVQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.456937692 (13h43m30.682120769s) [noise=true , address=104.36.82.5:4848 , piece_id=YPQNRHC7BMQET4FH3IOP3WVAY6D3H5FCVJSSIYWL6KAJ43GFPDWA, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.457694363 (13h43m30.68287745s) [noise=true , address=104.36.82.11:4128 , piece_id=QIDJJMBP36RUA4XXQ2Q2HDF2R4DW53A222OEQEWA2AMX6RSQCVFA, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.458098192 (13h43m30.68328127s) [noise=true , address=104.36.82.11:4140 , piece_id=BA5JUOEPAD4TNNCFEHMQ5KO3CDJJ5L56GDXZMT6VIGGBXCETBYGQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.458479239 (13h43m30.683662315s) [noise=true , address=104.36.82.23:4466 , piece_id=U6DXP2ADNBE657QXHKT633JIV66ROOTRQKF4B7OAJTVDOV3CRLUA, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.458886112 (13h43m30.684069199s) [noise=true , address=104.36.82.44:4890 , piece_id=NYLN3X5UXITCKCFZ6E2WIGI7WZV7USAFIEMUNESNBYU4BVOKAW5Q, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.459042417 (13h43m30.684225493s) [noise=true , address=104.36.82.50:4017 , piece_id=VXMNPE5WHITPQP7LQUDAEYAN6LYYWPWIR6BTE2FJXECSXKQAHVWQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.459511177 (13h43m30.684694254s) [noise=true , address=104.36.82.60:4365 , piece_id=IOYRFBESQVMDVOEH677WCO6CDSU6LOMQOZQOMMXT2QSEAXDRLFWA, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.468110394 (13h43m30.693293461s) [noise=true , address=77.90.31.19:4855 , piece_id=NCMORUSZ6XAEPRPT4YPXHWIZGP5BVLWCDCNBTOC7ECK6QMU22WFQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.620114931 (13h43m30.845298009s) [noise=true , address=79.127.201.215:4349 , piece_id=5KA4X7E475FZVO4JMKFA5RN4IQN2CRCW5VBPYXLMYFOX3VA7ICGQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.663559442 (13h43m30.888742509s) [noise=true , address=77.90.31.16:4752 , piece_id=FKJQ66EGGM57CJOCPKD4V4K4YGWGRQJTFVA5JK2YZBOUFO2KFQDA, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.663591131 (13h43m30.888774198s) [seg_pos={0 0}, upload=12041]: Segment reached optimal threshold of 14 pieces. Aug 26 05:47:15.663955185 (13h43m30.889138262s) [noise=true , address=79.127.205.245:4220 , piece_id=FPXMKCW6YUM5CGTJ27UUGSXZE7VZ6MS542O3H4NYHAKYPM5U4OFQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123xj8bTNShfvqNJh3mSvM6V4TeXQoxFHR5TKELoUKTJJTzDyjD): protocol: write tcp 5.161.89.252:33592->79.127.205.245:4220: use of closed network connection; write tcp 5.161.89.252:33592->79.127.205.245:4220: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:33592->79.127.205.245:4220: use of closed network connection Aug 26 05:47:15.663980523 (13h43m30.88916359s) [noise=true , address=79.127.205.246:4284 , piece_id=EC3P5P5T2ODWFBH4VQ3666AR3TSW3LJZKZU7P2UFB76V22RD5VQQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 5.161.89.252:61910->79.127.205.246:4284: use of closed network connection; write tcp 5.161.89.252:61910->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:61910->79.127.205.246:4284: use of closed network connection Aug 26 05:47:15.664038241 (13h43m30.889221308s) [noise=true , address=64.49.13.154:4934 , piece_id=KDCFYU63FXZ4BHOYEGGO5VC6M3KC7JMERNSY5F24HM7TWJ2PRVHA, seg_pos={0 0}, upload=12041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: read tcp 5.161.89.252:62488->64.49.13.154:4934: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 26 05:47:15.664095149 (13h43m30.889278225s) [noise=true , address=79.127.205.234:4619 , piece_id=KURMGY53IW7WE6SMXSLZDFDMO6SSSILYL66NBM54LRPAZ3HVZXQA, seg_pos={0 0}, upload=12041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 5.161.89.252:33526->79.127.205.234:4619: use of closed network connection; write tcp 5.161.89.252:33526->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:33526->79.127.205.234:4619: use of closed network connection Aug 26 05:47:15.664159890 (13h43m30.889342967s) [seg_pos={0 0}, upload=12041]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 26 05:47:15.664249217 (13h43m30.889432295s) [upload=12041]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:47:15.664255018 (13h43m30.889438096s) [upload=12041]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:47:26.126651265 (13h43m41.351834322s) [upload=12041]: Done uploading segments... Aug 26 05:47:26.126673085 (13h43m41.351856142s) [upload=12041]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 966.250538ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 19 out of 60 is failed (threshold=3) [......X.X.XX.XXXXX....X..X...X...X......X..XX.X.......XX....] duration: 2.806137579s FAIL (2025-08-26 05:49:57 UTC) operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 26 05:46:28.652260030 (13h42m43.877443077s) [upload=12031]: Starting upload Aug 26 05:46:28.652309312 (13h42m43.87749236s) [upload=12031]: Done starting upload Aug 26 05:46:28.652384173 (13h42m43.87756722s) [upload=12031]: Uploading segments... Aug 26 05:46:28.652505932 (13h42m43.877688979s) [upload=12031]: Got next segment. Inline: false Aug 26 05:46:28.652541158 (13h42m43.877724205s) [upload=12031]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:46:28.652544514 (13h42m43.877727551s) [upload=12031]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:46:40.061445530 (13h42m55.286628608s) [seg_pos={0 0}, upload=12031]: Begin upload segment... Aug 26 05:46:40.061488060 (13h42m55.286671137s) [seg_pos={0 0}, upload=12031]: Done begin upload segment. Aug 26 05:46:40.061554374 (13h42m55.286737452s) [noise=true , address=45.91.116.7:4010 , piece_id=FH277WUIQEUP5HUFCO534CCX5APWHIKG7V7QSIYBKLNP43ULPN7Q, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.061611752 (13h42m55.286794849s) [noise=true , address=45.91.116.13:4155 , piece_id=NHY7PPHPYITMIDCFDHOBBHGWZXGOOUHPUNSMPEU4DVH5XCZCBY3A, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.062021513 (13h42m55.2872046s) [noise=true , address=45.91.116.12:4227 , piece_id=AVRMTCXUZCZKO7ADTQHFSPVSMDOTGCP5QIVSS73P27JG7TWZIOMQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.062468782 (13h42m55.2876519s) [noise=true , address=45.91.116.8:4047 , piece_id=E66WZM7JPHLX5DC6HIYJS6PIVUIVN75KRLW66CHVPZEQUB7RHHNA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.062534026 (13h42m55.287717103s) [noise=true , address=104.36.82.14:4221 , piece_id=GO4OPUXGJDX5IMH52JBQIIH4TOLOUCR5PQKVR2N4BUEOXNV5LLFQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.063015901 (13h42m55.288198978s) [noise=true , address=104.36.82.3:4767 , piece_id=URSW43FTPDWCPL2TMRGZZTDESJDGBARFPYEW43WE7OHNDD75JF3Q, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.063369004 (13h42m55.288552091s) [noise=true , address=45.91.116.11:4117 , piece_id=A3ZS3F2HM26OC4AT3ZXQCE4VUA7S77ACXYABZ4K5DZU5ZHASK7MA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.063410292 (13h42m55.28859338s) [noise=true , address=45.91.116.4:4940 , piece_id=3MVHQWYSPY7PCF3ZFT7BUAN62XYFENEEOA3B3LDGTM6HL3BI42ZQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.063862080 (13h42m55.289045158s) [noise=true , address=77.90.31.13:4627 , piece_id=LE6PYVEVSAVB7JMKR3MJSHFP2ZTJMLTWSVX2WS2DMVKWKOM4TKZA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.064200546 (13h42m55.289383624s) [noise=true , address=104.36.82.2:4729 , piece_id=HDVV3RUIKIXMW6TKHJJVXDDK75MGT6FMDWTSBBL54MXY6M6CETEA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.064299062 (13h42m55.289482139s) [noise=true , address=45.91.116.5:4297 , piece_id=AFE5WDDJLDOI56R57TNEX7AHXMOR4EDINRMBCLG6BODWKKA7BOTQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.064693774 (13h42m55.289876851s) [noise=true , address=77.90.31.16:4735 , piece_id=QBSRWDX6MKEAF3FBJ2ZPBRDRNDVJYR5UV5NAEGZGDK2NSWFHRLZA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.064967658 (13h42m55.290150735s) [noise=true , address=104.36.82.2:4732 , piece_id=2XHPT7TCG4P6ID3VYBIA4T5MLDKJFJIKIDQRDNVNLC6L2TCDNYXA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.065182031 (13h42m55.290365109s) [noise=true , address=45.91.116.5:4299 , piece_id=UI5RNMFCDMEEVW2AI5NCQBMS4IULHKTWRM4GA6Q2GXWN7NCFHUHQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.065678393 (13h42m55.290861481s) [noise=true , address=104.36.82.7:4911 , piece_id=KVBWTVBSMJRTDLSUU2BL2OVB3SW4DMDBBD2JM7VMKEQCZGDU7JHQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.066367499 (13h42m55.291550586s) [noise=true , address=77.90.31.21:4878 , piece_id=DWQ5MI6AF7FF655CC3UBNUU35Y3VJCGFOPLQ2FLJBIWXMBU4DLYQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.166559082 (13h42m55.391742129s) [upload=12031]: Next returned nil segment Aug 26 05:46:40.166572948 (13h42m55.391755995s) [upload=12031]: Waiting for error group managing segments... Aug 26 05:46:40.173665544 (13h42m55.398848592s) [noise=true , address=45.91.116.5:4299 , piece_id=UI5RNMFCDMEEVW2AI5NCQBMS4IULHKTWRM4GA6Q2GXWN7NCFHUHQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.174842136 (13h42m55.400025202s) [noise=true , address=45.91.116.8:4047 , piece_id=E66WZM7JPHLX5DC6HIYJS6PIVUIVN75KRLW66CHVPZEQUB7RHHNA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.175255342 (13h42m55.400438389s) [noise=true , address=77.90.31.16:4735 , piece_id=QBSRWDX6MKEAF3FBJ2ZPBRDRNDVJYR5UV5NAEGZGDK2NSWFHRLZA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.175557269 (13h42m55.400740356s) [noise=true , address=45.91.116.5:4297 , piece_id=AFE5WDDJLDOI56R57TNEX7AHXMOR4EDINRMBCLG6BODWKKA7BOTQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.175698043 (13h42m55.400881081s) [noise=true , address=45.91.116.11:4117 , piece_id=A3ZS3F2HM26OC4AT3ZXQCE4VUA7S77ACXYABZ4K5DZU5ZHASK7MA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.176056869 (13h42m55.401239935s) [noise=true , address=45.91.116.12:4227 , piece_id=AVRMTCXUZCZKO7ADTQHFSPVSMDOTGCP5QIVSS73P27JG7TWZIOMQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.176475945 (13h42m55.401659012s) [noise=true , address=77.90.31.21:4878 , piece_id=DWQ5MI6AF7FF655CC3UBNUU35Y3VJCGFOPLQ2FLJBIWXMBU4DLYQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.177490372 (13h42m55.402673449s) [noise=true , address=77.90.31.13:4627 , piece_id=LE6PYVEVSAVB7JMKR3MJSHFP2ZTJMLTWSVX2WS2DMVKWKOM4TKZA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.177539725 (13h42m55.402722771s) [noise=true , address=45.91.116.13:4155 , piece_id=NHY7PPHPYITMIDCFDHOBBHGWZXGOOUHPUNSMPEU4DVH5XCZCBY3A, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.178099717 (13h42m55.403282794s) [noise=true , address=45.91.116.7:4010 , piece_id=FH277WUIQEUP5HUFCO534CCX5APWHIKG7V7QSIYBKLNP43ULPN7Q, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.181059919 (13h42m55.406242966s) [noise=true , address=104.36.82.14:4221 , piece_id=GO4OPUXGJDX5IMH52JBQIIH4TOLOUCR5PQKVR2N4BUEOXNV5LLFQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.182162520 (13h42m55.407345598s) [noise=true , address=104.36.82.7:4911 , piece_id=KVBWTVBSMJRTDLSUU2BL2OVB3SW4DMDBBD2JM7VMKEQCZGDU7JHQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.184028706 (13h42m55.409211784s) [noise=true , address=45.91.116.4:4940 , piece_id=3MVHQWYSPY7PCF3ZFT7BUAN62XYFENEEOA3B3LDGTM6HL3BI42ZQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.184040439 (13h42m55.409223505s) [seg_pos={0 0}, upload=12031]: Segment reached optimal threshold of 13 pieces. Aug 26 05:46:40.184230777 (13h42m55.409413854s) [noise=true , address=104.36.82.3:4767 , piece_id=URSW43FTPDWCPL2TMRGZZTDESJDGBARFPYEW43WE7OHNDD75JF3Q, seg_pos={0 0}, upload=12031]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Aug 26 05:46:40.184361141 (13h42m55.409544208s) [noise=true , address=104.36.82.2:4729 , piece_id=HDVV3RUIKIXMW6TKHJJVXDDK75MGT6FMDWTSBBL54MXY6M6CETEA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: expected piece hash; context canceled; EOF Aug 26 05:46:40.184450850 (13h42m55.409633898s) [noise=true , address=104.36.82.2:4732 , piece_id=2XHPT7TCG4P6ID3VYBIA4T5MLDKJFJIKIDQRDNVNLC6L2TCDNYXA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.184476368 (13h42m55.409659416s) [seg_pos={0 0}, upload=12031]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Aug 26 05:46:40.184580183 (13h42m55.40976323s) [upload=12031]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:46:40.184585603 (13h42m55.40976865s) [upload=12031]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:46:47.044131312 (13h43m2.2693144s) [upload=12031]: Done uploading segments... Aug 26 05:46:47.044152874 (13h43m2.269335951s) [upload=12031]: Upload finished. err: <nil> Duration: 2.80615922s core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 10 out of 60 is failed (threshold=3) [......X....X...............X..X.........XX.........X.XX.X...] duration: 169.960036ms remote: "tcp:136.0.77.2:443" response headers: Content-Length=423 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=185F3AFB7EA3A7A1 X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:47:11 GMT Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=8tjmSuZMkvh Accept-Ranges=bytes target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-26 05:49:51 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F3AFB7EA3A7A1</RequestId><HostId></HostId></Error>" Duration: 169.980864ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 11 out of 60 is failed (threshold=3) [......X.....XX.XX....XX.................X...XX........X.....] duration: 141.06058ms remote: "tcp:45.38.24.2:443" response headers: Content-Type=application/xml Server=Storj X-Amz-Request-Id=185F3AEE0EB33B6A X-Request-Id=McQuPBREAb1 X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:46:14 GMT Accept-Ranges=bytes Content-Length=433 Content-Security-Policy=block-all-mixed-content Vary=Origin target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-26 05:49:50 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F3AEE0EB33B6A</RequestId><HostId></HostId></Error>" Duration: 141.077873ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 8 out of 60 is failed (threshold=3) [........X.X..X.............XX...............XX........X.....] duration: 1.32470758s FAIL (2025-08-26 05:49:41 UTC) operation error S3: GetObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 185F3AEE3B34C493, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled) Duration: 1.324730412s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 17 out of 60 is failed (threshold=3) [......XX.XX..XXX....XX......XX..XX....X............XXX......] duration: 689.773116ms FAIL (2025-08-26 05:49:36 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 689.789807ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 8 out of 60 is failed (threshold=3) [..........X.X..XX.....X...................X.........XX......] duration: 601.901395ms FAIL (2025-08-26 05:49:35 UTC) operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:46:19.122249242 (13h42m34.347432309s) [upload=12027]: Starting upload Aug 26 05:46:19.122336606 (13h42m34.347519673s) [upload=12027]: Done starting upload Aug 26 05:46:19.122389295 (13h42m34.347572352s) [upload=12027]: Uploading segments... Aug 26 05:46:19.122426304 (13h42m34.347609352s) [upload=12027]: Got next segment. Inline: true Aug 26 05:46:19.122431003 (13h42m34.34761406s) [upload=12027]: Waiting for error group managing segments... Aug 26 05:46:19.122482891 (13h42m34.347665938s) [upload=12027]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:46:19.122487078 (13h42m34.347670135s) [upload=12027]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:46:19.122489442 (13h42m34.3476725s) [upload=12027]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:46:30.124196038 (13h42m45.349379106s) [upload=12027]: Done uploading segments... Aug 26 05:46:30.124211648 (13h42m45.349394705s) [upload=12027]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration:* 601.921754ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 18 out of 60 is failed (threshold=3) [........XXX....XXX......X....X...X......XX.X.XX....XX.XX....] duration: 1.142177056s FAIL (2025-08-26 05:49:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.142197915s edge gateway us-select-1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 5 out of 60 is failed (threshold=6) [....X..X....X....X.......................X..................] duration: 127.672423ms remote: "tcp:136.0.77.2:443" response headers: Access-Control-Allow-Methods=GET, HEAD X-Request-Id=ZFwx4y7eAxE Content-Type=text/html; charset=utf-8 Accept-Ranges=bytes Access-Control-Allow-Headers=* Access-Control-Allow-Origin=* Date=Tue, 26 Aug 2025 05:38:38 GMT target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt FAIL (2025-08-26 05:49:31 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error \| Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error \| Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error \| Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY" Duration: 127.701107ms edge linksharing bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 10 out of 60 is failed (threshold=3) [.......X....X...............X..X.........XX.........X.XX.X..] duration: 169.512673ms remote: "tcp:136.0.77.2:443" response headers: Content-Length=423 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=185F3AFB7EA3A7A1 X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:47:11 GMT Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=8tjmSuZMkvh Accept-Ranges=bytes target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-26 05:49:20 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F3AFB7EA3A7A1</RequestId><HostId></HostId></Error>" Duration: 169.541267ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 16 out of 60 is failed (threshold=3) [.........XX.X.X.XX....X..X...XX.XXX..........X..XX..........] duration: 564.162969ms FAIL (2025-08-26 05:49:17 UTC) operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 26 05:40:50.174916229 (13h37m5.400099286s) [upload=11948]: Starting upload Aug 26 05:40:50.174950314 (13h37m5.400133371s) [upload=11948]: Done starting upload Aug 26 05:40:50.174991591 (13h37m5.400174638s) [upload=11948]: Uploading segments... Aug 26 05:40:50.175014524 (13h37m5.400197571s) [upload=11948]: Got next segment. Inline: true Aug 26 05:40:50.175017720 (13h37m5.400200767s) [upload=11948]: Waiting for error group managing segments... Aug 26 05:40:50.175043148 (13h37m5.400226195s) [upload=11948]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:40:50.175046144 (13h37m5.400229191s) [upload=11948]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:40:50.175048268 (13h37m5.400231315s) [upload=11948]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:41:09.312511333 (13h37m24.53769439s) [upload=11948]: Done uploading segments... Aug 26 05:41:09.312532192 (13h37m24.537715249s) [upload=11948]: Upload finished. err: <nil> Duration:* 564.185302ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 19 out of 60 is failed (threshold=3) [...XX....X..X.XX....X..X..X..X.......XX.....XXXXX.....XX....] duration: 547.508091ms FAIL (2025-08-26 05:49:15 UTC) operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 547.535273ms core uplink us1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 5 out of 60 is failed (threshold=6) [.....X..X....X....X.......................X.................] duration: 389.413486ms remote: "tcp:136.0.77.2:443" response headers: Access-Control-Allow-Methods=GET, HEAD X-Request-Id=ZFwx4y7eAxE Content-Type=text/html; charset=utf-8 Accept-Ranges=bytes Access-Control-Allow-Headers=* Access-Control-Allow-Origin=* Date=Tue, 26 Aug 2025 05:38:38 GMT target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt FAIL (2025-08-26 05:49:15 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error \| Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error \| Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error \| Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY" Duration: 389.438374ms edge linksharing bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 29 out of 60 is failed (threshold=3) [...XXXXXXXX.XX.......X..XX.XXXXXXX.....XX..X.XXX......XX.X..] duration: 2.506320809s FAIL (2025-08-26 05:49:09 UTC) operation: Commit uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 2.506349692s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 8 out of 60 is failed (threshold=3) [.........X.X..X.............XX...............XX........X....] duration: 2.819136601s FAIL (2025-08-26 05:49:05 UTC) operation error S3: GetObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 185F3AEE3B34C493, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled) Duration: 2.819149895s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 8 out of 60 is failed (threshold=3) [...........X.X..XX.....X...................X.........XX.....] duration: 625.774823ms FAIL (2025-08-26 05:49:04 UTC) operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:46:19.122249242 (13h42m34.347432309s) [upload=12027]: Starting upload Aug 26 05:46:19.122336606 (13h42m34.347519673s) [upload=12027]: Done starting upload Aug 26 05:46:19.122389295 (13h42m34.347572352s) [upload=12027]: Uploading segments... Aug 26 05:46:19.122426304 (13h42m34.347609352s) [upload=12027]: Got next segment. Inline: true Aug 26 05:46:19.122431003 (13h42m34.34761406s) [upload=12027]: Waiting for error group managing segments... Aug 26 05:46:19.122482891 (13h42m34.347665938s) [upload=12027]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:46:19.122487078 (13h42m34.347670135s) [upload=12027]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:46:19.122489442 (13h42m34.3476725s) [upload=12027]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:46:30.124196038 (13h42m45.349379106s) [upload=12027]: Done uploading segments... Aug 26 05:46:30.124211648 (13h42m45.349394705s) [upload=12027]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration:* 625.806332ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 11 out of 60 is failed (threshold=3) [X........XX.X.X.X.....X..X......................X.....X..X..] duration: 2.209213178s FAIL (2025-08-26 05:49:03 UTC) operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== O4JMKFA5RN4IQN2CRCW5VBPYXLMYFOX3VA7ICGQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.337676887 (13h43m30.562859964s) [noise=true , address=77.90.31.15:4717 , piece_id=5I67NYFJRZT7ORPYPVSJA56BB4LYVB3WUQOE7ZXFFHTCHMI2TYVQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.338323312 (13h43m30.563506388s) [noise=true , address=104.36.82.44:4890 , piece_id=NYLN3X5UXITCKCFZ6E2WIGI7WZV7USAFIEMUNESNBYU4BVOKAW5Q, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.340398391 (13h43m30.565581469s) [noise=true , address=79.127.205.245:4220 , piece_id=FPXMKCW6YUM5CGTJ27UUGSXZE7VZ6MS542O3H4NYHAKYPM5U4OFQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.340778866 (13h43m30.565961953s) [noise=true , address=104.36.82.60:4365 , piece_id=IOYRFBESQVMDVOEH677WCO6CDSU6LOMQOZQOMMXT2QSEAXDRLFWA, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.341147428 (13h43m30.566330505s) [noise=true , address=79.127.205.246:4284 , piece_id=EC3P5P5T2ODWFBH4VQ3666AR3TSW3LJZKZU7P2UFB76V22RD5VQQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.341604627 (13h43m30.566787705s) [noise=true , address=104.36.82.11:4128 , piece_id=QIDJJMBP36RUA4XXQ2Q2HDF2R4DW53A222OEQEWA2AMX6RSQCVFA, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.341967629 (13h43m30.567150706s) [noise=true , address=77.90.31.18:4821 , piece_id=RSEEETAXPX2UNFT3NAGVQIDD6HZXMX2BRHMKMTVXPNWVXKFVSYXQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.342312617 (13h43m30.567495705s) [noise=true , address=45.91.116.6:4002 , piece_id=42SYNFZV4JY4CHJ4KHGEPLK5BY3PVIII66CTFE4I4SAJLVELULYQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.342682082 (13h43m30.56786516s) [noise=true , address=104.36.82.5:4848 , piece_id=YPQNRHC7BMQET4FH3IOP3WVAY6D3H5FCVJSSIYWL6KAJ43GFPDWA, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.343107501 (13h43m30.568290578s) [noise=true , address=79.127.219.47:4065 , piece_id=J774Z6CPOJBLVO4KC2ODC2FMFRG5LQYLHL2LFQF3AR4SWD2CD6BQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.343696528 (13h43m30.568879605s) [noise=true , address=104.36.82.23:4466 , piece_id=U6DXP2ADNBE657QXHKT633JIV66ROOTRQKF4B7OAJTVDOV3CRLUA, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.347700131 (13h43m30.572883208s) [noise=true , address=104.36.82.11:4140 , piece_id=BA5JUOEPAD4TNNCFEHMQ5KO3CDJJ5L56GDXZMT6VIGGBXCETBYGQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.353294242 (13h43m30.578477318s) [noise=true , address=79.127.205.234:4619 , piece_id=KURMGY53IW7WE6SMXSLZDFDMO6SSSILYL66NBM54LRPAZ3HVZXQA, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.357005705 (13h43m30.582188852s) [noise=true , address=104.36.82.50:4017 , piece_id=VXMNPE5WHITPQP7LQUDAEYAN6LYYWPWIR6BTE2FJXECSXKQAHVWQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.360097525 (13h43m30.585280602s) [noise=true , address=64.49.13.154:4934 , piece_id=KDCFYU63FXZ4BHOYEGGO5VC6M3KC7JMERNSY5F24HM7TWJ2PRVHA, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.360718501 (13h43m30.585901589s) [noise=true , address=77.90.31.16:4752 , piece_id=FKJQ66EGGM57CJOCPKD4V4K4YGWGRQJTFVA5JK2YZBOUFO2KFQDA, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.363118261 (13h43m30.588301337s) [noise=true , address=77.90.31.19:4855 , piece_id=NCMORUSZ6XAEPRPT4YPXHWIZGP5BVLWCDCNBTOC7ECK6QMU22WFQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.442534509 (13h43m30.667717586s) [upload=12041]: Next returned nil segment Aug 26 05:47:15.442550258 (13h43m30.667733345s) [upload=12041]: Waiting for error group managing segments... Aug 26 05:47:15.451182057 (13h43m30.676365164s) [noise=true , address=77.90.31.18:4821 , piece_id=RSEEETAXPX2UNFT3NAGVQIDD6HZXMX2BRHMKMTVXPNWVXKFVSYXQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.452462604 (13h43m30.677645681s) [noise=true , address=79.127.219.47:4065 , piece_id=J774Z6CPOJBLVO4KC2ODC2FMFRG5LQYLHL2LFQF3AR4SWD2CD6BQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.454260442 (13h43m30.679443529s) [noise=true , address=45.91.116.6:4002 , piece_id=42SYNFZV4JY4CHJ4KHGEPLK5BY3PVIII66CTFE4I4SAJLVELULYQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.455280057 (13h43m30.680463144s) [noise=true , address=77.90.31.15:4717 , piece_id=5I67NYFJRZT7ORPYPVSJA56BB4LYVB3WUQOE7ZXFFHTCHMI2TYVQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.456937692 (13h43m30.682120769s) [noise=true , address=104.36.82.5:4848 , piece_id=YPQNRHC7BMQET4FH3IOP3WVAY6D3H5FCVJSSIYWL6KAJ43GFPDWA, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.457694363 (13h43m30.68287745s) [noise=true , address=104.36.82.11:4128 , piece_id=QIDJJMBP36RUA4XXQ2Q2HDF2R4DW53A222OEQEWA2AMX6RSQCVFA, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.458098192 (13h43m30.68328127s) [noise=true , address=104.36.82.11:4140 , piece_id=BA5JUOEPAD4TNNCFEHMQ5KO3CDJJ5L56GDXZMT6VIGGBXCETBYGQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.458479239 (13h43m30.683662315s) [noise=true , address=104.36.82.23:4466 , piece_id=U6DXP2ADNBE657QXHKT633JIV66ROOTRQKF4B7OAJTVDOV3CRLUA, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.458886112 (13h43m30.684069199s) [noise=true , address=104.36.82.44:4890 , piece_id=NYLN3X5UXITCKCFZ6E2WIGI7WZV7USAFIEMUNESNBYU4BVOKAW5Q, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.459042417 (13h43m30.684225493s) [noise=true , address=104.36.82.50:4017 , piece_id=VXMNPE5WHITPQP7LQUDAEYAN6LYYWPWIR6BTE2FJXECSXKQAHVWQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.459511177 (13h43m30.684694254s) [noise=true , address=104.36.82.60:4365 , piece_id=IOYRFBESQVMDVOEH677WCO6CDSU6LOMQOZQOMMXT2QSEAXDRLFWA, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.468110394 (13h43m30.693293461s) [noise=true , address=77.90.31.19:4855 , piece_id=NCMORUSZ6XAEPRPT4YPXHWIZGP5BVLWCDCNBTOC7ECK6QMU22WFQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.620114931 (13h43m30.845298009s) [noise=true , address=79.127.201.215:4349 , piece_id=5KA4X7E475FZVO4JMKFA5RN4IQN2CRCW5VBPYXLMYFOX3VA7ICGQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.663559442 (13h43m30.888742509s) [noise=true , address=77.90.31.16:4752 , piece_id=FKJQ66EGGM57CJOCPKD4V4K4YGWGRQJTFVA5JK2YZBOUFO2KFQDA, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.663591131 (13h43m30.888774198s) [seg_pos={0 0}, upload=12041]: Segment reached optimal threshold of 14 pieces. Aug 26 05:47:15.663955185 (13h43m30.889138262s) [noise=true , address=79.127.205.245:4220 , piece_id=FPXMKCW6YUM5CGTJ27UUGSXZE7VZ6MS542O3H4NYHAKYPM5U4OFQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123xj8bTNShfvqNJh3mSvM6V4TeXQoxFHR5TKELoUKTJJTzDyjD): protocol: write tcp 5.161.89.252:33592->79.127.205.245:4220: use of closed network connection; write tcp 5.161.89.252:33592->79.127.205.245:4220: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:33592->79.127.205.245:4220: use of closed network connection Aug 26 05:47:15.663980523 (13h43m30.88916359s) [noise=true , address=79.127.205.246:4284 , piece_id=EC3P5P5T2ODWFBH4VQ3666AR3TSW3LJZKZU7P2UFB76V22RD5VQQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 5.161.89.252:61910->79.127.205.246:4284: use of closed network connection; write tcp 5.161.89.252:61910->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:61910->79.127.205.246:4284: use of closed network connection Aug 26 05:47:15.664038241 (13h43m30.889221308s) [noise=true , address=64.49.13.154:4934 , piece_id=KDCFYU63FXZ4BHOYEGGO5VC6M3KC7JMERNSY5F24HM7TWJ2PRVHA, seg_pos={0 0}, upload=12041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: read tcp 5.161.89.252:62488->64.49.13.154:4934: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 26 05:47:15.664095149 (13h43m30.889278225s) [noise=true , address=79.127.205.234:4619 , piece_id=KURMGY53IW7WE6SMXSLZDFDMO6SSSILYL66NBM54LRPAZ3HVZXQA, seg_pos={0 0}, upload=12041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 5.161.89.252:33526->79.127.205.234:4619: use of closed network connection; write tcp 5.161.89.252:33526->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:33526->79.127.205.234:4619: use of closed network connection Aug 26 05:47:15.664159890 (13h43m30.889342967s) [seg_pos={0 0}, upload=12041]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 26 05:47:15.664249217 (13h43m30.889432295s) [upload=12041]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:47:15.664255018 (13h43m30.889438096s) [upload=12041]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:47:26.126651265 (13h43m41.351834322s) [upload=12041]: Done uploading segments... Aug 26 05:47:26.126673085 (13h43m41.351856142s) [upload=12041]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 2.209231954s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 11 out of 60 is failed (threshold=3) [.......X.....XX.XX....XX.................X...XX........X....] duration: 221.599378ms remote: "tcp:45.38.24.2:443" response headers: Content-Type=application/xml Server=Storj X-Amz-Request-Id=185F3AEE0EB33B6A X-Request-Id=McQuPBREAb1 X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:46:14 GMT Accept-Ranges=bytes Content-Length=433 Content-Security-Policy=block-all-mixed-content Vary=Origin target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-26 05:49:03 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F3AEE0EB33B6A</RequestId><HostId></HostId></Error>" Duration: 221.613947ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 19 out of 60 is failed (threshold=3) [.......X.X.XX.XXXXX....X..X...X...X......X..XX.X.......XX...] duration: 1.162390522s FAIL (2025-08-26 05:48:51 UTC) operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 26 05:46:28.652260030 (13h42m43.877443077s) [upload=12031]: Starting upload Aug 26 05:46:28.652309312 (13h42m43.87749236s) [upload=12031]: Done starting upload Aug 26 05:46:28.652384173 (13h42m43.87756722s) [upload=12031]: Uploading segments... Aug 26 05:46:28.652505932 (13h42m43.877688979s) [upload=12031]: Got next segment. Inline: false Aug 26 05:46:28.652541158 (13h42m43.877724205s) [upload=12031]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:46:28.652544514 (13h42m43.877727551s) [upload=12031]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:46:40.061445530 (13h42m55.286628608s) [seg_pos={0 0}, upload=12031]: Begin upload segment... Aug 26 05:46:40.061488060 (13h42m55.286671137s) [seg_pos={0 0}, upload=12031]: Done begin upload segment. Aug 26 05:46:40.061554374 (13h42m55.286737452s) [noise=true , address=45.91.116.7:4010 , piece_id=FH277WUIQEUP5HUFCO534CCX5APWHIKG7V7QSIYBKLNP43ULPN7Q, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.061611752 (13h42m55.286794849s) [noise=true , address=45.91.116.13:4155 , piece_id=NHY7PPHPYITMIDCFDHOBBHGWZXGOOUHPUNSMPEU4DVH5XCZCBY3A, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.062021513 (13h42m55.2872046s) [noise=true , address=45.91.116.12:4227 , piece_id=AVRMTCXUZCZKO7ADTQHFSPVSMDOTGCP5QIVSS73P27JG7TWZIOMQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.062468782 (13h42m55.2876519s) [noise=true , address=45.91.116.8:4047 , piece_id=E66WZM7JPHLX5DC6HIYJS6PIVUIVN75KRLW66CHVPZEQUB7RHHNA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.062534026 (13h42m55.287717103s) [noise=true , address=104.36.82.14:4221 , piece_id=GO4OPUXGJDX5IMH52JBQIIH4TOLOUCR5PQKVR2N4BUEOXNV5LLFQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.063015901 (13h42m55.288198978s) [noise=true , address=104.36.82.3:4767 , piece_id=URSW43FTPDWCPL2TMRGZZTDESJDGBARFPYEW43WE7OHNDD75JF3Q, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.063369004 (13h42m55.288552091s) [noise=true , address=45.91.116.11:4117 , piece_id=A3ZS3F2HM26OC4AT3ZXQCE4VUA7S77ACXYABZ4K5DZU5ZHASK7MA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.063410292 (13h42m55.28859338s) [noise=true , address=45.91.116.4:4940 , piece_id=3MVHQWYSPY7PCF3ZFT7BUAN62XYFENEEOA3B3LDGTM6HL3BI42ZQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.063862080 (13h42m55.289045158s) [noise=true , address=77.90.31.13:4627 , piece_id=LE6PYVEVSAVB7JMKR3MJSHFP2ZTJMLTWSVX2WS2DMVKWKOM4TKZA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.064200546 (13h42m55.289383624s) [noise=true , address=104.36.82.2:4729 , piece_id=HDVV3RUIKIXMW6TKHJJVXDDK75MGT6FMDWTSBBL54MXY6M6CETEA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.064299062 (13h42m55.289482139s) [noise=true , address=45.91.116.5:4297 , piece_id=AFE5WDDJLDOI56R57TNEX7AHXMOR4EDINRMBCLG6BODWKKA7BOTQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.064693774 (13h42m55.289876851s) [noise=true , address=77.90.31.16:4735 , piece_id=QBSRWDX6MKEAF3FBJ2ZPBRDRNDVJYR5UV5NAEGZGDK2NSWFHRLZA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.064967658 (13h42m55.290150735s) [noise=true , address=104.36.82.2:4732 , piece_id=2XHPT7TCG4P6ID3VYBIA4T5MLDKJFJIKIDQRDNVNLC6L2TCDNYXA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.065182031 (13h42m55.290365109s) [noise=true , address=45.91.116.5:4299 , piece_id=UI5RNMFCDMEEVW2AI5NCQBMS4IULHKTWRM4GA6Q2GXWN7NCFHUHQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.065678393 (13h42m55.290861481s) [noise=true , address=104.36.82.7:4911 , piece_id=KVBWTVBSMJRTDLSUU2BL2OVB3SW4DMDBBD2JM7VMKEQCZGDU7JHQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.066367499 (13h42m55.291550586s) [noise=true , address=77.90.31.21:4878 , piece_id=DWQ5MI6AF7FF655CC3UBNUU35Y3VJCGFOPLQ2FLJBIWXMBU4DLYQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.166559082 (13h42m55.391742129s) [upload=12031]: Next returned nil segment Aug 26 05:46:40.166572948 (13h42m55.391755995s) [upload=12031]: Waiting for error group managing segments... Aug 26 05:46:40.173665544 (13h42m55.398848592s) [noise=true , address=45.91.116.5:4299 , piece_id=UI5RNMFCDMEEVW2AI5NCQBMS4IULHKTWRM4GA6Q2GXWN7NCFHUHQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.174842136 (13h42m55.400025202s) [noise=true , address=45.91.116.8:4047 , piece_id=E66WZM7JPHLX5DC6HIYJS6PIVUIVN75KRLW66CHVPZEQUB7RHHNA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.175255342 (13h42m55.400438389s) [noise=true , address=77.90.31.16:4735 , piece_id=QBSRWDX6MKEAF3FBJ2ZPBRDRNDVJYR5UV5NAEGZGDK2NSWFHRLZA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.175557269 (13h42m55.400740356s) [noise=true , address=45.91.116.5:4297 , piece_id=AFE5WDDJLDOI56R57TNEX7AHXMOR4EDINRMBCLG6BODWKKA7BOTQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.175698043 (13h42m55.400881081s) [noise=true , address=45.91.116.11:4117 , piece_id=A3ZS3F2HM26OC4AT3ZXQCE4VUA7S77ACXYABZ4K5DZU5ZHASK7MA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.176056869 (13h42m55.401239935s) [noise=true , address=45.91.116.12:4227 , piece_id=AVRMTCXUZCZKO7ADTQHFSPVSMDOTGCP5QIVSS73P27JG7TWZIOMQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.176475945 (13h42m55.401659012s) [noise=true , address=77.90.31.21:4878 , piece_id=DWQ5MI6AF7FF655CC3UBNUU35Y3VJCGFOPLQ2FLJBIWXMBU4DLYQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.177490372 (13h42m55.402673449s) [noise=true , address=77.90.31.13:4627 , piece_id=LE6PYVEVSAVB7JMKR3MJSHFP2ZTJMLTWSVX2WS2DMVKWKOM4TKZA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.177539725 (13h42m55.402722771s) [noise=true , address=45.91.116.13:4155 , piece_id=NHY7PPHPYITMIDCFDHOBBHGWZXGOOUHPUNSMPEU4DVH5XCZCBY3A, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.178099717 (13h42m55.403282794s) [noise=true , address=45.91.116.7:4010 , piece_id=FH277WUIQEUP5HUFCO534CCX5APWHIKG7V7QSIYBKLNP43ULPN7Q, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.181059919 (13h42m55.406242966s) [noise=true , address=104.36.82.14:4221 , piece_id=GO4OPUXGJDX5IMH52JBQIIH4TOLOUCR5PQKVR2N4BUEOXNV5LLFQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.182162520 (13h42m55.407345598s) [noise=true , address=104.36.82.7:4911 , piece_id=KVBWTVBSMJRTDLSUU2BL2OVB3SW4DMDBBD2JM7VMKEQCZGDU7JHQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.184028706 (13h42m55.409211784s) [noise=true , address=45.91.116.4:4940 , piece_id=3MVHQWYSPY7PCF3ZFT7BUAN62XYFENEEOA3B3LDGTM6HL3BI42ZQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.184040439 (13h42m55.409223505s) [seg_pos={0 0}, upload=12031]: Segment reached optimal threshold of 13 pieces. Aug 26 05:46:40.184230777 (13h42m55.409413854s) [noise=true , address=104.36.82.3:4767 , piece_id=URSW43FTPDWCPL2TMRGZZTDESJDGBARFPYEW43WE7OHNDD75JF3Q, seg_pos={0 0}, upload=12031]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Aug 26 05:46:40.184361141 (13h42m55.409544208s) [noise=true , address=104.36.82.2:4729 , piece_id=HDVV3RUIKIXMW6TKHJJVXDDK75MGT6FMDWTSBBL54MXY6M6CETEA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: expected piece hash; context canceled; EOF Aug 26 05:46:40.184450850 (13h42m55.409633898s) [noise=true , address=104.36.82.2:4732 , piece_id=2XHPT7TCG4P6ID3VYBIA4T5MLDKJFJIKIDQRDNVNLC6L2TCDNYXA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.184476368 (13h42m55.409659416s) [seg_pos={0 0}, upload=12031]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Aug 26 05:46:40.184580183 (13h42m55.40976323s) [upload=12031]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:46:40.184585603 (13h42m55.40976865s) [upload=12031]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:46:47.044131312 (13h43m2.2693144s) [upload=12031]: Done uploading segments... Aug 26 05:46:47.044152874 (13h43m2.269335951s) [upload=12031]: Upload finished. err: <nil> Duration: 1.16241555s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 18 out of 60 is failed (threshold=3) [.........XXX....XXX......X....X...X......XX.X.XX....XX.XX...] duration: 722.822731ms FAIL (2025-08-26 05:48:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 722.879447ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 8 out of 60 is failed (threshold=3) [............X.X..XX.....X...................X.........XX....] duration: 849.577966ms FAIL (2025-08-26 05:48:45 UTC) operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:46:19.122249242 (13h42m34.347432309s) [upload=12027]: Starting upload Aug 26 05:46:19.122336606 (13h42m34.347519673s) [upload=12027]: Done starting upload Aug 26 05:46:19.122389295 (13h42m34.347572352s) [upload=12027]: Uploading segments... Aug 26 05:46:19.122426304 (13h42m34.347609352s) [upload=12027]: Got next segment. Inline: true Aug 26 05:46:19.122431003 (13h42m34.34761406s) [upload=12027]: Waiting for error group managing segments... Aug 26 05:46:19.122482891 (13h42m34.347665938s) [upload=12027]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:46:19.122487078 (13h42m34.347670135s) [upload=12027]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:46:19.122489442 (13h42m34.3476725s) [upload=12027]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:46:30.124196038 (13h42m45.349379106s) [upload=12027]: Done uploading segments... Aug 26 05:46:30.124211648 (13h42m45.349394705s) [upload=12027]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration:* 849.626619ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 17 out of 60 is failed (threshold=3) [.......XX.XX..XXX....XX......XX..XX....X............XXX.....] duration: 629.063636ms FAIL (2025-08-26 05:48:39 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 629.091008ms edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 11 out of 60 is failed (threshold=3) [........X.....XX.XX....XX.................X...XX........X...] duration: 170.860625ms remote: "tcp:45.38.24.2:443" response headers: Content-Type=application/xml Server=Storj X-Amz-Request-Id=185F3AEE0EB33B6A X-Request-Id=McQuPBREAb1 X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:46:14 GMT Accept-Ranges=bytes Content-Length=433 Content-Security-Policy=block-all-mixed-content Vary=Origin target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-26 05:48:28 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F3AEE0EB33B6A</RequestId><HostId></HostId></Error>" Duration: 170.887757ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 5 out of 60 is failed (threshold=6) [......X..X....X....X.......................X................] duration: 328.512817ms remote: "tcp:136.0.77.2:443" response headers: Access-Control-Allow-Methods=GET, HEAD X-Request-Id=ZFwx4y7eAxE Content-Type=text/html; charset=utf-8 Accept-Ranges=bytes Access-Control-Allow-Headers=* Access-Control-Allow-Origin=* Date=Tue, 26 Aug 2025 05:38:38 GMT target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt FAIL (2025-08-26 05:48:27 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error \| Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error \| Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error \| Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY" Duration: 328.53085ms edge linksharing bgp us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 17 out of 60 is failed (threshold=3) [........XX.XX..XXX....XX......XX..XX....X............XXX....] duration: 2.316406341s FAIL (2025-08-26 05:48:23 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.316424615s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 19 out of 60 is failed (threshold=3) [....XX....X..X.XX....X..X..X..X.......XX.....XXXXX.....XX...] duration: 619.754311ms FAIL (2025-08-26 05:48:22 UTC) operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 619.777907ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 8 out of 60 is failed (threshold=3) [.............X.X..XX.....X...................X.........XX...] duration: 710.491372ms FAIL (2025-08-26 05:48:20 UTC) operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:46:19.122249242 (13h42m34.347432309s) [upload=12027]: Starting upload Aug 26 05:46:19.122336606 (13h42m34.347519673s) [upload=12027]: Done starting upload Aug 26 05:46:19.122389295 (13h42m34.347572352s) [upload=12027]: Uploading segments... Aug 26 05:46:19.122426304 (13h42m34.347609352s) [upload=12027]: Got next segment. Inline: true Aug 26 05:46:19.122431003 (13h42m34.34761406s) [upload=12027]: Waiting for error group managing segments... Aug 26 05:46:19.122482891 (13h42m34.347665938s) [upload=12027]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:46:19.122487078 (13h42m34.347670135s) [upload=12027]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:46:19.122489442 (13h42m34.3476725s) [upload=12027]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:46:30.124196038 (13h42m45.349379106s) [upload=12027]: Done uploading segments... Aug 26 05:46:30.124211648 (13h42m45.349394705s) [upload=12027]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration:* 710.51613ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 16 out of 60 is failed (threshold=3) [..........XX.X.X.XX....X..X...XX.XXX..........X..XX.........] duration: 592.839492ms FAIL (2025-08-26 05:48:11 UTC) operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 26 05:40:50.174916229 (13h37m5.400099286s) [upload=11948]: Starting upload Aug 26 05:40:50.174950314 (13h37m5.400133371s) [upload=11948]: Done starting upload Aug 26 05:40:50.174991591 (13h37m5.400174638s) [upload=11948]: Uploading segments... Aug 26 05:40:50.175014524 (13h37m5.400197571s) [upload=11948]: Got next segment. Inline: true Aug 26 05:40:50.175017720 (13h37m5.400200767s) [upload=11948]: Waiting for error group managing segments... Aug 26 05:40:50.175043148 (13h37m5.400226195s) [upload=11948]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:40:50.175046144 (13h37m5.400229191s) [upload=11948]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:40:50.175048268 (13h37m5.400231315s) [upload=11948]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:41:09.312511333 (13h37m24.53769439s) [upload=11948]: Done uploading segments... Aug 26 05:41:09.312532192 (13h37m24.537715249s) [upload=11948]: Upload finished. err: <nil> Duration:* 592.863347ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 29 out of 60 is failed (threshold=3) [....XXXXXXXX.XX.......X..XX.XXXXXXX.....XX..X.XXX......XX.X.] duration: 3.131862777s FAIL (2025-08-26 05:48:10 UTC) operation: Commit uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 3.13188612s core uplink us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 10 out of 60 is failed (threshold=3) [........X....X...............X..X.........XX.........X.XX.X.] duration: 223.884537ms remote: "tcp:136.0.77.2:443" response headers: Content-Length=423 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=185F3AFB7EA3A7A1 X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:47:11 GMT Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=8tjmSuZMkvh Accept-Ranges=bytes target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-26 05:48:10 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F3AFB7EA3A7A1</RequestId><HostId></HostId></Error>" Duration: 223.8969ms edge gateway vhost bgp us1

Orbiter Check History

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)