Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 14 out of 60 is failed (threshold=3) [................X.....X...........X.X.XX.XXXXX....X..X...X..] duration: 6.860621285s FAIL (2025-08-26 05:27:02 UTC) operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:25:48.268296054 (13h22m3.493479131s) [upload=11734]: Starting upload Aug 26 05:25:48.268414677 (13h22m3.493597765s) [upload=11734]: Done starting upload Aug 26 05:25:48.268504676 (13h22m3.493687743s) [upload=11734]: Uploading segments... Aug 26 05:25:48.268985209 (13h22m3.494168266s) [upload=11734]: Got next segment. Inline: false Aug 26 05:25:48.269022029 (13h22m3.494205096s) [upload=11734]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:25:48.269026998 (13h22m3.494210056s) [upload=11734]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:25:48.586807534 (13h22m3.811990571s) [seg_pos={0 0}, upload=11734]: Begin upload segment... Aug 26 05:25:48.586835076 (13h22m3.812018113s) [seg_pos={0 0}, upload=11734]: Done begin upload segment. Aug 26 05:25:48.586852479 (13h22m3.812035516s) [noise=true , address=45.91.116.7:4010 , piece_id=DCQYN3ZJSCC6TYXEXBGYTVD5E4WMIOTPBHNUYBKRX4A4AYORWMAA, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.586944582 (13h22m3.812127649s) [noise=true , address=45.91.116.7:4009 , piece_id=IWJLCN5TU5JAGWPCQYE2OTYYGAEPV2JLV53GSEVEZ7MVNA67BG5A, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.587113278 (13h22m3.812296326s) [noise=true , address=104.36.82.12:4150 , piece_id=I7QLZFNU2LWDDIFX6JVA4444URQGVEK5KRCZLR2L4PI445S2LB6Q, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.587299689 (13h22m3.812482726s) [noise=true , address=104.36.82.7:4910 , piece_id=RTT6ICFSXO7LQFGSZZZEIW7OFEZOEXZ632DAQCHCYZKBYA4LIHOQ, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.587470419 (13h22m3.812653467s) [noise=true , address=45.91.116.14:4191 , piece_id=4BRPYBC3UGWTZ2XJZTOXNU5D5UZCSAAFNCBWCZI2ABUNQD5JOLJA, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.587613979 (13h22m3.812797037s) [noise=true , address=45.91.116.12:4225 , piece_id=4YM7MDAWIEEGU6KA236MJHGDN4ZEKVH2S5NXIUQIXA6QKFXSAIOA, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.587638876 (13h22m3.812821923s) [noise=true , address=77.90.31.11:4553 , piece_id=GKNVPWP4LEUCSEJEERV73GEDEPGI4L47UTVE77Q3GVCNZBCPU6SA, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.587841867 (13h22m3.813024904s) [noise=true , address=45.91.116.6:4974 , piece_id=R3SZHRSXFZBD5T3CIN52G2VUTDJBTWDRDOFLHXPNNRVKTH3FECRQ, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.588047053 (13h22m3.81323009s) [noise=true , address=77.90.31.14:4663 , piece_id=PAHL4S3LD3YBN4GP7NCLQY2OKNQNGHJBOYGIZNUQUJPXKA376UBQ, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.588153783 (13h22m3.81333685s) [noise=true , address=77.90.31.18:4805 , piece_id=2Q6BP3QNYEWOZ5QGUKG7TLH3UWCOL2JAPP6WIPRHLL4SI3BIM6MA, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.588232171 (13h22m3.813415218s) [noise=true , address=77.90.31.18:4806 , piece_id=T4FD3NDAZ7WHSQDJP36J6VHB6PHFQWX6YOV3N5D7MUGZGFEW4S4A, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.588450240 (13h22m3.813633287s) [noise=true , address=45.91.116.13:4153 , piece_id=AVTQMUCQMMEUK5LT4GKT4AHRWVH5PU2O34MVSVB5X73WBM5IHQZA, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.588772525 (13h22m3.813955593s) [noise=true , address=45.91.116.6:4973 , piece_id=BXMHGXBQGL67RDPATOXCUKNPBFUCLBMNZMUVUSH4RUPJUA73SSJQ, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.589311809 (13h22m3.814494876s) [noise=true , address=77.90.31.15:4699 , piece_id=IEIRX6YQFDHD6KLK4NK4OWIZ5H67SUQRERGKLE4KRIFFTME5TAGA, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.589915933 (13h22m3.81509903s) [noise=true , address=45.91.116.14:4190 , piece_id=OY6EURWMYI4JF46Q5ZUMAW6F6VPFJMKMA5DT55NRUPJ5B27L5ZYQ, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.590632359 (13h22m3.815815426s) [noise=true , address=45.91.116.11:4117 , piece_id=BIK6IZNYHXPW7UNJCEPFOQR6FNS45FASODJEJJUNKTYJCDPITSYA, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.694796915 (13h22m3.919979962s) [upload=11734]: Next returned nil segment Aug 26 05:25:48.694809519 (13h22m3.919992565s) [upload=11734]: Waiting for error group managing segments... Aug 26 05:25:48.703657829 (13h22m3.928840877s) [noise=true , address=45.91.116.11:4117 , piece_id=BIK6IZNYHXPW7UNJCEPFOQR6FNS45FASODJEJJUNKTYJCDPITSYA, seg_pos={0 0}, upload=11734]: Done uploading piece. err: <nil> Aug 26 05:25:48.704009500 (13h22m3.929192547s) [noise=true , address=45.91.116.12:4225 , piece_id=4YM7MDAWIEEGU6KA236MJHGDN4ZEKVH2S5NXIUQIXA6QKFXSAIOA, seg_pos={0 0}, upload=11734]: Done uploading piece. err: <nil> Aug 26 05:25:48.704130397 (13h22m3.929313454s) [noise=true , address=45.91.116.7:4010 , piece_id=DCQYN3ZJSCC6TYXEXBGYTVD5E4WMIOTPBHNUYBKRX4A4AYORWMAA, seg_pos={0 0}, upload=11734]: Done uploading piece. err: <nil> Aug 26 05:25:48.704294274 (13h22m3.929477321s) [noise=true , address=45.91.116.6:4974 , piece_id=R3SZHRSXFZBD5T3CIN52G2VUTDJBTWDRDOFLHXPNNRVKTH3FECRQ, seg_pos={0 0}, upload=11734]: Done uploading piece. err: <nil> Aug 26 05:25:48.704587335 (13h22m3.929770382s) [noise=true , address=45.91.116.14:4191 , piece_id=4BRPYBC3UGWTZ2XJZTOXNU5D5UZCSAAFNCBWCZI2ABUNQD5JOLJA, seg_pos={0 0}, upload=11734]: Done uploading piece. err: <nil> Aug 26 05:25:48.704659381 (13h22m3.929842448s) [noise=true , address=45.91.116.14:4190 , piece_id=OY6EURWMYI4JF46Q5ZUMAW6F6VPFJMKMA5DT55NRUPJ5B27L5ZYQ, seg_pos={0 0}, upload=11734]: Done uploading piece. err: <nil> Aug 26 05:25:48.704923065 (13h22m3.930106112s) [noise=true , address=45.91.116.13:4153 , piece_id=AVTQMUCQMMEUK5LT4GKT4AHRWVH5PU2O34MVSVB5X73WBM5IHQZA, seg_pos={0 0}, upload=11734]: Done uploading piece. err: <nil> Aug 26 05:25:48.705363163 (13h22m3.93054622s) [noise=true , address=45.91.116.7:4009 , piece_id=IWJLCN5TU5JAGWPCQYE2OTYYGAEPV2JLV53GSEVEZ7MVNA67BG5A, seg_pos={0 0}, upload=11734]: Done uploading piece. err: <nil> Aug 26 05:25:48.705531549 (13h22m3.930714606s) [noise=true , address=77.90.31.18:4806 , piece_id=T4FD3NDAZ7WHSQDJP36J6VHB6PHFQWX6YOV3N5D7MUGZGFEW4S4A, seg_pos={0 0}, upload=11734]: Done uploading piece. err: <nil> Aug 26 05:25:48.705994468 (13h22m3.931177525s) [noise=true , address=77.90.31.14:4663 , piece_id=PAHL4S3LD3YBN4GP7NCLQY2OKNQNGHJBOYGIZNUQUJPXKA376UBQ, seg_pos={0 0}, upload=11734]: Done uploading piece. err: <nil> Aug 26 05:25:48.706576742 (13h22m3.931759799s) [noise=true , address=77.90.31.18:4805 , piece_id=2Q6BP3QNYEWOZ5QGUKG7TLH3UWCOL2JAPP6WIPRHLL4SI3BIM6MA, seg_pos={0 0}, upload=11734]: Done uploading piece. err: <nil> Aug 26 05:25:48.707168123 (13h22m3.93235119s) [noise=true , address=77.90.31.11:4553 , piece_id=GKNVPWP4LEUCSEJEERV73GEDEPGI4L47UTVE77Q3GVCNZBCPU6SA, seg_pos={0 0}, upload=11734]: Done uploading piece. err: <nil> Aug 26 05:25:48.707869761 (13h22m3.933052818s) [noise=true , address=77.90.31.15:4699 , piece_id=IEIRX6YQFDHD6KLK4NK4OWIZ5H67SUQRERGKLE4KRIFFTME5TAGA, seg_pos={0 0}, upload=11734]: Done uploading piece. err: <nil> Aug 26 05:25:48.707887534 (13h22m3.933070591s) [seg_pos={0 0}, upload=11734]: Segment reached optimal threshold of 13 pieces. Aug 26 05:25:48.708066050 (13h22m3.933249117s) [noise=true , address=104.36.82.7:4910 , piece_id=RTT6ICFSXO7LQFGSZZZEIW7OFEZOEXZ632DAQCHCYZKBYA4LIHOQ, seg_pos={0 0}, upload=11734]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15uiNvgWc1hPsws7NJjiH5dTx8aBh6PG4fQhsNQTqQTi9MC2Hn): protocol: expected piece hash; context canceled; EOF Aug 26 05:25:48.708093732 (13h22m3.933276789s) [noise=true , address=45.91.116.6:4973 , piece_id=BXMHGXBQGL67RDPATOXCUKNPBFUCLBMNZMUVUSH4RUPJUA73SSJQ, seg_pos={0 0}, upload=11734]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: write tcp 5.161.89.252:60594->45.91.116.6:4973: use of closed network connection; write tcp 5.161.89.252:60594->45.91.116.6:4973: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:60594->45.91.116.6:4973: use of closed network connection Aug 26 05:25:48.708128517 (13h22m3.933311584s) [noise=true , address=104.36.82.12:4150 , piece_id=I7QLZFNU2LWDDIFX6JVA4444URQGVEK5KRCZLR2L4PI445S2LB6Q, seg_pos={0 0}, upload=11734]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK): protocol: expected piece hash; context canceled; EOF Aug 26 05:25:48.708154325 (13h22m3.933337382s) [seg_pos={0 0}, upload=11734]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 05:25:48.708242130 (13h22m3.933425187s) [upload=11734]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:25:48.708246679 (13h22m3.933429746s) [upload=11734]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:25:48.935259083 (13h22m4.160442131s) [upload=11734]: Done uploading segments... Aug 26 05:25:48.935281586 (13h22m4.160464633s) [upload=11734]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 6.860643117s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 14 out of 60 is failed (threshold=3) [.................X.....X...........X.X.XX.XXXXX....X..X...X.] duration: 19.041939905s FAIL (2025-08-26 05:26:55 UTC) operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:25:48.268296054 (13h22m3.493479131s) [upload=11734]: Starting upload Aug 26 05:25:48.268414677 (13h22m3.493597765s) [upload=11734]: Done starting upload Aug 26 05:25:48.268504676 (13h22m3.493687743s) [upload=11734]: Uploading segments... Aug 26 05:25:48.268985209 (13h22m3.494168266s) [upload=11734]: Got next segment. Inline: false Aug 26 05:25:48.269022029 (13h22m3.494205096s) [upload=11734]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:25:48.269026998 (13h22m3.494210056s) [upload=11734]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:25:48.586807534 (13h22m3.811990571s) [seg_pos={0 0}, upload=11734]: Begin upload segment... Aug 26 05:25:48.586835076 (13h22m3.812018113s) [seg_pos={0 0}, upload=11734]: Done begin upload segment. Aug 26 05:25:48.586852479 (13h22m3.812035516s) [noise=true , address=45.91.116.7:4010 , piece_id=DCQYN3ZJSCC6TYXEXBGYTVD5E4WMIOTPBHNUYBKRX4A4AYORWMAA, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.586944582 (13h22m3.812127649s) [noise=true , address=45.91.116.7:4009 , piece_id=IWJLCN5TU5JAGWPCQYE2OTYYGAEPV2JLV53GSEVEZ7MVNA67BG5A, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.587113278 (13h22m3.812296326s) [noise=true , address=104.36.82.12:4150 , piece_id=I7QLZFNU2LWDDIFX6JVA4444URQGVEK5KRCZLR2L4PI445S2LB6Q, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.587299689 (13h22m3.812482726s) [noise=true , address=104.36.82.7:4910 , piece_id=RTT6ICFSXO7LQFGSZZZEIW7OFEZOEXZ632DAQCHCYZKBYA4LIHOQ, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.587470419 (13h22m3.812653467s) [noise=true , address=45.91.116.14:4191 , piece_id=4BRPYBC3UGWTZ2XJZTOXNU5D5UZCSAAFNCBWCZI2ABUNQD5JOLJA, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.587613979 (13h22m3.812797037s) [noise=true , address=45.91.116.12:4225 , piece_id=4YM7MDAWIEEGU6KA236MJHGDN4ZEKVH2S5NXIUQIXA6QKFXSAIOA, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.587638876 (13h22m3.812821923s) [noise=true , address=77.90.31.11:4553 , piece_id=GKNVPWP4LEUCSEJEERV73GEDEPGI4L47UTVE77Q3GVCNZBCPU6SA, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.587841867 (13h22m3.813024904s) [noise=true , address=45.91.116.6:4974 , piece_id=R3SZHRSXFZBD5T3CIN52G2VUTDJBTWDRDOFLHXPNNRVKTH3FECRQ, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.588047053 (13h22m3.81323009s) [noise=true , address=77.90.31.14:4663 , piece_id=PAHL4S3LD3YBN4GP7NCLQY2OKNQNGHJBOYGIZNUQUJPXKA376UBQ, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.588153783 (13h22m3.81333685s) [noise=true , address=77.90.31.18:4805 , piece_id=2Q6BP3QNYEWOZ5QGUKG7TLH3UWCOL2JAPP6WIPRHLL4SI3BIM6MA, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.588232171 (13h22m3.813415218s) [noise=true , address=77.90.31.18:4806 , piece_id=T4FD3NDAZ7WHSQDJP36J6VHB6PHFQWX6YOV3N5D7MUGZGFEW4S4A, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.588450240 (13h22m3.813633287s) [noise=true , address=45.91.116.13:4153 , piece_id=AVTQMUCQMMEUK5LT4GKT4AHRWVH5PU2O34MVSVB5X73WBM5IHQZA, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.588772525 (13h22m3.813955593s) [noise=true , address=45.91.116.6:4973 , piece_id=BXMHGXBQGL67RDPATOXCUKNPBFUCLBMNZMUVUSH4RUPJUA73SSJQ, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.589311809 (13h22m3.814494876s) [noise=true , address=77.90.31.15:4699 , piece_id=IEIRX6YQFDHD6KLK4NK4OWIZ5H67SUQRERGKLE4KRIFFTME5TAGA, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.589915933 (13h22m3.81509903s) [noise=true , address=45.91.116.14:4190 , piece_id=OY6EURWMYI4JF46Q5ZUMAW6F6VPFJMKMA5DT55NRUPJ5B27L5ZYQ, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.590632359 (13h22m3.815815426s) [noise=true , address=45.91.116.11:4117 , piece_id=BIK6IZNYHXPW7UNJCEPFOQR6FNS45FASODJEJJUNKTYJCDPITSYA, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.694796915 (13h22m3.919979962s) [upload=11734]: Next returned nil segment Aug 26 05:25:48.694809519 (13h22m3.919992565s) [upload=11734]: Waiting for error group managing segments... Aug 26 05:25:48.703657829 (13h22m3.928840877s) [noise=true , address=45.91.116.11:4117 , piece_id=BIK6IZNYHXPW7UNJCEPFOQR6FNS45FASODJEJJUNKTYJCDPITSYA, seg_pos={0 0}, upload=11734]: Done uploading piece. err: <nil> Aug 26 05:25:48.704009500 (13h22m3.929192547s) [noise=true , address=45.91.116.12:4225 , piece_id=4YM7MDAWIEEGU6KA236MJHGDN4ZEKVH2S5NXIUQIXA6QKFXSAIOA, seg_pos={0 0}, upload=11734]: Done uploading piece. err: <nil> Aug 26 05:25:48.704130397 (13h22m3.929313454s) [noise=true , address=45.91.116.7:4010 , piece_id=DCQYN3ZJSCC6TYXEXBGYTVD5E4WMIOTPBHNUYBKRX4A4AYORWMAA, seg_pos={0 0}, upload=11734]: Done uploading piece. err: <nil> Aug 26 05:25:48.704294274 (13h22m3.929477321s) [noise=true , address=45.91.116.6:4974 , piece_id=R3SZHRSXFZBD5T3CIN52G2VUTDJBTWDRDOFLHXPNNRVKTH3FECRQ, seg_pos={0 0}, upload=11734]: Done uploading piece. err: <nil> Aug 26 05:25:48.704587335 (13h22m3.929770382s) [noise=true , address=45.91.116.14:4191 , piece_id=4BRPYBC3UGWTZ2XJZTOXNU5D5UZCSAAFNCBWCZI2ABUNQD5JOLJA, seg_pos={0 0}, upload=11734]: Done uploading piece. err: <nil> Aug 26 05:25:48.704659381 (13h22m3.929842448s) [noise=true , address=45.91.116.14:4190 , piece_id=OY6EURWMYI4JF46Q5ZUMAW6F6VPFJMKMA5DT55NRUPJ5B27L5ZYQ, seg_pos={0 0}, upload=11734]: Done uploading piece. err: <nil> Aug 26 05:25:48.704923065 (13h22m3.930106112s) [noise=true , address=45.91.116.13:4153 , piece_id=AVTQMUCQMMEUK5LT4GKT4AHRWVH5PU2O34MVSVB5X73WBM5IHQZA, seg_pos={0 0}, upload=11734]: Done uploading piece. err: <nil> Aug 26 05:25:48.705363163 (13h22m3.93054622s) [noise=true , address=45.91.116.7:4009 , piece_id=IWJLCN5TU5JAGWPCQYE2OTYYGAEPV2JLV53GSEVEZ7MVNA67BG5A, seg_pos={0 0}, upload=11734]: Done uploading piece. err: <nil> Aug 26 05:25:48.705531549 (13h22m3.930714606s) [noise=true , address=77.90.31.18:4806 , piece_id=T4FD3NDAZ7WHSQDJP36J6VHB6PHFQWX6YOV3N5D7MUGZGFEW4S4A, seg_pos={0 0}, upload=11734]: Done uploading piece. err: <nil> Aug 26 05:25:48.705994468 (13h22m3.931177525s) [noise=true , address=77.90.31.14:4663 , piece_id=PAHL4S3LD3YBN4GP7NCLQY2OKNQNGHJBOYGIZNUQUJPXKA376UBQ, seg_pos={0 0}, upload=11734]: Done uploading piece. err: <nil> Aug 26 05:25:48.706576742 (13h22m3.931759799s) [noise=true , address=77.90.31.18:4805 , piece_id=2Q6BP3QNYEWOZ5QGUKG7TLH3UWCOL2JAPP6WIPRHLL4SI3BIM6MA, seg_pos={0 0}, upload=11734]: Done uploading piece. err: <nil> Aug 26 05:25:48.707168123 (13h22m3.93235119s) [noise=true , address=77.90.31.11:4553 , piece_id=GKNVPWP4LEUCSEJEERV73GEDEPGI4L47UTVE77Q3GVCNZBCPU6SA, seg_pos={0 0}, upload=11734]: Done uploading piece. err: <nil> Aug 26 05:25:48.707869761 (13h22m3.933052818s) [noise=true , address=77.90.31.15:4699 , piece_id=IEIRX6YQFDHD6KLK4NK4OWIZ5H67SUQRERGKLE4KRIFFTME5TAGA, seg_pos={0 0}, upload=11734]: Done uploading piece. err: <nil> Aug 26 05:25:48.707887534 (13h22m3.933070591s) [seg_pos={0 0}, upload=11734]: Segment reached optimal threshold of 13 pieces. Aug 26 05:25:48.708066050 (13h22m3.933249117s) [noise=true , address=104.36.82.7:4910 , piece_id=RTT6ICFSXO7LQFGSZZZEIW7OFEZOEXZ632DAQCHCYZKBYA4LIHOQ, seg_pos={0 0}, upload=11734]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15uiNvgWc1hPsws7NJjiH5dTx8aBh6PG4fQhsNQTqQTi9MC2Hn): protocol: expected piece hash; context canceled; EOF Aug 26 05:25:48.708093732 (13h22m3.933276789s) [noise=true , address=45.91.116.6:4973 , piece_id=BXMHGXBQGL67RDPATOXCUKNPBFUCLBMNZMUVUSH4RUPJUA73SSJQ, seg_pos={0 0}, upload=11734]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: write tcp 5.161.89.252:60594->45.91.116.6:4973: use of closed network connection; write tcp 5.161.89.252:60594->45.91.116.6:4973: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:60594->45.91.116.6:4973: use of closed network connection Aug 26 05:25:48.708128517 (13h22m3.933311584s) [noise=true , address=104.36.82.12:4150 , piece_id=I7QLZFNU2LWDDIFX6JVA4444URQGVEK5KRCZLR2L4PI445S2LB6Q, seg_pos={0 0}, upload=11734]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK): protocol: expected piece hash; context canceled; EOF Aug 26 05:25:48.708154325 (13h22m3.933337382s) [seg_pos={0 0}, upload=11734]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 05:25:48.708242130 (13h22m3.933425187s) [upload=11734]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:25:48.708246679 (13h22m3.933429746s) [upload=11734]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:25:48.935259083 (13h22m4.160442131s) [upload=11734]: Done uploading segments... Aug 26 05:25:48.935281586 (13h22m4.160464633s) [upload=11734]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 19.041963048s core uplink us-select-1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 5 out of 60 is failed (threshold=6) [.....................X...............X..X....X....X.........] duration: 6.680396267s remote: "tcp:136.0.77.2:443" response headers: Access-Control-Allow-Methods=GET, HEAD Access-Control-Allow-Origin=* X-Request-Id=9LMxmq1gtt2 Date=Tue, 26 Aug 2025 05:20:20 GMT Accept-Ranges=bytes Access-Control-Allow-Headers=* Content-Type=text/html; charset=utf-8 target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt FAIL (2025-08-26 05:26:43 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error \| Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error \| Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error \| Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY" Duration: 6.680422096s edge linksharing bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 8 out of 60 is failed (threshold=3) [.............................X........XX.X.X.X.....X..X.....] duration: 10.103258153s FAIL (2025-08-26 05:26:36 UTC) operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== (13h18m10.903192629s) [upload=11683]: Uploading segments... Aug 26 05:21:55.678233874 (13h18m10.903416931s) [upload=11683]: Got next segment. Inline: false Aug 26 05:21:55.678260154 (13h18m10.903443211s) [upload=11683]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:21:55.678264411 (13h18m10.903447459s) [upload=11683]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:22:32.600325641 (13h18m47.825508709s) [seg_pos={0 0}, upload=11683]: Begin upload segment... Aug 26 05:22:32.600393179 (13h18m47.825576255s) [seg_pos={0 0}, upload=11683]: Done begin upload segment. Aug 26 05:22:32.600435157 (13h18m47.825618234s) [noise=true , address=77.90.31.10:4536 , piece_id=RLSTCB3DRLXIM6BS7HNFIASJYJQLV4C4VH26WWO7APNIBA743UWA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.600452519 (13h18m47.825635597s) [noise=true , address=77.90.31.14:4676 , piece_id=PIMLYBVKLMHO2NDPLZ6TR6XATDIHLKLZNRROQW4LX5ZOKKOXUC4A, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.601074888 (13h18m47.826257966s) [noise=true , address=64.49.13.154:4934 , piece_id=MZ2CATHR2J7MEW3ZVCBA5Q7SR7JN2M3MKXJ2ACQMQHMPXYOJRXWQ, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.601112790 (13h18m47.826295867s) [noise=true , address=45.91.116.10:4090 , piece_id=GCTDOJWW73RBYVLSGO7JYNJJOGIKALYZOJCULQRRJAIB5PYUODDA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.601653837 (13h18m47.826836904s) [noise=true , address=45.91.116.7:4025 , piece_id=SQM2OZOZYIXTD2NZKVDEH5DT3TGTVQC3MMR6B2NSRSZC3LCG3VQQ, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.602360183 (13h18m47.827543251s) [noise=true , address=79.127.205.246:4268 , piece_id=QOTALM2EQDO4WOEEA2HTKMMFBUBFAPQ4IWJXP7OCMMWEN7JUHGJA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.602820207 (13h18m47.828003284s) [noise=true , address=79.127.201.215:4348 , piece_id=2NC6IN6DCEUBKUWP5P6BLTUILQUYH7OKFBLGUPNIANFDPS3AASXA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.603293896 (13h18m47.828476974s) [noise=true , address=104.36.82.60:4338 , piece_id=7RYWCNBREFMCJAY2OKVONQLZOM7ZGISW7W4G7UIJ2RS4URUCDGIA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.603762638 (13h18m47.828945714s) [noise=true , address=104.36.82.53:4147 , piece_id=6SZ5LYDXM7QREG5466AAYCCX2FJTPVB6AVLU7L536OVEAAERRT2Q, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.604257226 (13h18m47.829440304s) [noise=true , address=79.127.219.47:4065 , piece_id=AMPXWWP2X26KCGGSJT5XIIV7S2ZQCSBPMCRSUYRKLLUU5YJYNJLA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.604687584 (13h18m47.829870662s) [noise=true , address=79.127.219.48:4104 , piece_id=HV264WUAQQURRN27GOZGE7UAFDAXSEBA6MH7PA72IVB2UPAKAMPA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.605131769 (13h18m47.830314845s) [noise=true , address=77.90.31.15:4701 , piece_id=MWY66KUMVLCQMCTJSBF6PUTPL5A2AIL55GPKAZABAZYELEX3Z52A, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.605618583 (13h18m47.830801691s) [noise=true , address=104.36.82.10:4085 , piece_id=SRFGVCOSJBC6GVWW7L3YEAIFKAW3RJJQO4LCHQ6UZIXXUES3PJ6Q, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.606201718 (13h18m47.831384795s) [noise=true , address=104.36.82.5:4851 , piece_id=XDD3DWFRLI5374XNSXIEALKIAABOOY6NLA7XRVHRBNMQF5GABMHA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.606759907 (13h18m47.831942984s) [noise=true , address=77.90.31.18:4814 , piece_id=GJQEUMHDADXZHO3YSZX5ITUQFSJQXUAAORPNBLAJZK3WRSJG4WHQ, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.607244707 (13h18m47.832427785s) [noise=true , address=45.91.116.8:4056 , piece_id=RL7KICVBDUYFR2WGZFV55MPEIGNY5JNV2YGMMXBAV23VSOYFP5BA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.607719629 (13h18m47.832902766s) [noise=true , address=77.90.31.12:4605 , piece_id=5N6WPRDM5FGLSPCGHFKDTADKLHRBXRGNELL2BL7BGKY4KCMTGKMQ, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.608307774 (13h18m47.833490851s) [noise=true , address=104.36.82.23:4470 , piece_id=EZ3HRRIU7W5WU6TJEIMMDV4W56BPSPQ4X26AI5DU72ZRKKHQZRYA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.691988392 (13h18m47.917171449s) [upload=11683]: Next returned nil segment Aug 26 05:22:32.691999162 (13h18m47.917182219s) [upload=11683]: Waiting for error group managing segments... Aug 26 05:22:32.699693495 (13h18m47.924876552s) [noise=true , address=79.127.219.47:4065 , piece_id=AMPXWWP2X26KCGGSJT5XIIV7S2ZQCSBPMCRSUYRKLLUU5YJYNJLA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.700617159 (13h18m47.925800216s) [noise=true , address=79.127.219.48:4104 , piece_id=HV264WUAQQURRN27GOZGE7UAFDAXSEBA6MH7PA72IVB2UPAKAMPA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.701137898 (13h18m47.926320955s) [noise=true , address=45.91.116.10:4090 , piece_id=GCTDOJWW73RBYVLSGO7JYNJJOGIKALYZOJCULQRRJAIB5PYUODDA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.701200094 (13h18m47.926383141s) [noise=true , address=45.91.116.8:4056 , piece_id=RL7KICVBDUYFR2WGZFV55MPEIGNY5JNV2YGMMXBAV23VSOYFP5BA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.701597160 (13h18m47.926780207s) [noise=true , address=77.90.31.14:4676 , piece_id=PIMLYBVKLMHO2NDPLZ6TR6XATDIHLKLZNRROQW4LX5ZOKKOXUC4A, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.701717084 (13h18m47.926900142s) [noise=true , address=77.90.31.12:4605 , piece_id=5N6WPRDM5FGLSPCGHFKDTADKLHRBXRGNELL2BL7BGKY4KCMTGKMQ, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.701967515 (13h18m47.927150572s) [noise=true , address=45.91.116.7:4025 , piece_id=SQM2OZOZYIXTD2NZKVDEH5DT3TGTVQC3MMR6B2NSRSZC3LCG3VQQ, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.702309588 (13h18m47.927492645s) [noise=true , address=77.90.31.15:4701 , piece_id=MWY66KUMVLCQMCTJSBF6PUTPL5A2AIL55GPKAZABAZYELEX3Z52A, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.702425255 (13h18m47.927608312s) [noise=true , address=77.90.31.10:4536 , piece_id=RLSTCB3DRLXIM6BS7HNFIASJYJQLV4C4VH26WWO7APNIBA743UWA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.702872827 (13h18m47.928055873s) [noise=true , address=104.36.82.60:4338 , piece_id=7RYWCNBREFMCJAY2OKVONQLZOM7ZGISW7W4G7UIJ2RS4URUCDGIA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.705698062 (13h18m47.930881119s) [noise=true , address=104.36.82.53:4147 , piece_id=6SZ5LYDXM7QREG5466AAYCCX2FJTPVB6AVLU7L536OVEAAERRT2Q, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.722366000 (13h18m47.947549057s) [noise=true , address=104.36.82.10:4085 , piece_id=SRFGVCOSJBC6GVWW7L3YEAIFKAW3RJJQO4LCHQ6UZIXXUES3PJ6Q, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.729280427 (13h18m47.954463474s) [noise=true , address=104.36.82.23:4470 , piece_id=EZ3HRRIU7W5WU6TJEIMMDV4W56BPSPQ4X26AI5DU72ZRKKHQZRYA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.741223921 (13h18m47.966406968s) [noise=true , address=77.90.31.18:4814 , piece_id=GJQEUMHDADXZHO3YSZX5ITUQFSJQXUAAORPNBLAJZK3WRSJG4WHQ, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.741231004 (13h18m47.966414052s) [seg_pos={0 0}, upload=11683]: Segment reached optimal threshold of 14 pieces. Aug 26 05:22:32.741460224 (13h18m47.966643271s) [noise=true , address=104.36.82.5:4851 , piece_id=XDD3DWFRLI5374XNSXIEALKIAABOOY6NLA7XRVHRBNMQF5GABMHA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fTtTieEUquaKNUNzqK98PkX7tVxjsiNeMLjz8kQJwdLne7d9R): protocol: expected piece hash; context canceled; EOF Aug 26 05:22:32.741510720 (13h18m47.966693777s) [noise=true , address=79.127.201.215:4348 , piece_id=2NC6IN6DCEUBKUWP5P6BLTUILQUYH7OKFBLGUPNIANFDPS3AASXA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: context canceled Aug 26 05:22:32.741626567 (13h18m47.966809614s) [noise=true , address=79.127.205.246:4268 , piece_id=QOTALM2EQDO4WOEEA2HTKMMFBUBFAPQ4IWJXP7OCMMWEN7JUHGJA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k72iHWdcnM2JKs7VPTQFQwmpQ835HmAP8KpXxjMbEy5QxfzG): protocol: read tcp 5.161.89.252:20776->79.127.205.246:4268: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 26 05:22:32.741637688 (13h18m47.966820735s) [noise=true , address=64.49.13.154:4934 , piece_id=MZ2CATHR2J7MEW3ZVCBA5Q7SR7JN2M3MKXJ2ACQMQHMPXYOJRXWQ, seg_pos={0 0}, upload=11683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: read tcp 5.161.89.252:30556->64.49.13.154:4934: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 26 05:22:32.741659869 (13h18m47.966842926s) [seg_pos={0 0}, upload=11683]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 26 05:22:32.741708741 (13h18m47.966891789s) [upload=11683]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:22:32.741712488 (13h18m47.966895545s) [upload=11683]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:23:03.030254989 (13h19m18.255438035s) [upload=11683]: Done uploading segments... Aug 26 05:23:03.030281389 (13h19m18.255464436s) [upload=11683]: Upload finished. err: metaclient: context deadline exceeded Duration: 10.103279973s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 5 out of 60 is failed (threshold=3) [.........................................X.X..XX.....X......] duration: 57.215513087s FAIL (2025-08-26 05:26:35 UTC) operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:19:33.789655908 (13h15m49.014838985s) [upload=11650]: Starting upload Aug 26 05:19:33.789738403 (13h15m49.01492148s) [upload=11650]: Done starting upload Aug 26 05:19:33.789799137 (13h15m49.014982224s) [upload=11650]: Uploading segments... Aug 26 05:19:33.789882654 (13h15m49.01506573s) [upload=11650]: Got next segment. Inline: true Aug 26 05:19:33.789891009 (13h15m49.015074086s) [upload=11650]: Waiting for error group managing segments... Aug 26 05:19:33.789942085 (13h15m49.015125162s) [upload=11650]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:19:33.789947546 (13h15m49.015130624s) [upload=11650]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:19:33.789951443 (13h15m49.015134521s) [upload=11650]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:19:37.763117992 (13h15m52.988301059s) [upload=11650]: Done uploading segments... Aug 26 05:19:37.763136176 (13h15m52.988319243s) [upload=11650]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration:* 57.215538255s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [..................X..................XXX....XXX......X....X.] duration: 18.796934533s FAIL (2025-08-26 05:26:32 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 18.796995556s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 12 out of 60 is failed (threshold=3) [.................X.....XX..........XX....X..X.XX....X..X..X.] duration: 16.149306603s FAIL (2025-08-26 05:26:28 UTC) operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 16.149329104s core uplink us1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 7 out of 60 is failed (threshold=3) [....................................X.....XX.XX....XX.......] duration: 4.679171522s remote: "tcp:45.38.24.2:443" response headers: Content-Length=433 Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:20:48 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=185F398ACC12A1DA X-Request-Id=4XAeFcrV1RT target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-26 05:26:25 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F398ACC12A1DA</RequestId><HostId></HostId></Error>" Duration: 4.679192752s edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 19 out of 60 is failed (threshold=3) [..............XX.......X..X.......XXXXXXXX.XX.......X..XX.XX] duration: 30.883751436s FAIL (2025-08-26 05:26:20 UTC) operation: Commit uplink: metaclient: context deadline exceeded Duration: 30.883766014s core uplink us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 4 out of 60 is failed (threshold=3) [...........................X..........X....X...............X] duration: 288.694804ms remote: "tcp:136.0.77.2:443" response headers: Content-Length=423 Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=185F39D55F61F51C X-Request-Id=DYzmAwBePQR X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:26:08 GMT Content-Type=application/xml Vary=Origin Accept-Ranges=bytes target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-26 05:26:08 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F39D55F61F51C</RequestId><HostId></HostId></Error>" Duration: 288.719391ms edge gateway vhost bgp us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 14 out of 60 is failed (threshold=3) [....................X....XX.........XX.XX..XXX....XX......XX] duration: 1.946492863s FAIL (2025-08-26 05:26:02 UTC) orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 429, RequestID: 185F39D3F2B1B9DF, HostID: , api error SlowDown: Please reduce your request rate. Duration: 1.946520273s edge gateway us-select-1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 5 out of 60 is failed (threshold=6) [......................X...............X..X....X....X........] duration: 8.043169389s remote: "tcp:136.0.77.2:443" response headers: Access-Control-Allow-Methods=GET, HEAD Access-Control-Allow-Origin=* X-Request-Id=9LMxmq1gtt2 Date=Tue, 26 Aug 2025 05:20:20 GMT Accept-Ranges=bytes Access-Control-Allow-Headers=* Content-Type=text/html; charset=utf-8 target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt FAIL (2025-08-26 05:25:53 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error \| Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error \| Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error \| Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY" Duration: 8.043199315s edge linksharing bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 14 out of 60 is failed (threshold=3) [..................X.....X...........X.X.XX.XXXXX....X..X...X] duration: 680.651643ms FAIL (2025-08-26 05:25:48 UTC) operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:25:48.268296054 (13h22m3.493479131s) [upload=11734]: Starting upload Aug 26 05:25:48.268414677 (13h22m3.493597765s) [upload=11734]: Done starting upload Aug 26 05:25:48.268504676 (13h22m3.493687743s) [upload=11734]: Uploading segments... Aug 26 05:25:48.268985209 (13h22m3.494168266s) [upload=11734]: Got next segment. Inline: false Aug 26 05:25:48.269022029 (13h22m3.494205096s) [upload=11734]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:25:48.269026998 (13h22m3.494210056s) [upload=11734]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:25:48.586807534 (13h22m3.811990571s) [seg_pos={0 0}, upload=11734]: Begin upload segment... Aug 26 05:25:48.586835076 (13h22m3.812018113s) [seg_pos={0 0}, upload=11734]: Done begin upload segment. Aug 26 05:25:48.586852479 (13h22m3.812035516s) [noise=true , address=45.91.116.7:4010 , piece_id=DCQYN3ZJSCC6TYXEXBGYTVD5E4WMIOTPBHNUYBKRX4A4AYORWMAA, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.586944582 (13h22m3.812127649s) [noise=true , address=45.91.116.7:4009 , piece_id=IWJLCN5TU5JAGWPCQYE2OTYYGAEPV2JLV53GSEVEZ7MVNA67BG5A, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.587113278 (13h22m3.812296326s) [noise=true , address=104.36.82.12:4150 , piece_id=I7QLZFNU2LWDDIFX6JVA4444URQGVEK5KRCZLR2L4PI445S2LB6Q, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.587299689 (13h22m3.812482726s) [noise=true , address=104.36.82.7:4910 , piece_id=RTT6ICFSXO7LQFGSZZZEIW7OFEZOEXZ632DAQCHCYZKBYA4LIHOQ, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.587470419 (13h22m3.812653467s) [noise=true , address=45.91.116.14:4191 , piece_id=4BRPYBC3UGWTZ2XJZTOXNU5D5UZCSAAFNCBWCZI2ABUNQD5JOLJA, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.587613979 (13h22m3.812797037s) [noise=true , address=45.91.116.12:4225 , piece_id=4YM7MDAWIEEGU6KA236MJHGDN4ZEKVH2S5NXIUQIXA6QKFXSAIOA, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.587638876 (13h22m3.812821923s) [noise=true , address=77.90.31.11:4553 , piece_id=GKNVPWP4LEUCSEJEERV73GEDEPGI4L47UTVE77Q3GVCNZBCPU6SA, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.587841867 (13h22m3.813024904s) [noise=true , address=45.91.116.6:4974 , piece_id=R3SZHRSXFZBD5T3CIN52G2VUTDJBTWDRDOFLHXPNNRVKTH3FECRQ, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.588047053 (13h22m3.81323009s) [noise=true , address=77.90.31.14:4663 , piece_id=PAHL4S3LD3YBN4GP7NCLQY2OKNQNGHJBOYGIZNUQUJPXKA376UBQ, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.588153783 (13h22m3.81333685s) [noise=true , address=77.90.31.18:4805 , piece_id=2Q6BP3QNYEWOZ5QGUKG7TLH3UWCOL2JAPP6WIPRHLL4SI3BIM6MA, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.588232171 (13h22m3.813415218s) [noise=true , address=77.90.31.18:4806 , piece_id=T4FD3NDAZ7WHSQDJP36J6VHB6PHFQWX6YOV3N5D7MUGZGFEW4S4A, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.588450240 (13h22m3.813633287s) [noise=true , address=45.91.116.13:4153 , piece_id=AVTQMUCQMMEUK5LT4GKT4AHRWVH5PU2O34MVSVB5X73WBM5IHQZA, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.588772525 (13h22m3.813955593s) [noise=true , address=45.91.116.6:4973 , piece_id=BXMHGXBQGL67RDPATOXCUKNPBFUCLBMNZMUVUSH4RUPJUA73SSJQ, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.589311809 (13h22m3.814494876s) [noise=true , address=77.90.31.15:4699 , piece_id=IEIRX6YQFDHD6KLK4NK4OWIZ5H67SUQRERGKLE4KRIFFTME5TAGA, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.589915933 (13h22m3.81509903s) [noise=true , address=45.91.116.14:4190 , piece_id=OY6EURWMYI4JF46Q5ZUMAW6F6VPFJMKMA5DT55NRUPJ5B27L5ZYQ, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.590632359 (13h22m3.815815426s) [noise=true , address=45.91.116.11:4117 , piece_id=BIK6IZNYHXPW7UNJCEPFOQR6FNS45FASODJEJJUNKTYJCDPITSYA, seg_pos={0 0}, upload=11734]: Uploading piece... Aug 26 05:25:48.694796915 (13h22m3.919979962s) [upload=11734]: Next returned nil segment Aug 26 05:25:48.694809519 (13h22m3.919992565s) [upload=11734]: Waiting for error group managing segments... Aug 26 05:25:48.703657829 (13h22m3.928840877s) [noise=true , address=45.91.116.11:4117 , piece_id=BIK6IZNYHXPW7UNJCEPFOQR6FNS45FASODJEJJUNKTYJCDPITSYA, seg_pos={0 0}, upload=11734]: Done uploading piece. err: <nil> Aug 26 05:25:48.704009500 (13h22m3.929192547s) [noise=true , address=45.91.116.12:4225 , piece_id=4YM7MDAWIEEGU6KA236MJHGDN4ZEKVH2S5NXIUQIXA6QKFXSAIOA, seg_pos={0 0}, upload=11734]: Done uploading piece. err: <nil> Aug 26 05:25:48.704130397 (13h22m3.929313454s) [noise=true , address=45.91.116.7:4010 , piece_id=DCQYN3ZJSCC6TYXEXBGYTVD5E4WMIOTPBHNUYBKRX4A4AYORWMAA, seg_pos={0 0}, upload=11734]: Done uploading piece. err: <nil> Aug 26 05:25:48.704294274 (13h22m3.929477321s) [noise=true , address=45.91.116.6:4974 , piece_id=R3SZHRSXFZBD5T3CIN52G2VUTDJBTWDRDOFLHXPNNRVKTH3FECRQ, seg_pos={0 0}, upload=11734]: Done uploading piece. err: <nil> Aug 26 05:25:48.704587335 (13h22m3.929770382s) [noise=true , address=45.91.116.14:4191 , piece_id=4BRPYBC3UGWTZ2XJZTOXNU5D5UZCSAAFNCBWCZI2ABUNQD5JOLJA, seg_pos={0 0}, upload=11734]: Done uploading piece. err: <nil> Aug 26 05:25:48.704659381 (13h22m3.929842448s) [noise=true , address=45.91.116.14:4190 , piece_id=OY6EURWMYI4JF46Q5ZUMAW6F6VPFJMKMA5DT55NRUPJ5B27L5ZYQ, seg_pos={0 0}, upload=11734]: Done uploading piece. err: <nil> Aug 26 05:25:48.704923065 (13h22m3.930106112s) [noise=true , address=45.91.116.13:4153 , piece_id=AVTQMUCQMMEUK5LT4GKT4AHRWVH5PU2O34MVSVB5X73WBM5IHQZA, seg_pos={0 0}, upload=11734]: Done uploading piece. err: <nil> Aug 26 05:25:48.705363163 (13h22m3.93054622s) [noise=true , address=45.91.116.7:4009 , piece_id=IWJLCN5TU5JAGWPCQYE2OTYYGAEPV2JLV53GSEVEZ7MVNA67BG5A, seg_pos={0 0}, upload=11734]: Done uploading piece. err: <nil> Aug 26 05:25:48.705531549 (13h22m3.930714606s) [noise=true , address=77.90.31.18:4806 , piece_id=T4FD3NDAZ7WHSQDJP36J6VHB6PHFQWX6YOV3N5D7MUGZGFEW4S4A, seg_pos={0 0}, upload=11734]: Done uploading piece. err: <nil> Aug 26 05:25:48.705994468 (13h22m3.931177525s) [noise=true , address=77.90.31.14:4663 , piece_id=PAHL4S3LD3YBN4GP7NCLQY2OKNQNGHJBOYGIZNUQUJPXKA376UBQ, seg_pos={0 0}, upload=11734]: Done uploading piece. err: <nil> Aug 26 05:25:48.706576742 (13h22m3.931759799s) [noise=true , address=77.90.31.18:4805 , piece_id=2Q6BP3QNYEWOZ5QGUKG7TLH3UWCOL2JAPP6WIPRHLL4SI3BIM6MA, seg_pos={0 0}, upload=11734]: Done uploading piece. err: <nil> Aug 26 05:25:48.707168123 (13h22m3.93235119s) [noise=true , address=77.90.31.11:4553 , piece_id=GKNVPWP4LEUCSEJEERV73GEDEPGI4L47UTVE77Q3GVCNZBCPU6SA, seg_pos={0 0}, upload=11734]: Done uploading piece. err: <nil> Aug 26 05:25:48.707869761 (13h22m3.933052818s) [noise=true , address=77.90.31.15:4699 , piece_id=IEIRX6YQFDHD6KLK4NK4OWIZ5H67SUQRERGKLE4KRIFFTME5TAGA, seg_pos={0 0}, upload=11734]: Done uploading piece. err: <nil> Aug 26 05:25:48.707887534 (13h22m3.933070591s) [seg_pos={0 0}, upload=11734]: Segment reached optimal threshold of 13 pieces. Aug 26 05:25:48.708066050 (13h22m3.933249117s) [noise=true , address=104.36.82.7:4910 , piece_id=RTT6ICFSXO7LQFGSZZZEIW7OFEZOEXZ632DAQCHCYZKBYA4LIHOQ, seg_pos={0 0}, upload=11734]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15uiNvgWc1hPsws7NJjiH5dTx8aBh6PG4fQhsNQTqQTi9MC2Hn): protocol: expected piece hash; context canceled; EOF Aug 26 05:25:48.708093732 (13h22m3.933276789s) [noise=true , address=45.91.116.6:4973 , piece_id=BXMHGXBQGL67RDPATOXCUKNPBFUCLBMNZMUVUSH4RUPJUA73SSJQ, seg_pos={0 0}, upload=11734]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV): protocol: write tcp 5.161.89.252:60594->45.91.116.6:4973: use of closed network connection; write tcp 5.161.89.252:60594->45.91.116.6:4973: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:60594->45.91.116.6:4973: use of closed network connection Aug 26 05:25:48.708128517 (13h22m3.933311584s) [noise=true , address=104.36.82.12:4150 , piece_id=I7QLZFNU2LWDDIFX6JVA4444URQGVEK5KRCZLR2L4PI445S2LB6Q, seg_pos={0 0}, upload=11734]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK): protocol: expected piece hash; context canceled; EOF Aug 26 05:25:48.708154325 (13h22m3.933337382s) [seg_pos={0 0}, upload=11734]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 05:25:48.708242130 (13h22m3.933425187s) [upload=11734]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:25:48.708246679 (13h22m3.933429746s) [upload=11734]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:25:48.935259083 (13h22m4.160442131s) [upload=11734]: Done uploading segments... Aug 26 05:25:48.935281586 (13h22m4.160464633s) [upload=11734]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 680.663295ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [.......................................X.X..X.............XX] duration: 3.486756321s FAIL (2025-08-26 05:25:48 UTC) operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 429, RequestID: 185F39D0A60DE102, HostID: , api error SlowDown: Please reduce your request rate. Duration: 3.486770528s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 12 out of 60 is failed (threshold=3) [...................XX.......X..........XX.X.X.XX....X..X...X] duration: 311.556766ms FAIL (2025-08-26 05:25:46 UTC) operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:25:46.268625093 (13h22m1.49380815s) [upload=11733]: Starting upload Aug 26 05:25:46.268684414 (13h22m1.493867461s) [upload=11733]: Done starting upload Aug 26 05:25:46.268735179 (13h22m1.493918236s) [upload=11733]: Uploading segments... Aug 26 05:25:46.268778050 (13h22m1.493961107s) [upload=11733]: Got next segment. Inline: true Aug 26 05:25:46.268781586 (13h22m1.493964644s) [upload=11733]: Waiting for error group managing segments... Aug 26 05:25:46.268839094 (13h22m1.494022142s) [upload=11733]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:25:46.268843603 (13h22m1.49402665s) [upload=11733]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:25:46.268846017 (13h22m1.494029075s) [upload=11733]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:25:46.564388353 (13h22m1.789571421s) [upload=11733]: Done uploading segments... Aug 26 05:25:46.564406117 (13h22m1.789589194s) [upload=11733]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration:* 311.572617ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [........................................X.X..X.............X] duration: 50.739531711s FAIL (2025-08-26 05:25:44 UTC) operation error S3: GetObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 185F39CFCC989C09, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled) Duration: 50.739559503s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 12 out of 60 is failed (threshold=3) [..................X.....XX..........XX....X..X.XX....X..X..X] duration: 30.000691375s FAIL (2025-08-26 05:25:43 UTC) operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 30.000712305s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 8 out of 60 is failed (threshold=3) [..............................X........XX.X.X.X.....X..X....] duration: 21.758941546s FAIL (2025-08-26 05:25:38 UTC) operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== (13h18m10.903192629s) [upload=11683]: Uploading segments... Aug 26 05:21:55.678233874 (13h18m10.903416931s) [upload=11683]: Got next segment. Inline: false Aug 26 05:21:55.678260154 (13h18m10.903443211s) [upload=11683]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:21:55.678264411 (13h18m10.903447459s) [upload=11683]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:22:32.600325641 (13h18m47.825508709s) [seg_pos={0 0}, upload=11683]: Begin upload segment... Aug 26 05:22:32.600393179 (13h18m47.825576255s) [seg_pos={0 0}, upload=11683]: Done begin upload segment. Aug 26 05:22:32.600435157 (13h18m47.825618234s) [noise=true , address=77.90.31.10:4536 , piece_id=RLSTCB3DRLXIM6BS7HNFIASJYJQLV4C4VH26WWO7APNIBA743UWA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.600452519 (13h18m47.825635597s) [noise=true , address=77.90.31.14:4676 , piece_id=PIMLYBVKLMHO2NDPLZ6TR6XATDIHLKLZNRROQW4LX5ZOKKOXUC4A, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.601074888 (13h18m47.826257966s) [noise=true , address=64.49.13.154:4934 , piece_id=MZ2CATHR2J7MEW3ZVCBA5Q7SR7JN2M3MKXJ2ACQMQHMPXYOJRXWQ, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.601112790 (13h18m47.826295867s) [noise=true , address=45.91.116.10:4090 , piece_id=GCTDOJWW73RBYVLSGO7JYNJJOGIKALYZOJCULQRRJAIB5PYUODDA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.601653837 (13h18m47.826836904s) [noise=true , address=45.91.116.7:4025 , piece_id=SQM2OZOZYIXTD2NZKVDEH5DT3TGTVQC3MMR6B2NSRSZC3LCG3VQQ, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.602360183 (13h18m47.827543251s) [noise=true , address=79.127.205.246:4268 , piece_id=QOTALM2EQDO4WOEEA2HTKMMFBUBFAPQ4IWJXP7OCMMWEN7JUHGJA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.602820207 (13h18m47.828003284s) [noise=true , address=79.127.201.215:4348 , piece_id=2NC6IN6DCEUBKUWP5P6BLTUILQUYH7OKFBLGUPNIANFDPS3AASXA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.603293896 (13h18m47.828476974s) [noise=true , address=104.36.82.60:4338 , piece_id=7RYWCNBREFMCJAY2OKVONQLZOM7ZGISW7W4G7UIJ2RS4URUCDGIA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.603762638 (13h18m47.828945714s) [noise=true , address=104.36.82.53:4147 , piece_id=6SZ5LYDXM7QREG5466AAYCCX2FJTPVB6AVLU7L536OVEAAERRT2Q, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.604257226 (13h18m47.829440304s) [noise=true , address=79.127.219.47:4065 , piece_id=AMPXWWP2X26KCGGSJT5XIIV7S2ZQCSBPMCRSUYRKLLUU5YJYNJLA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.604687584 (13h18m47.829870662s) [noise=true , address=79.127.219.48:4104 , piece_id=HV264WUAQQURRN27GOZGE7UAFDAXSEBA6MH7PA72IVB2UPAKAMPA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.605131769 (13h18m47.830314845s) [noise=true , address=77.90.31.15:4701 , piece_id=MWY66KUMVLCQMCTJSBF6PUTPL5A2AIL55GPKAZABAZYELEX3Z52A, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.605618583 (13h18m47.830801691s) [noise=true , address=104.36.82.10:4085 , piece_id=SRFGVCOSJBC6GVWW7L3YEAIFKAW3RJJQO4LCHQ6UZIXXUES3PJ6Q, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.606201718 (13h18m47.831384795s) [noise=true , address=104.36.82.5:4851 , piece_id=XDD3DWFRLI5374XNSXIEALKIAABOOY6NLA7XRVHRBNMQF5GABMHA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.606759907 (13h18m47.831942984s) [noise=true , address=77.90.31.18:4814 , piece_id=GJQEUMHDADXZHO3YSZX5ITUQFSJQXUAAORPNBLAJZK3WRSJG4WHQ, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.607244707 (13h18m47.832427785s) [noise=true , address=45.91.116.8:4056 , piece_id=RL7KICVBDUYFR2WGZFV55MPEIGNY5JNV2YGMMXBAV23VSOYFP5BA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.607719629 (13h18m47.832902766s) [noise=true , address=77.90.31.12:4605 , piece_id=5N6WPRDM5FGLSPCGHFKDTADKLHRBXRGNELL2BL7BGKY4KCMTGKMQ, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.608307774 (13h18m47.833490851s) [noise=true , address=104.36.82.23:4470 , piece_id=EZ3HRRIU7W5WU6TJEIMMDV4W56BPSPQ4X26AI5DU72ZRKKHQZRYA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.691988392 (13h18m47.917171449s) [upload=11683]: Next returned nil segment Aug 26 05:22:32.691999162 (13h18m47.917182219s) [upload=11683]: Waiting for error group managing segments... Aug 26 05:22:32.699693495 (13h18m47.924876552s) [noise=true , address=79.127.219.47:4065 , piece_id=AMPXWWP2X26KCGGSJT5XIIV7S2ZQCSBPMCRSUYRKLLUU5YJYNJLA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.700617159 (13h18m47.925800216s) [noise=true , address=79.127.219.48:4104 , piece_id=HV264WUAQQURRN27GOZGE7UAFDAXSEBA6MH7PA72IVB2UPAKAMPA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.701137898 (13h18m47.926320955s) [noise=true , address=45.91.116.10:4090 , piece_id=GCTDOJWW73RBYVLSGO7JYNJJOGIKALYZOJCULQRRJAIB5PYUODDA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.701200094 (13h18m47.926383141s) [noise=true , address=45.91.116.8:4056 , piece_id=RL7KICVBDUYFR2WGZFV55MPEIGNY5JNV2YGMMXBAV23VSOYFP5BA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.701597160 (13h18m47.926780207s) [noise=true , address=77.90.31.14:4676 , piece_id=PIMLYBVKLMHO2NDPLZ6TR6XATDIHLKLZNRROQW4LX5ZOKKOXUC4A, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.701717084 (13h18m47.926900142s) [noise=true , address=77.90.31.12:4605 , piece_id=5N6WPRDM5FGLSPCGHFKDTADKLHRBXRGNELL2BL7BGKY4KCMTGKMQ, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.701967515 (13h18m47.927150572s) [noise=true , address=45.91.116.7:4025 , piece_id=SQM2OZOZYIXTD2NZKVDEH5DT3TGTVQC3MMR6B2NSRSZC3LCG3VQQ, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.702309588 (13h18m47.927492645s) [noise=true , address=77.90.31.15:4701 , piece_id=MWY66KUMVLCQMCTJSBF6PUTPL5A2AIL55GPKAZABAZYELEX3Z52A, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.702425255 (13h18m47.927608312s) [noise=true , address=77.90.31.10:4536 , piece_id=RLSTCB3DRLXIM6BS7HNFIASJYJQLV4C4VH26WWO7APNIBA743UWA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.702872827 (13h18m47.928055873s) [noise=true , address=104.36.82.60:4338 , piece_id=7RYWCNBREFMCJAY2OKVONQLZOM7ZGISW7W4G7UIJ2RS4URUCDGIA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.705698062 (13h18m47.930881119s) [noise=true , address=104.36.82.53:4147 , piece_id=6SZ5LYDXM7QREG5466AAYCCX2FJTPVB6AVLU7L536OVEAAERRT2Q, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.722366000 (13h18m47.947549057s) [noise=true , address=104.36.82.10:4085 , piece_id=SRFGVCOSJBC6GVWW7L3YEAIFKAW3RJJQO4LCHQ6UZIXXUES3PJ6Q, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.729280427 (13h18m47.954463474s) [noise=true , address=104.36.82.23:4470 , piece_id=EZ3HRRIU7W5WU6TJEIMMDV4W56BPSPQ4X26AI5DU72ZRKKHQZRYA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.741223921 (13h18m47.966406968s) [noise=true , address=77.90.31.18:4814 , piece_id=GJQEUMHDADXZHO3YSZX5ITUQFSJQXUAAORPNBLAJZK3WRSJG4WHQ, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.741231004 (13h18m47.966414052s) [seg_pos={0 0}, upload=11683]: Segment reached optimal threshold of 14 pieces. Aug 26 05:22:32.741460224 (13h18m47.966643271s) [noise=true , address=104.36.82.5:4851 , piece_id=XDD3DWFRLI5374XNSXIEALKIAABOOY6NLA7XRVHRBNMQF5GABMHA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fTtTieEUquaKNUNzqK98PkX7tVxjsiNeMLjz8kQJwdLne7d9R): protocol: expected piece hash; context canceled; EOF Aug 26 05:22:32.741510720 (13h18m47.966693777s) [noise=true , address=79.127.201.215:4348 , piece_id=2NC6IN6DCEUBKUWP5P6BLTUILQUYH7OKFBLGUPNIANFDPS3AASXA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: context canceled Aug 26 05:22:32.741626567 (13h18m47.966809614s) [noise=true , address=79.127.205.246:4268 , piece_id=QOTALM2EQDO4WOEEA2HTKMMFBUBFAPQ4IWJXP7OCMMWEN7JUHGJA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k72iHWdcnM2JKs7VPTQFQwmpQ835HmAP8KpXxjMbEy5QxfzG): protocol: read tcp 5.161.89.252:20776->79.127.205.246:4268: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 26 05:22:32.741637688 (13h18m47.966820735s) [noise=true , address=64.49.13.154:4934 , piece_id=MZ2CATHR2J7MEW3ZVCBA5Q7SR7JN2M3MKXJ2ACQMQHMPXYOJRXWQ, seg_pos={0 0}, upload=11683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: read tcp 5.161.89.252:30556->64.49.13.154:4934: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 26 05:22:32.741659869 (13h18m47.966842926s) [seg_pos={0 0}, upload=11683]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 26 05:22:32.741708741 (13h18m47.966891789s) [upload=11683]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:22:32.741712488 (13h18m47.966895545s) [upload=11683]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:23:03.030254989 (13h19m18.255438035s) [upload=11683]: Done uploading segments... Aug 26 05:23:03.030281389 (13h19m18.255464436s) [upload=11683]: Upload finished. err: metaclient: context deadline exceeded Duration: 21.758963507s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [...................X..................XXX....XXX......X....X] duration: 30.000828975s FAIL (2025-08-26 05:25:38 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000855496s edge gateway us-select-1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 5 out of 60 is failed (threshold=6) [.......................X...............X..X....X....X.......] duration: 19.894455636s remote: "tcp:136.0.77.2:443" response headers: Access-Control-Allow-Methods=GET, HEAD Access-Control-Allow-Origin=* X-Request-Id=9LMxmq1gtt2 Date=Tue, 26 Aug 2025 05:20:20 GMT Accept-Ranges=bytes Access-Control-Allow-Headers=* Content-Type=text/html; charset=utf-8 target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt FAIL (2025-08-26 05:25:34 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error \| Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error \| Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error \| Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY" Duration: 19.894473449s edge linksharing bgp us1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 7 out of 60 is failed (threshold=3) [.....................................X.....XX.XX....XX......] duration: 8.087855073s remote: "tcp:45.38.24.2:443" response headers: Content-Length=433 Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:20:48 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=185F398ACC12A1DA X-Request-Id=4XAeFcrV1RT target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-26 05:25:29 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F398ACC12A1DA</RequestId><HostId></HostId></Error>" Duration: 8.087873979s edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 13 out of 60 is failed (threshold=3) [.....................X....XX.........XX.XX..XXX....XX......X] duration: 30.00038261s FAIL (2025-08-26 05:25:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000396746s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 3 out of 60 is failed (threshold=3) [............................X..........X....X...............] duration: 6.994927585s remote: "tcp:136.0.77.2:443" response headers: X-Request-Id=VcCcTMkH9av Content-Length=423 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=185F392FFCED1105 X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:14:18 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-26 05:25:20 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F392FFCED1105</RequestId><HostId></HostId></Error>" Duration: 6.994953884s edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 8 out of 60 is failed (threshold=3) [...............................X........XX.X.X.X.....X..X...] duration: 51.426781261s FAIL (2025-08-26 05:25:16 UTC) operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== (13h18m10.903192629s) [upload=11683]: Uploading segments... Aug 26 05:21:55.678233874 (13h18m10.903416931s) [upload=11683]: Got next segment. Inline: false Aug 26 05:21:55.678260154 (13h18m10.903443211s) [upload=11683]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:21:55.678264411 (13h18m10.903447459s) [upload=11683]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:22:32.600325641 (13h18m47.825508709s) [seg_pos={0 0}, upload=11683]: Begin upload segment... Aug 26 05:22:32.600393179 (13h18m47.825576255s) [seg_pos={0 0}, upload=11683]: Done begin upload segment. Aug 26 05:22:32.600435157 (13h18m47.825618234s) [noise=true , address=77.90.31.10:4536 , piece_id=RLSTCB3DRLXIM6BS7HNFIASJYJQLV4C4VH26WWO7APNIBA743UWA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.600452519 (13h18m47.825635597s) [noise=true , address=77.90.31.14:4676 , piece_id=PIMLYBVKLMHO2NDPLZ6TR6XATDIHLKLZNRROQW4LX5ZOKKOXUC4A, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.601074888 (13h18m47.826257966s) [noise=true , address=64.49.13.154:4934 , piece_id=MZ2CATHR2J7MEW3ZVCBA5Q7SR7JN2M3MKXJ2ACQMQHMPXYOJRXWQ, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.601112790 (13h18m47.826295867s) [noise=true , address=45.91.116.10:4090 , piece_id=GCTDOJWW73RBYVLSGO7JYNJJOGIKALYZOJCULQRRJAIB5PYUODDA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.601653837 (13h18m47.826836904s) [noise=true , address=45.91.116.7:4025 , piece_id=SQM2OZOZYIXTD2NZKVDEH5DT3TGTVQC3MMR6B2NSRSZC3LCG3VQQ, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.602360183 (13h18m47.827543251s) [noise=true , address=79.127.205.246:4268 , piece_id=QOTALM2EQDO4WOEEA2HTKMMFBUBFAPQ4IWJXP7OCMMWEN7JUHGJA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.602820207 (13h18m47.828003284s) [noise=true , address=79.127.201.215:4348 , piece_id=2NC6IN6DCEUBKUWP5P6BLTUILQUYH7OKFBLGUPNIANFDPS3AASXA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.603293896 (13h18m47.828476974s) [noise=true , address=104.36.82.60:4338 , piece_id=7RYWCNBREFMCJAY2OKVONQLZOM7ZGISW7W4G7UIJ2RS4URUCDGIA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.603762638 (13h18m47.828945714s) [noise=true , address=104.36.82.53:4147 , piece_id=6SZ5LYDXM7QREG5466AAYCCX2FJTPVB6AVLU7L536OVEAAERRT2Q, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.604257226 (13h18m47.829440304s) [noise=true , address=79.127.219.47:4065 , piece_id=AMPXWWP2X26KCGGSJT5XIIV7S2ZQCSBPMCRSUYRKLLUU5YJYNJLA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.604687584 (13h18m47.829870662s) [noise=true , address=79.127.219.48:4104 , piece_id=HV264WUAQQURRN27GOZGE7UAFDAXSEBA6MH7PA72IVB2UPAKAMPA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.605131769 (13h18m47.830314845s) [noise=true , address=77.90.31.15:4701 , piece_id=MWY66KUMVLCQMCTJSBF6PUTPL5A2AIL55GPKAZABAZYELEX3Z52A, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.605618583 (13h18m47.830801691s) [noise=true , address=104.36.82.10:4085 , piece_id=SRFGVCOSJBC6GVWW7L3YEAIFKAW3RJJQO4LCHQ6UZIXXUES3PJ6Q, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.606201718 (13h18m47.831384795s) [noise=true , address=104.36.82.5:4851 , piece_id=XDD3DWFRLI5374XNSXIEALKIAABOOY6NLA7XRVHRBNMQF5GABMHA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.606759907 (13h18m47.831942984s) [noise=true , address=77.90.31.18:4814 , piece_id=GJQEUMHDADXZHO3YSZX5ITUQFSJQXUAAORPNBLAJZK3WRSJG4WHQ, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.607244707 (13h18m47.832427785s) [noise=true , address=45.91.116.8:4056 , piece_id=RL7KICVBDUYFR2WGZFV55MPEIGNY5JNV2YGMMXBAV23VSOYFP5BA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.607719629 (13h18m47.832902766s) [noise=true , address=77.90.31.12:4605 , piece_id=5N6WPRDM5FGLSPCGHFKDTADKLHRBXRGNELL2BL7BGKY4KCMTGKMQ, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.608307774 (13h18m47.833490851s) [noise=true , address=104.36.82.23:4470 , piece_id=EZ3HRRIU7W5WU6TJEIMMDV4W56BPSPQ4X26AI5DU72ZRKKHQZRYA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.691988392 (13h18m47.917171449s) [upload=11683]: Next returned nil segment Aug 26 05:22:32.691999162 (13h18m47.917182219s) [upload=11683]: Waiting for error group managing segments... Aug 26 05:22:32.699693495 (13h18m47.924876552s) [noise=true , address=79.127.219.47:4065 , piece_id=AMPXWWP2X26KCGGSJT5XIIV7S2ZQCSBPMCRSUYRKLLUU5YJYNJLA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.700617159 (13h18m47.925800216s) [noise=true , address=79.127.219.48:4104 , piece_id=HV264WUAQQURRN27GOZGE7UAFDAXSEBA6MH7PA72IVB2UPAKAMPA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.701137898 (13h18m47.926320955s) [noise=true , address=45.91.116.10:4090 , piece_id=GCTDOJWW73RBYVLSGO7JYNJJOGIKALYZOJCULQRRJAIB5PYUODDA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.701200094 (13h18m47.926383141s) [noise=true , address=45.91.116.8:4056 , piece_id=RL7KICVBDUYFR2WGZFV55MPEIGNY5JNV2YGMMXBAV23VSOYFP5BA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.701597160 (13h18m47.926780207s) [noise=true , address=77.90.31.14:4676 , piece_id=PIMLYBVKLMHO2NDPLZ6TR6XATDIHLKLZNRROQW4LX5ZOKKOXUC4A, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.701717084 (13h18m47.926900142s) [noise=true , address=77.90.31.12:4605 , piece_id=5N6WPRDM5FGLSPCGHFKDTADKLHRBXRGNELL2BL7BGKY4KCMTGKMQ, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.701967515 (13h18m47.927150572s) [noise=true , address=45.91.116.7:4025 , piece_id=SQM2OZOZYIXTD2NZKVDEH5DT3TGTVQC3MMR6B2NSRSZC3LCG3VQQ, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.702309588 (13h18m47.927492645s) [noise=true , address=77.90.31.15:4701 , piece_id=MWY66KUMVLCQMCTJSBF6PUTPL5A2AIL55GPKAZABAZYELEX3Z52A, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.702425255 (13h18m47.927608312s) [noise=true , address=77.90.31.10:4536 , piece_id=RLSTCB3DRLXIM6BS7HNFIASJYJQLV4C4VH26WWO7APNIBA743UWA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.702872827 (13h18m47.928055873s) [noise=true , address=104.36.82.60:4338 , piece_id=7RYWCNBREFMCJAY2OKVONQLZOM7ZGISW7W4G7UIJ2RS4URUCDGIA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.705698062 (13h18m47.930881119s) [noise=true , address=104.36.82.53:4147 , piece_id=6SZ5LYDXM7QREG5466AAYCCX2FJTPVB6AVLU7L536OVEAAERRT2Q, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.722366000 (13h18m47.947549057s) [noise=true , address=104.36.82.10:4085 , piece_id=SRFGVCOSJBC6GVWW7L3YEAIFKAW3RJJQO4LCHQ6UZIXXUES3PJ6Q, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.729280427 (13h18m47.954463474s) [noise=true , address=104.36.82.23:4470 , piece_id=EZ3HRRIU7W5WU6TJEIMMDV4W56BPSPQ4X26AI5DU72ZRKKHQZRYA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.741223921 (13h18m47.966406968s) [noise=true , address=77.90.31.18:4814 , piece_id=GJQEUMHDADXZHO3YSZX5ITUQFSJQXUAAORPNBLAJZK3WRSJG4WHQ, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.741231004 (13h18m47.966414052s) [seg_pos={0 0}, upload=11683]: Segment reached optimal threshold of 14 pieces. Aug 26 05:22:32.741460224 (13h18m47.966643271s) [noise=true , address=104.36.82.5:4851 , piece_id=XDD3DWFRLI5374XNSXIEALKIAABOOY6NLA7XRVHRBNMQF5GABMHA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fTtTieEUquaKNUNzqK98PkX7tVxjsiNeMLjz8kQJwdLne7d9R): protocol: expected piece hash; context canceled; EOF Aug 26 05:22:32.741510720 (13h18m47.966693777s) [noise=true , address=79.127.201.215:4348 , piece_id=2NC6IN6DCEUBKUWP5P6BLTUILQUYH7OKFBLGUPNIANFDPS3AASXA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: context canceled Aug 26 05:22:32.741626567 (13h18m47.966809614s) [noise=true , address=79.127.205.246:4268 , piece_id=QOTALM2EQDO4WOEEA2HTKMMFBUBFAPQ4IWJXP7OCMMWEN7JUHGJA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k72iHWdcnM2JKs7VPTQFQwmpQ835HmAP8KpXxjMbEy5QxfzG): protocol: read tcp 5.161.89.252:20776->79.127.205.246:4268: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 26 05:22:32.741637688 (13h18m47.966820735s) [noise=true , address=64.49.13.154:4934 , piece_id=MZ2CATHR2J7MEW3ZVCBA5Q7SR7JN2M3MKXJ2ACQMQHMPXYOJRXWQ, seg_pos={0 0}, upload=11683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: read tcp 5.161.89.252:30556->64.49.13.154:4934: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 26 05:22:32.741659869 (13h18m47.966842926s) [seg_pos={0 0}, upload=11683]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 26 05:22:32.741708741 (13h18m47.966891789s) [upload=11683]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:22:32.741712488 (13h18m47.966895545s) [upload=11683]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:23:03.030254989 (13h19m18.255438035s) [upload=11683]: Done uploading segments... Aug 26 05:23:03.030281389 (13h19m18.255464436s) [upload=11683]: Upload finished. err: metaclient: context deadline exceeded Duration: 51.426808853s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 5 out of 60 is failed (threshold=3) [..........................................X.X..XX.....X.....] duration: 20.297697038s FAIL (2025-08-26 05:25:13 UTC) operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:19:33.789655908 (13h15m49.014838985s) [upload=11650]: Starting upload Aug 26 05:19:33.789738403 (13h15m49.01492148s) [upload=11650]: Done starting upload Aug 26 05:19:33.789799137 (13h15m49.014982224s) [upload=11650]: Uploading segments... Aug 26 05:19:33.789882654 (13h15m49.01506573s) [upload=11650]: Got next segment. Inline: true Aug 26 05:19:33.789891009 (13h15m49.015074086s) [upload=11650]: Waiting for error group managing segments... Aug 26 05:19:33.789942085 (13h15m49.015125162s) [upload=11650]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:19:33.789947546 (13h15m49.015130624s) [upload=11650]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:19:33.789951443 (13h15m49.015134521s) [upload=11650]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:19:37.763117992 (13h15m52.988301059s) [upload=11650]: Done uploading segments... Aug 26 05:19:37.763136176 (13h15m52.988319243s) [upload=11650]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration:* 20.29774087s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 18 out of 60 is failed (threshold=3) [...............XX.......X..X.......XXXXXXXX.XX.......X..XX.X] duration: 30.005835434s FAIL (2025-08-26 05:25:06 UTC) operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 30.005855712s core uplink us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 3 out of 60 is failed (threshold=3) [.............................X..........X....X..............] duration: 7.964245546s remote: "tcp:136.0.77.2:443" response headers: X-Request-Id=VcCcTMkH9av Content-Length=423 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=185F392FFCED1105 X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:14:18 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-26 05:25:04 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F392FFCED1105</RequestId><HostId></HostId></Error>" Duration: 7.964267407s edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 11 out of 60 is failed (threshold=3) [....................XX.......X..........XX.X.X.XX....X..X...] duration: 20.506926601s FAIL (2025-08-26 05:25:01 UTC) operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 26 05:22:24.933708597 (13h18m40.158891675s) [upload=11689]: Starting upload Aug 26 05:22:24.933811441 (13h18m40.158994518s) [upload=11689]: Done starting upload Aug 26 05:22:24.933882795 (13h18m40.159065873s) [upload=11689]: Uploading segments... Aug 26 05:22:24.933924644 (13h18m40.159107731s) [upload=11689]: Got next segment. Inline: true Aug 26 05:22:24.933930565 (13h18m40.159113642s) [upload=11689]: Waiting for error group managing segments... Aug 26 05:22:24.933975670 (13h18m40.159158747s) [upload=11689]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:22:24.933981069 (13h18m40.159164147s) [upload=11689]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:22:24.933984546 (13h18m40.159167624s) [upload=11689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:22:54.919523652 (13h19m10.144706699s) [upload=11689]: Done uploading segments... Aug 26 05:22:54.919539953 (13h19m10.144722999s) [upload=11689]: Upload finished. err: metaclient: context deadline exceeded Duration:* 20.506948613s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 11 out of 60 is failed (threshold=3) [...................X.....XX..........XX....X..X.XX....X..X..] duration: 24.763136873s FAIL (2025-08-26 05:24:55 UTC) operation: Commit uplink: metaclient: context deadline exceeded Duration: 24.763164494s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 5 out of 60 is failed (threshold=3) [...........................................X.X..XX.....X....] duration: 48.736060148s FAIL (2025-08-26 05:24:53 UTC) operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:19:33.789655908 (13h15m49.014838985s) [upload=11650]: Starting upload Aug 26 05:19:33.789738403 (13h15m49.01492148s) [upload=11650]: Done starting upload Aug 26 05:19:33.789799137 (13h15m49.014982224s) [upload=11650]: Uploading segments... Aug 26 05:19:33.789882654 (13h15m49.01506573s) [upload=11650]: Got next segment. Inline: true Aug 26 05:19:33.789891009 (13h15m49.015074086s) [upload=11650]: Waiting for error group managing segments... Aug 26 05:19:33.789942085 (13h15m49.015125162s) [upload=11650]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:19:33.789947546 (13h15m49.015130624s) [upload=11650]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:19:33.789951443 (13h15m49.015134521s) [upload=11650]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:19:37.763117992 (13h15m52.988301059s) [upload=11650]: Done uploading segments... Aug 26 05:19:37.763136176 (13h15m52.988319243s) [upload=11650]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration:* 48.736089784s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 5 out of 60 is failed (threshold=6) [........................X...............X..X....X....X......] duration: 45.284167617s remote: "tcp:136.0.77.2:443" response headers: Access-Control-Allow-Methods=GET, HEAD Access-Control-Allow-Origin=* X-Request-Id=9LMxmq1gtt2 Date=Tue, 26 Aug 2025 05:20:20 GMT Accept-Ranges=bytes Access-Control-Allow-Headers=* Content-Type=text/html; charset=utf-8 target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt FAIL (2025-08-26 05:24:51 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error \| Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error \| Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error \| Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY" Duration: 45.284188337s edge linksharing bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [....................X.....X...........X.X.XX.XXXXX....X..X..] duration: 23.805994078s FAIL (2025-08-26 05:24:35 UTC) operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 26 05:22:16.980734776 (13h18m32.205917842s) [upload=11686]: Starting upload Aug 26 05:22:16.980834793 (13h18m32.20601787s) [upload=11686]: Done starting upload Aug 26 05:22:16.980961741 (13h18m32.206144808s) [upload=11686]: Uploading segments... Aug 26 05:22:16.981263788 (13h18m32.206446855s) [upload=11686]: Got next segment. Inline: false Aug 26 05:22:16.981323069 (13h18m32.206506126s) [upload=11686]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:22:16.981331305 (13h18m32.206514372s) [upload=11686]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:22:40.843198771 (13h18m56.068381818s) [seg_pos={0 0}, upload=11686]: Begin upload segment... Aug 26 05:22:40.843250447 (13h18m56.068433494s) [seg_pos={0 0}, upload=11686]: Done begin upload segment. Aug 26 05:22:40.843271097 (13h18m56.068454143s) [noise=true , address=77.90.31.15:4697 , piece_id=VX75U6KQPP47KIU3EZIIOGGDTR5JFAE53CLPI5BFUVE6LTDJNYUQ, seg_pos={0 0}, upload=11686]: Uploading piece... Aug 26 05:22:40.843281005 (13h18m56.068464052s) [noise=true , address=45.91.116.6:4974 , piece_id=GQOQ5MU3AEJXZXL3GIJTT5V4ECTM3VGERKBWD5EL7JCBGXGDOMTA, seg_pos={0 0}, upload=11686]: Uploading piece... Aug 26 05:22:40.843353000 (13h18m56.068536057s) [noise=true , address=45.91.116.8:4045 , piece_id=OSIDIB5YCJZUUYC7M2RJMZLJM47PTXWS277H6RDRRN3LSAPI4VWQ, seg_pos={0 0}, upload=11686]: Uploading piece... Aug 26 05:22:40.843550341 (13h18m56.068733388s) [noise=true , address=45.91.116.4:4938 , piece_id=FMUVGXP2V65EFTOXVQSD3FDKN7O4ZTFKSNI5HEBTU25TAXJYSY4Q, seg_pos={0 0}, upload=11686]: Uploading piece... Aug 26 05:22:40.843616635 (13h18m56.068799683s) [noise=true , address=104.36.82.16:4293 , piece_id=7CNPC7IWP3YOAVXUMQ6ALY7RNKXDRNABZ5XBFSAUZ3JCYXUUMJCA, seg_pos={0 0}, upload=11686]: Uploading piece... Aug 26 05:22:40.843841016 (13h18m56.069024063s) [noise=true , address=104.36.82.6:4873 , piece_id=4WVKCJDQVMZ4MGR5NWRQJUXHV265AEL6WW7X6QYDKCVTX4KNIC5Q, seg_pos={0 0}, upload=11686]: Uploading piece... Aug 26 05:22:40.843890821 (13h18m56.069073878s) [noise=true , address=77.90.31.19:4841 , piece_id=UNAOLAZVPHJ6NDDXWO6U7EEHYEPVQJNASFYHTVV5BUDNRVQIGADQ, seg_pos={0 0}, upload=11686]: Uploading piece... Aug 26 05:22:40.844147411 (13h18m56.069330469s) [noise=true , address=77.90.31.16:4733 , piece_id=IZ6I3BBJYWNINNIS73BDLW7CXF2RDSVIXYU3CMVI3GE26HWKCNXQ, seg_pos={0 0}, upload=11686]: Uploading piece... Aug 26 05:22:40.844157601 (13h18m56.069340668s) [noise=true , address=45.91.116.12:4225 , piece_id=CIZYKG7LOLXLGVH7MXMPU456A4IWBBUDIFRRMHRV7KMBTERMMMSA, seg_pos={0 0}, upload=11686]: Uploading piece... Aug 26 05:22:40.844379839 (13h18m56.069562886s) [noise=true , address=45.91.116.12:4226 , piece_id=4QDIBBA6JO62W7YEFGUGKFGGVDRUIADVBPZER2PBJQ2RM4CJUESQ, seg_pos={0 0}, upload=11686]: Uploading piece... Aug 26 05:22:40.844449129 (13h18m56.069632176s) [noise=true , address=77.90.31.12:4589 , piece_id=NYHIKAEJZBNO7HKEDQ6NP2KOIR3U5H5GC42ZH3GQ5MZKV3UVAXNQ, seg_pos={0 0}, upload=11686]: Uploading piece... Aug 26 05:22:40.844652531 (13h18m56.069835588s) [noise=true , address=45.91.116.7:4010 , piece_id=QMRZIMSU7R4PFBKH4RNMVVJDZUHV25DCHBNVTO3QJ3AV4U65KMVA, seg_pos={0 0}, upload=11686]: Uploading piece... Aug 26 05:22:40.844737480 (13h18m56.069920527s) [noise=true , address=104.36.82.9:4005 , piece_id=3T2SZVSO4VPGQOUN2BIPB2HC6IDULSVNVLRLXICZUJMLL5HK3EOA, seg_pos={0 0}, upload=11686]: Uploading piece... Aug 26 05:22:40.845051571 (13h18m56.070234618s) [noise=true , address=77.90.31.21:4878 , piece_id=AA232AUIO5IUGVCLH5XOGAFMMSA3SVTPA3EHSYPSSRI4N64HUOLA, seg_pos={0 0}, upload=11686]: Uploading piece... Aug 26 05:22:40.845351193 (13h18m56.07053424s) [noise=true , address=45.91.116.4:4940 , piece_id=Z56PI2KLIW2VF363WZ54FEXHMMASD5IGD7WLBVWAXZA35HHHFYJQ, seg_pos={0 0}, upload=11686]: Uploading piece... Aug 26 05:22:40.845654673 (13h18m56.07083772s) [noise=true , address=104.36.82.11:4114 , piece_id=PTQVP37IARLVR3KSYJKNU2XX2JURCVJU3EZQ75RKYUUA4PMX6L2A, seg_pos={0 0}, upload=11686]: Uploading piece... Aug 26 05:22:40.929806696 (13h18m56.154989753s) [upload=11686]: Next returned nil segment Aug 26 05:22:40.929845939 (13h18m56.155028997s) [upload=11686]: Waiting for error group managing segments... Aug 26 05:22:40.940293253 (13h18m56.16547631s) [noise=true , address=45.91.116.8:4045 , piece_id=OSIDIB5YCJZUUYC7M2RJMZLJM47PTXWS277H6RDRRN3LSAPI4VWQ, seg_pos={0 0}, upload=11686]: Done uploading piece. err: <nil> Aug 26 05:22:40.941067998 (13h18m56.166251045s) [noise=true , address=45.91.116.12:4226 , piece_id=4QDIBBA6JO62W7YEFGUGKFGGVDRUIADVBPZER2PBJQ2RM4CJUESQ, seg_pos={0 0}, upload=11686]: Done uploading piece. err: <nil> Aug 26 05:22:40.941281339 (13h18m56.166464386s) [noise=true , address=45.91.116.7:4010 , piece_id=QMRZIMSU7R4PFBKH4RNMVVJDZUHV25DCHBNVTO3QJ3AV4U65KMVA, seg_pos={0 0}, upload=11686]: Done uploading piece. err: <nil> Aug 26 05:22:40.941471615 (13h18m56.166654673s) [noise=true , address=45.91.116.6:4974 , piece_id=GQOQ5MU3AEJXZXL3GIJTT5V4ECTM3VGERKBWD5EL7JCBGXGDOMTA, seg_pos={0 0}, upload=11686]: Done uploading piece. err: <nil> Aug 26 05:22:40.941773563 (13h18m56.16695661s) [noise=true , address=45.91.116.4:4940 , piece_id=Z56PI2KLIW2VF363WZ54FEXHMMASD5IGD7WLBVWAXZA35HHHFYJQ, seg_pos={0 0}, upload=11686]: Done uploading piece. err: <nil> Aug 26 05:22:40.942258614 (13h18m56.167441672s) [noise=true , address=45.91.116.12:4225 , piece_id=CIZYKG7LOLXLGVH7MXMPU456A4IWBBUDIFRRMHRV7KMBTERMMMSA, seg_pos={0 0}, upload=11686]: Done uploading piece. err: <nil> Aug 26 05:22:40.942332744 (13h18m56.167515791s) [noise=true , address=77.90.31.21:4878 , piece_id=AA232AUIO5IUGVCLH5XOGAFMMSA3SVTPA3EHSYPSSRI4N64HUOLA, seg_pos={0 0}, upload=11686]: Done uploading piece. err: <nil> Aug 26 05:22:40.942361959 (13h18m56.167545006s) [noise=true , address=45.91.116.4:4938 , piece_id=FMUVGXP2V65EFTOXVQSD3FDKN7O4ZTFKSNI5HEBTU25TAXJYSY4Q, seg_pos={0 0}, upload=11686]: Done uploading piece. err: <nil> Aug 26 05:22:40.942651483 (13h18m56.16783454s) [noise=true , address=77.90.31.19:4841 , piece_id=UNAOLAZVPHJ6NDDXWO6U7EEHYEPVQJNASFYHTVV5BUDNRVQIGADQ, seg_pos={0 0}, upload=11686]: Done uploading piece. err: <nil> Aug 26 05:22:40.944389386 (13h18m56.169572443s) [noise=true , address=104.36.82.6:4873 , piece_id=4WVKCJDQVMZ4MGR5NWRQJUXHV265AEL6WW7X6QYDKCVTX4KNIC5Q, seg_pos={0 0}, upload=11686]: Done uploading piece. err: <nil> Aug 26 05:22:40.944652310 (13h18m56.169835367s) [noise=true , address=104.36.82.11:4114 , piece_id=PTQVP37IARLVR3KSYJKNU2XX2JURCVJU3EZQ75RKYUUA4PMX6L2A, seg_pos={0 0}, upload=11686]: Done uploading piece. err: <nil> Aug 26 05:22:40.945196002 (13h18m56.170379059s) [noise=true , address=77.90.31.15:4697 , piece_id=VX75U6KQPP47KIU3EZIIOGGDTR5JFAE53CLPI5BFUVE6LTDJNYUQ, seg_pos={0 0}, upload=11686]: Done uploading piece. err: <nil> Aug 26 05:22:40.945771602 (13h18m56.170954659s) [noise=true , address=77.90.31.16:4733 , piece_id=IZ6I3BBJYWNINNIS73BDLW7CXF2RDSVIXYU3CMVI3GE26HWKCNXQ, seg_pos={0 0}, upload=11686]: Done uploading piece. err: <nil> Aug 26 05:22:40.945821427 (13h18m56.171004484s) [seg_pos={0 0}, upload=11686]: Segment reached optimal threshold of 13 pieces. Aug 26 05:22:40.945905374 (13h18m56.171088431s) [noise=true , address=104.36.82.9:4005 , piece_id=3T2SZVSO4VPGQOUN2BIPB2HC6IDULSVNVLRLXICZUJMLL5HK3EOA, seg_pos={0 0}, upload=11686]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF Aug 26 05:22:40.945968433 (13h18m56.171151479s) [noise=true , address=77.90.31.12:4589 , piece_id=NYHIKAEJZBNO7HKEDQ6NP2KOIR3U5H5GC42ZH3GQ5MZKV3UVAXNQ, seg_pos={0 0}, upload=11686]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Aug 26 05:22:40.945997948 (13h18m56.171181005s) [noise=true , address=104.36.82.16:4293 , piece_id=7CNPC7IWP3YOAVXUMQ6ALY7RNKXDRNABZ5XBFSAUZ3JCYXUUMJCA, seg_pos={0 0}, upload=11686]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE): protocol: expected piece hash; context canceled; EOF Aug 26 05:22:40.946012064 (13h18m56.171195121s) [seg_pos={0 0}, upload=11686]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 05:22:40.946054955 (13h18m56.171238002s) [upload=11686]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:22:40.946058742 (13h18m56.171241799s) [upload=11686]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:22:44.348063957 (13h18m59.573247044s) [upload=11686]: Done uploading segments... Aug 26 05:22:44.348083072 (13h18m59.573266149s) [upload=11686]: Upload finished. err: <nil> Duration: 23.80601593s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 11 out of 60 is failed (threshold=3) [.....................XX.......X..........XX.X.X.XX....X..X..] duration: 12.918098562s FAIL (2025-08-26 05:24:32 UTC) operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 26 05:22:24.933708597 (13h18m40.158891675s) [upload=11689]: Starting upload Aug 26 05:22:24.933811441 (13h18m40.158994518s) [upload=11689]: Done starting upload Aug 26 05:22:24.933882795 (13h18m40.159065873s) [upload=11689]: Uploading segments... Aug 26 05:22:24.933924644 (13h18m40.159107731s) [upload=11689]: Got next segment. Inline: true Aug 26 05:22:24.933930565 (13h18m40.159113642s) [upload=11689]: Waiting for error group managing segments... Aug 26 05:22:24.933975670 (13h18m40.159158747s) [upload=11689]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:22:24.933981069 (13h18m40.159164147s) [upload=11689]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:22:24.933984546 (13h18m40.159167624s) [upload=11689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:22:54.919523652 (13h19m10.144706699s) [upload=11689]: Done uploading segments... Aug 26 05:22:54.919539953 (13h19m10.144722999s) [upload=11689]: Upload finished. err: metaclient: context deadline exceeded Duration:* 12.918121736s core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 3 out of 60 is failed (threshold=3) [..............................X..........X....X.............] duration: 2.901565646s remote: "tcp:136.0.77.2:443" response headers: X-Request-Id=VcCcTMkH9av Content-Length=423 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=185F392FFCED1105 X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:14:18 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-26 05:24:30 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F392FFCED1105</RequestId><HostId></HostId></Error>" Duration: 2.901596954s edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 7 out of 60 is failed (threshold=3) [......................................X.....XX.XX....XX.....] duration: 6.305815833s remote: "tcp:45.38.24.2:443" response headers: Content-Length=433 Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:20:48 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=185F398ACC12A1DA X-Request-Id=4XAeFcrV1RT target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-26 05:24:29 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F398ACC12A1DA</RequestId><HostId></HostId></Error>" Duration: 6.305860657s edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [....................X..................XXX....XXX......X....] duration: 28.79159782s FAIL (2025-08-26 05:24:28 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 28.791625352s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 12 out of 60 is failed (threshold=3) [......................X....XX.........XX.XX..XXX....XX......] duration: 19.082244461s FAIL (2025-08-26 05:24:11 UTC) orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 185F39844D3D72D8, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled) Duration: 19.082261674s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 3 out of 60 is failed (threshold=3) [...............................X..........X....X............] duration: 8.039785094s remote: "tcp:136.0.77.2:443" response headers: X-Request-Id=VcCcTMkH9av Content-Length=423 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=185F392FFCED1105 X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:14:18 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-26 05:24:10 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F392FFCED1105</RequestId><HostId></HostId></Error>" Duration: 8.039807496s edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 17 out of 60 is failed (threshold=3) [................XX.......X..X.......XXXXXXXX.XX.......X..XX.] duration: 2.312180608s FAIL (2025-08-26 05:23:50 UTC) operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 2.312206626s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.........................................X.X..X.............] duration: 7.053079672s FAIL (2025-08-26 05:23:46 UTC) orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 185F3927EAB52717, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled) Duration: 7.053096313s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 8 out of 60 is failed (threshold=3) [................................X........XX.X.X.X.....X..X..] duration: 12.20522913s FAIL (2025-08-26 05:23:44 UTC) operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== (13h18m10.903192629s) [upload=11683]: Uploading segments... Aug 26 05:21:55.678233874 (13h18m10.903416931s) [upload=11683]: Got next segment. Inline: false Aug 26 05:21:55.678260154 (13h18m10.903443211s) [upload=11683]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:21:55.678264411 (13h18m10.903447459s) [upload=11683]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:22:32.600325641 (13h18m47.825508709s) [seg_pos={0 0}, upload=11683]: Begin upload segment... Aug 26 05:22:32.600393179 (13h18m47.825576255s) [seg_pos={0 0}, upload=11683]: Done begin upload segment. Aug 26 05:22:32.600435157 (13h18m47.825618234s) [noise=true , address=77.90.31.10:4536 , piece_id=RLSTCB3DRLXIM6BS7HNFIASJYJQLV4C4VH26WWO7APNIBA743UWA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.600452519 (13h18m47.825635597s) [noise=true , address=77.90.31.14:4676 , piece_id=PIMLYBVKLMHO2NDPLZ6TR6XATDIHLKLZNRROQW4LX5ZOKKOXUC4A, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.601074888 (13h18m47.826257966s) [noise=true , address=64.49.13.154:4934 , piece_id=MZ2CATHR2J7MEW3ZVCBA5Q7SR7JN2M3MKXJ2ACQMQHMPXYOJRXWQ, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.601112790 (13h18m47.826295867s) [noise=true , address=45.91.116.10:4090 , piece_id=GCTDOJWW73RBYVLSGO7JYNJJOGIKALYZOJCULQRRJAIB5PYUODDA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.601653837 (13h18m47.826836904s) [noise=true , address=45.91.116.7:4025 , piece_id=SQM2OZOZYIXTD2NZKVDEH5DT3TGTVQC3MMR6B2NSRSZC3LCG3VQQ, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.602360183 (13h18m47.827543251s) [noise=true , address=79.127.205.246:4268 , piece_id=QOTALM2EQDO4WOEEA2HTKMMFBUBFAPQ4IWJXP7OCMMWEN7JUHGJA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.602820207 (13h18m47.828003284s) [noise=true , address=79.127.201.215:4348 , piece_id=2NC6IN6DCEUBKUWP5P6BLTUILQUYH7OKFBLGUPNIANFDPS3AASXA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.603293896 (13h18m47.828476974s) [noise=true , address=104.36.82.60:4338 , piece_id=7RYWCNBREFMCJAY2OKVONQLZOM7ZGISW7W4G7UIJ2RS4URUCDGIA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.603762638 (13h18m47.828945714s) [noise=true , address=104.36.82.53:4147 , piece_id=6SZ5LYDXM7QREG5466AAYCCX2FJTPVB6AVLU7L536OVEAAERRT2Q, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.604257226 (13h18m47.829440304s) [noise=true , address=79.127.219.47:4065 , piece_id=AMPXWWP2X26KCGGSJT5XIIV7S2ZQCSBPMCRSUYRKLLUU5YJYNJLA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.604687584 (13h18m47.829870662s) [noise=true , address=79.127.219.48:4104 , piece_id=HV264WUAQQURRN27GOZGE7UAFDAXSEBA6MH7PA72IVB2UPAKAMPA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.605131769 (13h18m47.830314845s) [noise=true , address=77.90.31.15:4701 , piece_id=MWY66KUMVLCQMCTJSBF6PUTPL5A2AIL55GPKAZABAZYELEX3Z52A, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.605618583 (13h18m47.830801691s) [noise=true , address=104.36.82.10:4085 , piece_id=SRFGVCOSJBC6GVWW7L3YEAIFKAW3RJJQO4LCHQ6UZIXXUES3PJ6Q, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.606201718 (13h18m47.831384795s) [noise=true , address=104.36.82.5:4851 , piece_id=XDD3DWFRLI5374XNSXIEALKIAABOOY6NLA7XRVHRBNMQF5GABMHA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.606759907 (13h18m47.831942984s) [noise=true , address=77.90.31.18:4814 , piece_id=GJQEUMHDADXZHO3YSZX5ITUQFSJQXUAAORPNBLAJZK3WRSJG4WHQ, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.607244707 (13h18m47.832427785s) [noise=true , address=45.91.116.8:4056 , piece_id=RL7KICVBDUYFR2WGZFV55MPEIGNY5JNV2YGMMXBAV23VSOYFP5BA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.607719629 (13h18m47.832902766s) [noise=true , address=77.90.31.12:4605 , piece_id=5N6WPRDM5FGLSPCGHFKDTADKLHRBXRGNELL2BL7BGKY4KCMTGKMQ, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.608307774 (13h18m47.833490851s) [noise=true , address=104.36.82.23:4470 , piece_id=EZ3HRRIU7W5WU6TJEIMMDV4W56BPSPQ4X26AI5DU72ZRKKHQZRYA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.691988392 (13h18m47.917171449s) [upload=11683]: Next returned nil segment Aug 26 05:22:32.691999162 (13h18m47.917182219s) [upload=11683]: Waiting for error group managing segments... Aug 26 05:22:32.699693495 (13h18m47.924876552s) [noise=true , address=79.127.219.47:4065 , piece_id=AMPXWWP2X26KCGGSJT5XIIV7S2ZQCSBPMCRSUYRKLLUU5YJYNJLA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.700617159 (13h18m47.925800216s) [noise=true , address=79.127.219.48:4104 , piece_id=HV264WUAQQURRN27GOZGE7UAFDAXSEBA6MH7PA72IVB2UPAKAMPA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.701137898 (13h18m47.926320955s) [noise=true , address=45.91.116.10:4090 , piece_id=GCTDOJWW73RBYVLSGO7JYNJJOGIKALYZOJCULQRRJAIB5PYUODDA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.701200094 (13h18m47.926383141s) [noise=true , address=45.91.116.8:4056 , piece_id=RL7KICVBDUYFR2WGZFV55MPEIGNY5JNV2YGMMXBAV23VSOYFP5BA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.701597160 (13h18m47.926780207s) [noise=true , address=77.90.31.14:4676 , piece_id=PIMLYBVKLMHO2NDPLZ6TR6XATDIHLKLZNRROQW4LX5ZOKKOXUC4A, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.701717084 (13h18m47.926900142s) [noise=true , address=77.90.31.12:4605 , piece_id=5N6WPRDM5FGLSPCGHFKDTADKLHRBXRGNELL2BL7BGKY4KCMTGKMQ, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.701967515 (13h18m47.927150572s) [noise=true , address=45.91.116.7:4025 , piece_id=SQM2OZOZYIXTD2NZKVDEH5DT3TGTVQC3MMR6B2NSRSZC3LCG3VQQ, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.702309588 (13h18m47.927492645s) [noise=true , address=77.90.31.15:4701 , piece_id=MWY66KUMVLCQMCTJSBF6PUTPL5A2AIL55GPKAZABAZYELEX3Z52A, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.702425255 (13h18m47.927608312s) [noise=true , address=77.90.31.10:4536 , piece_id=RLSTCB3DRLXIM6BS7HNFIASJYJQLV4C4VH26WWO7APNIBA743UWA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.702872827 (13h18m47.928055873s) [noise=true , address=104.36.82.60:4338 , piece_id=7RYWCNBREFMCJAY2OKVONQLZOM7ZGISW7W4G7UIJ2RS4URUCDGIA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.705698062 (13h18m47.930881119s) [noise=true , address=104.36.82.53:4147 , piece_id=6SZ5LYDXM7QREG5466AAYCCX2FJTPVB6AVLU7L536OVEAAERRT2Q, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.722366000 (13h18m47.947549057s) [noise=true , address=104.36.82.10:4085 , piece_id=SRFGVCOSJBC6GVWW7L3YEAIFKAW3RJJQO4LCHQ6UZIXXUES3PJ6Q, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.729280427 (13h18m47.954463474s) [noise=true , address=104.36.82.23:4470 , piece_id=EZ3HRRIU7W5WU6TJEIMMDV4W56BPSPQ4X26AI5DU72ZRKKHQZRYA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.741223921 (13h18m47.966406968s) [noise=true , address=77.90.31.18:4814 , piece_id=GJQEUMHDADXZHO3YSZX5ITUQFSJQXUAAORPNBLAJZK3WRSJG4WHQ, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.741231004 (13h18m47.966414052s) [seg_pos={0 0}, upload=11683]: Segment reached optimal threshold of 14 pieces. Aug 26 05:22:32.741460224 (13h18m47.966643271s) [noise=true , address=104.36.82.5:4851 , piece_id=XDD3DWFRLI5374XNSXIEALKIAABOOY6NLA7XRVHRBNMQF5GABMHA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fTtTieEUquaKNUNzqK98PkX7tVxjsiNeMLjz8kQJwdLne7d9R): protocol: expected piece hash; context canceled; EOF Aug 26 05:22:32.741510720 (13h18m47.966693777s) [noise=true , address=79.127.201.215:4348 , piece_id=2NC6IN6DCEUBKUWP5P6BLTUILQUYH7OKFBLGUPNIANFDPS3AASXA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: context canceled Aug 26 05:22:32.741626567 (13h18m47.966809614s) [noise=true , address=79.127.205.246:4268 , piece_id=QOTALM2EQDO4WOEEA2HTKMMFBUBFAPQ4IWJXP7OCMMWEN7JUHGJA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k72iHWdcnM2JKs7VPTQFQwmpQ835HmAP8KpXxjMbEy5QxfzG): protocol: read tcp 5.161.89.252:20776->79.127.205.246:4268: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 26 05:22:32.741637688 (13h18m47.966820735s) [noise=true , address=64.49.13.154:4934 , piece_id=MZ2CATHR2J7MEW3ZVCBA5Q7SR7JN2M3MKXJ2ACQMQHMPXYOJRXWQ, seg_pos={0 0}, upload=11683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: read tcp 5.161.89.252:30556->64.49.13.154:4934: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 26 05:22:32.741659869 (13h18m47.966842926s) [seg_pos={0 0}, upload=11683]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 26 05:22:32.741708741 (13h18m47.966891789s) [upload=11683]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:22:32.741712488 (13h18m47.966895545s) [upload=11683]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:23:03.030254989 (13h19m18.255438035s) [upload=11683]: Done uploading segments... Aug 26 05:23:03.030281389 (13h19m18.255464436s) [upload=11683]: Upload finished. err: metaclient: context deadline exceeded Duration: 12.205254257s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 5 out of 60 is failed (threshold=6) [.........................X...............X..X....X....X.....] duration: 149.875008ms remote: "tcp:136.0.77.2:443" response headers: Access-Control-Allow-Methods=GET, HEAD Access-Control-Allow-Origin=* X-Request-Id=9LMxmq1gtt2 Date=Tue, 26 Aug 2025 05:20:20 GMT Accept-Ranges=bytes Access-Control-Allow-Headers=* Content-Type=text/html; charset=utf-8 target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt FAIL (2025-08-26 05:23:44 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error \| Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error \| Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error \| Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY" Duration: 149.893363ms edge linksharing bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 11 out of 60 is failed (threshold=3) [......................XX.......X..........XX.X.X.XX....X..X.] duration: 4.859032923s FAIL (2025-08-26 05:23:43 UTC) operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 26 05:22:24.933708597 (13h18m40.158891675s) [upload=11689]: Starting upload Aug 26 05:22:24.933811441 (13h18m40.158994518s) [upload=11689]: Done starting upload Aug 26 05:22:24.933882795 (13h18m40.159065873s) [upload=11689]: Uploading segments... Aug 26 05:22:24.933924644 (13h18m40.159107731s) [upload=11689]: Got next segment. Inline: true Aug 26 05:22:24.933930565 (13h18m40.159113642s) [upload=11689]: Waiting for error group managing segments... Aug 26 05:22:24.933975670 (13h18m40.159158747s) [upload=11689]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:22:24.933981069 (13h18m40.159164147s) [upload=11689]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:22:24.933984546 (13h18m40.159167624s) [upload=11689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:22:54.919523652 (13h19m10.144706699s) [upload=11689]: Done uploading segments... Aug 26 05:22:54.919539953 (13h19m10.144722999s) [upload=11689]: Upload finished. err: metaclient: context deadline exceeded Duration:* 4.859059253s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [..........................................X.X..X............] duration: 25.184523581s FAIL (2025-08-26 05:23:39 UTC) orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 185F3927EAB52717, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled) Duration: 25.184567655s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [.....................X..................XXX....XXX......X...] duration: 3.468800413s FAIL (2025-08-26 05:23:36 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.468822636s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 12 out of 60 is failed (threshold=3) [.......................X....XX.........XX.XX..XXX....XX.....] duration: 3.885066378s FAIL (2025-08-26 05:23:31 UTC) orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 185F39844D3D72D8, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled) Duration: 3.885084643s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 3 out of 60 is failed (threshold=3) [................................X..........X....X...........] duration: 2.842629173s remote: "tcp:136.0.77.2:443" response headers: X-Request-Id=VcCcTMkH9av Content-Length=423 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=185F392FFCED1105 X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:14:18 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-26 05:23:27 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F392FFCED1105</RequestId><HostId></HostId></Error>" Duration: 2.842657717s edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 5 out of 60 is failed (threshold=3) [............................................X.X..XX.....X...] duration: 32.228381173s FAIL (2025-08-26 05:23:23 UTC) operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:19:33.789655908 (13h15m49.014838985s) [upload=11650]: Starting upload Aug 26 05:19:33.789738403 (13h15m49.01492148s) [upload=11650]: Done starting upload Aug 26 05:19:33.789799137 (13h15m49.014982224s) [upload=11650]: Uploading segments... Aug 26 05:19:33.789882654 (13h15m49.01506573s) [upload=11650]: Got next segment. Inline: true Aug 26 05:19:33.789891009 (13h15m49.015074086s) [upload=11650]: Waiting for error group managing segments... Aug 26 05:19:33.789942085 (13h15m49.015125162s) [upload=11650]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:19:33.789947546 (13h15m49.015130624s) [upload=11650]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:19:33.789951443 (13h15m49.015134521s) [upload=11650]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:19:37.763117992 (13h15m52.988301059s) [upload=11650]: Done uploading segments... Aug 26 05:19:37.763136176 (13h15m52.988319243s) [upload=11650]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration:* 32.228399047s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 8 out of 60 is failed (threshold=3) [.................................X........XX.X.X.X.....X..X.] duration: 19.028990312s FAIL (2025-08-26 05:23:22 UTC) operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== (13h18m10.903192629s) [upload=11683]: Uploading segments... Aug 26 05:21:55.678233874 (13h18m10.903416931s) [upload=11683]: Got next segment. Inline: false Aug 26 05:21:55.678260154 (13h18m10.903443211s) [upload=11683]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:21:55.678264411 (13h18m10.903447459s) [upload=11683]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:22:32.600325641 (13h18m47.825508709s) [seg_pos={0 0}, upload=11683]: Begin upload segment... Aug 26 05:22:32.600393179 (13h18m47.825576255s) [seg_pos={0 0}, upload=11683]: Done begin upload segment. Aug 26 05:22:32.600435157 (13h18m47.825618234s) [noise=true , address=77.90.31.10:4536 , piece_id=RLSTCB3DRLXIM6BS7HNFIASJYJQLV4C4VH26WWO7APNIBA743UWA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.600452519 (13h18m47.825635597s) [noise=true , address=77.90.31.14:4676 , piece_id=PIMLYBVKLMHO2NDPLZ6TR6XATDIHLKLZNRROQW4LX5ZOKKOXUC4A, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.601074888 (13h18m47.826257966s) [noise=true , address=64.49.13.154:4934 , piece_id=MZ2CATHR2J7MEW3ZVCBA5Q7SR7JN2M3MKXJ2ACQMQHMPXYOJRXWQ, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.601112790 (13h18m47.826295867s) [noise=true , address=45.91.116.10:4090 , piece_id=GCTDOJWW73RBYVLSGO7JYNJJOGIKALYZOJCULQRRJAIB5PYUODDA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.601653837 (13h18m47.826836904s) [noise=true , address=45.91.116.7:4025 , piece_id=SQM2OZOZYIXTD2NZKVDEH5DT3TGTVQC3MMR6B2NSRSZC3LCG3VQQ, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.602360183 (13h18m47.827543251s) [noise=true , address=79.127.205.246:4268 , piece_id=QOTALM2EQDO4WOEEA2HTKMMFBUBFAPQ4IWJXP7OCMMWEN7JUHGJA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.602820207 (13h18m47.828003284s) [noise=true , address=79.127.201.215:4348 , piece_id=2NC6IN6DCEUBKUWP5P6BLTUILQUYH7OKFBLGUPNIANFDPS3AASXA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.603293896 (13h18m47.828476974s) [noise=true , address=104.36.82.60:4338 , piece_id=7RYWCNBREFMCJAY2OKVONQLZOM7ZGISW7W4G7UIJ2RS4URUCDGIA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.603762638 (13h18m47.828945714s) [noise=true , address=104.36.82.53:4147 , piece_id=6SZ5LYDXM7QREG5466AAYCCX2FJTPVB6AVLU7L536OVEAAERRT2Q, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.604257226 (13h18m47.829440304s) [noise=true , address=79.127.219.47:4065 , piece_id=AMPXWWP2X26KCGGSJT5XIIV7S2ZQCSBPMCRSUYRKLLUU5YJYNJLA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.604687584 (13h18m47.829870662s) [noise=true , address=79.127.219.48:4104 , piece_id=HV264WUAQQURRN27GOZGE7UAFDAXSEBA6MH7PA72IVB2UPAKAMPA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.605131769 (13h18m47.830314845s) [noise=true , address=77.90.31.15:4701 , piece_id=MWY66KUMVLCQMCTJSBF6PUTPL5A2AIL55GPKAZABAZYELEX3Z52A, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.605618583 (13h18m47.830801691s) [noise=true , address=104.36.82.10:4085 , piece_id=SRFGVCOSJBC6GVWW7L3YEAIFKAW3RJJQO4LCHQ6UZIXXUES3PJ6Q, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.606201718 (13h18m47.831384795s) [noise=true , address=104.36.82.5:4851 , piece_id=XDD3DWFRLI5374XNSXIEALKIAABOOY6NLA7XRVHRBNMQF5GABMHA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.606759907 (13h18m47.831942984s) [noise=true , address=77.90.31.18:4814 , piece_id=GJQEUMHDADXZHO3YSZX5ITUQFSJQXUAAORPNBLAJZK3WRSJG4WHQ, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.607244707 (13h18m47.832427785s) [noise=true , address=45.91.116.8:4056 , piece_id=RL7KICVBDUYFR2WGZFV55MPEIGNY5JNV2YGMMXBAV23VSOYFP5BA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.607719629 (13h18m47.832902766s) [noise=true , address=77.90.31.12:4605 , piece_id=5N6WPRDM5FGLSPCGHFKDTADKLHRBXRGNELL2BL7BGKY4KCMTGKMQ, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.608307774 (13h18m47.833490851s) [noise=true , address=104.36.82.23:4470 , piece_id=EZ3HRRIU7W5WU6TJEIMMDV4W56BPSPQ4X26AI5DU72ZRKKHQZRYA, seg_pos={0 0}, upload=11683]: Uploading piece... Aug 26 05:22:32.691988392 (13h18m47.917171449s) [upload=11683]: Next returned nil segment Aug 26 05:22:32.691999162 (13h18m47.917182219s) [upload=11683]: Waiting for error group managing segments... Aug 26 05:22:32.699693495 (13h18m47.924876552s) [noise=true , address=79.127.219.47:4065 , piece_id=AMPXWWP2X26KCGGSJT5XIIV7S2ZQCSBPMCRSUYRKLLUU5YJYNJLA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.700617159 (13h18m47.925800216s) [noise=true , address=79.127.219.48:4104 , piece_id=HV264WUAQQURRN27GOZGE7UAFDAXSEBA6MH7PA72IVB2UPAKAMPA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.701137898 (13h18m47.926320955s) [noise=true , address=45.91.116.10:4090 , piece_id=GCTDOJWW73RBYVLSGO7JYNJJOGIKALYZOJCULQRRJAIB5PYUODDA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.701200094 (13h18m47.926383141s) [noise=true , address=45.91.116.8:4056 , piece_id=RL7KICVBDUYFR2WGZFV55MPEIGNY5JNV2YGMMXBAV23VSOYFP5BA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.701597160 (13h18m47.926780207s) [noise=true , address=77.90.31.14:4676 , piece_id=PIMLYBVKLMHO2NDPLZ6TR6XATDIHLKLZNRROQW4LX5ZOKKOXUC4A, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.701717084 (13h18m47.926900142s) [noise=true , address=77.90.31.12:4605 , piece_id=5N6WPRDM5FGLSPCGHFKDTADKLHRBXRGNELL2BL7BGKY4KCMTGKMQ, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.701967515 (13h18m47.927150572s) [noise=true , address=45.91.116.7:4025 , piece_id=SQM2OZOZYIXTD2NZKVDEH5DT3TGTVQC3MMR6B2NSRSZC3LCG3VQQ, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.702309588 (13h18m47.927492645s) [noise=true , address=77.90.31.15:4701 , piece_id=MWY66KUMVLCQMCTJSBF6PUTPL5A2AIL55GPKAZABAZYELEX3Z52A, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.702425255 (13h18m47.927608312s) [noise=true , address=77.90.31.10:4536 , piece_id=RLSTCB3DRLXIM6BS7HNFIASJYJQLV4C4VH26WWO7APNIBA743UWA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.702872827 (13h18m47.928055873s) [noise=true , address=104.36.82.60:4338 , piece_id=7RYWCNBREFMCJAY2OKVONQLZOM7ZGISW7W4G7UIJ2RS4URUCDGIA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.705698062 (13h18m47.930881119s) [noise=true , address=104.36.82.53:4147 , piece_id=6SZ5LYDXM7QREG5466AAYCCX2FJTPVB6AVLU7L536OVEAAERRT2Q, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.722366000 (13h18m47.947549057s) [noise=true , address=104.36.82.10:4085 , piece_id=SRFGVCOSJBC6GVWW7L3YEAIFKAW3RJJQO4LCHQ6UZIXXUES3PJ6Q, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.729280427 (13h18m47.954463474s) [noise=true , address=104.36.82.23:4470 , piece_id=EZ3HRRIU7W5WU6TJEIMMDV4W56BPSPQ4X26AI5DU72ZRKKHQZRYA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.741223921 (13h18m47.966406968s) [noise=true , address=77.90.31.18:4814 , piece_id=GJQEUMHDADXZHO3YSZX5ITUQFSJQXUAAORPNBLAJZK3WRSJG4WHQ, seg_pos={0 0}, upload=11683]: Done uploading piece. err: <nil> Aug 26 05:22:32.741231004 (13h18m47.966414052s) [seg_pos={0 0}, upload=11683]: Segment reached optimal threshold of 14 pieces. Aug 26 05:22:32.741460224 (13h18m47.966643271s) [noise=true , address=104.36.82.5:4851 , piece_id=XDD3DWFRLI5374XNSXIEALKIAABOOY6NLA7XRVHRBNMQF5GABMHA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fTtTieEUquaKNUNzqK98PkX7tVxjsiNeMLjz8kQJwdLne7d9R): protocol: expected piece hash; context canceled; EOF Aug 26 05:22:32.741510720 (13h18m47.966693777s) [noise=true , address=79.127.201.215:4348 , piece_id=2NC6IN6DCEUBKUWP5P6BLTUILQUYH7OKFBLGUPNIANFDPS3AASXA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: context canceled Aug 26 05:22:32.741626567 (13h18m47.966809614s) [noise=true , address=79.127.205.246:4268 , piece_id=QOTALM2EQDO4WOEEA2HTKMMFBUBFAPQ4IWJXP7OCMMWEN7JUHGJA, seg_pos={0 0}, upload=11683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k72iHWdcnM2JKs7VPTQFQwmpQ835HmAP8KpXxjMbEy5QxfzG): protocol: read tcp 5.161.89.252:20776->79.127.205.246:4268: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 26 05:22:32.741637688 (13h18m47.966820735s) [noise=true , address=64.49.13.154:4934 , piece_id=MZ2CATHR2J7MEW3ZVCBA5Q7SR7JN2M3MKXJ2ACQMQHMPXYOJRXWQ, seg_pos={0 0}, upload=11683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: read tcp 5.161.89.252:30556->64.49.13.154:4934: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 26 05:22:32.741659869 (13h18m47.966842926s) [seg_pos={0 0}, upload=11683]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 26 05:22:32.741708741 (13h18m47.966891789s) [upload=11683]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:22:32.741712488 (13h18m47.966895545s) [upload=11683]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:23:03.030254989 (13h19m18.255438035s) [upload=11683]: Done uploading segments... Aug 26 05:23:03.030281389 (13h19m18.255464436s) [upload=11683]: Upload finished. err: metaclient: context deadline exceeded Duration: 19.029007103s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 17 out of 60 is failed (threshold=3) [.................XX.......X..X.......XXXXXXXX.XX.......X..XX] duration: 30.007234196s FAIL (2025-08-26 05:23:21 UTC) operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 30.007247901s core uplink us1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)