Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....X.........................X.......X.....................] duration: 712.560051ms FAIL (2025-08-13 19:22:56 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments... Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment... Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment. Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments... Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces. Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments... Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil> Duration: 712.584177ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....X.........................X.......X....................] duration: 736.019217ms FAIL (2025-08-13 19:21:58 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments... Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment... Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment. Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments... Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces. Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments... Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil> Duration: 736.046399ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [X........................X..................................] duration: 183.625219ms FAIL (2025-08-13 19:21:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests Duration:* 183.660906ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.X........................X.................................] duration: 320.49461ms FAIL (2025-08-13 19:21:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests Duration:* 320.521249ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......X.........................X.......X...................] duration: 771.031834ms FAIL (2025-08-13 19:20:46 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments... Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment... Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment. Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments... Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces. Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments... Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil> Duration: 771.057842ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..X........................X................................] duration: 201.17576ms FAIL (2025-08-13 19:20:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests Duration:* 201.200035ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......X.........................X.......X..................] duration: 642.334415ms FAIL (2025-08-13 19:20:25 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments... Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment... Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment. Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments... Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces. Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments... Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil> Duration: 642.36376ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........X.........................X.......X.................] duration: 1.683365462s FAIL (2025-08-13 19:20:06 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments... Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment... Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment. Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments... Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces. Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments... Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil> Duration: 1.683455941s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........X.........................X.......X................] duration: 432.509468ms FAIL (2025-08-13 19:19:46 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments... Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment... Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment. Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments... Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces. Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments... Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil> Duration: 432.527472ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...X........................X...............................] duration: 245.390802ms FAIL (2025-08-13 19:19:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests Duration:* 245.417891ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..........X.........................X.......X...............] duration: 607.296753ms FAIL (2025-08-13 19:19:15 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments... Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment... Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment. Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments... Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces. Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments... Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil> Duration: 607.318994ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [....X........................X..............................] duration: 149.834081ms FAIL (2025-08-13 19:18:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests Duration:* 149.857674ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...........X.........................X.......X..............] duration: 429.335852ms FAIL (2025-08-13 19:18:29 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments... Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment... Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment. Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments... Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces. Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments... Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil> Duration: 429.359878ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....X........................X.............................] duration: 263.609289ms FAIL (2025-08-13 19:18:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests Duration:* 263.638244ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [............X.........................X.......X.............] duration: 490.613761ms FAIL (2025-08-13 19:18:02 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments... Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment... Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment. Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments... Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces. Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments... Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil> Duration: 490.636844ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.............X.........................X.......X............] duration: 460.079602ms FAIL (2025-08-13 19:17:23 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments... Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment... Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment. Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments... Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces. Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments... Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil> Duration: 460.103057ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [......X........................X............................] duration: 286.956445ms FAIL (2025-08-13 19:17:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests Duration:* 286.982604ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [X......X........................X...........................] duration: 191.878772ms FAIL (2025-08-13 19:16:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests Duration:* 191.907887ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..............X.........................X.......X...........] duration: 418.459759ms FAIL (2025-08-13 19:16:19 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments... Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment... Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment. Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments... Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces. Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments... Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil> Duration: 418.479386ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.X......X........................X..........................] duration: 404.564732ms FAIL (2025-08-13 19:15:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests Duration:* 404.585852ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...............X.........................X.......X..........] duration: 427.336314ms FAIL (2025-08-13 19:15:49 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments... Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment... Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment. Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments... Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces. Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments... Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil> Duration: 427.360891ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [................X.........................X.......X.........] duration: 489.307662ms FAIL (2025-08-13 19:15:14 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments... Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment... Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment. Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments... Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces. Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments... Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil> Duration: 489.3327ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..X......X........................X.........................] duration: 172.192303ms FAIL (2025-08-13 19:15:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests Duration:* 172.219163ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.................X.........................X.......X........] duration: 365.556205ms FAIL (2025-08-13 19:14:32 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments... Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment... Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment. Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments... Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces. Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments... Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil> Duration: 365.588475ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...X......X........................X........................] duration: 181.535046ms FAIL (2025-08-13 19:13:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests Duration:* 181.549684ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..................X.........................X.......X.......] duration: 834.631132ms FAIL (2025-08-13 19:13:46 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments... Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment... Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment. Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments... Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces. Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments... Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil> Duration: 834.651911ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [....X......X........................X.......................] duration: 447.690691ms FAIL (2025-08-13 19:13:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests Duration:* 447.718965ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...................X.........................X.......X......] duration: 539.746507ms FAIL (2025-08-13 19:13:13 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments... Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment... Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment. Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments... Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces. Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments... Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil> Duration: 539.837249ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....................X.........................X.......X.....] duration: 518.292163ms FAIL (2025-08-13 19:12:34 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments... Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment... Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment. Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments... Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces. Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments... Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil> Duration: 518.32844ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....X......X........................X......................] duration: 372.941229ms FAIL (2025-08-13 19:12:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests Duration:* 372.964252ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....................X.........................X.......X....] duration: 521.003274ms FAIL (2025-08-13 19:11:32 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments... Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment... Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment. Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments... Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces. Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments... Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil> Duration: 521.030446ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......................X.........................X.......X...] duration: 430.653034ms FAIL (2025-08-13 19:11:14 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments... Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment... Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment. Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments... Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces. Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments... Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil> Duration: 430.677319ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [......X......X........................X.....................] duration: 166.216514ms FAIL (2025-08-13 19:11:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests Duration:* 166.278821ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.......X......X........................X....................] duration: 211.647325ms FAIL (2025-08-13 19:10:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests Duration:* 211.669718ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [........X......X........................X...................] duration: 182.899503ms FAIL (2025-08-13 19:10:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests Duration:* 182.918688ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......................X.........................X.......X..] duration: 717.360206ms FAIL (2025-08-13 19:10:06 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments... Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment... Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment. Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments... Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces. Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments... Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil> Duration: 717.381618ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.........X......X........................X..................] duration: 338.990369ms FAIL (2025-08-13 19:09:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests Duration:* 339.01228ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........................X.........................X.......X.] duration: 464.272181ms FAIL (2025-08-13 19:09:16 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments... Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment... Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment. Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments... Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces. Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments... Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil> Duration: 464.295083ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..........X......X........................X.................] duration: 178.355313ms FAIL (2025-08-13 19:08:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests Duration:* 178.382334ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........................X.........................X.......X] duration: 864.680985ms FAIL (2025-08-13 19:08:21 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 19:08:20.572767219 (121h42m1.304034869s) [upload=126718]: Starting upload Aug 13 19:08:20.572840447 (121h42m1.304108097s) [upload=126718]: Done starting upload Aug 13 19:08:20.572952778 (121h42m1.304220427s) [upload=126718]: Uploading segments... Aug 13 19:08:20.573276887 (121h42m1.304544547s) [upload=126718]: Got next segment. Inline: false Aug 13 19:08:20.573342571 (121h42m1.304610222s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 19:08:20.573351448 (121h42m1.304619119s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 19:08:20.613293228 (121h42m1.344560888s) [seg_pos={0 0}, upload=126718]: Begin upload segment... Aug 13 19:08:20.613362899 (121h42m1.344630549s) [seg_pos={0 0}, upload=126718]: Done begin upload segment. Aug 13 19:08:20.613395610 (121h42m1.34466326s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613479168 (121h42m1.344746828s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613933462 (121h42m1.345201122s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.613966173 (121h42m1.345233824s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614473598 (121h42m1.345741248s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614513222 (121h42m1.345780882s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.614845417 (121h42m1.346113078s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615068767 (121h42m1.346336418s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615223789 (121h42m1.346491439s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615618681 (121h42m1.346886332s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.615644741 (121h42m1.346912401s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616154590 (121h42m1.34742224s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616169798 (121h42m1.347437449s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616718090 (121h42m1.347985739s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.616748518 (121h42m1.348016167s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.617120096 (121h42m1.348387746s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622023970 (121h42m1.353291681s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.622840135 (121h42m1.354107785s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Uploading piece... Aug 13 19:08:20.727179166 (121h42m1.458446786s) [upload=126718]: Next returned nil segment Aug 13 19:08:20.727279234 (121h42m1.458546864s) [upload=126718]: Waiting for error group managing segments... Aug 13 19:08:20.740817168 (121h42m1.472084789s) [noise=true , address=104.36.82.2:4748 , piece_id=OM2WUXDAN2FD4JLKQXVXKKTJ4BEIORTJK2ESESBSFFICSMPK3OIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741709907 (121h42m1.472977537s) [noise=true , address=104.36.82.39:4738 , piece_id=JVBGF7EWTKG7UJNHWOFQGKRZM6KZFDRG26QHWTFUROHSDN7YRMWQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.741976870 (121h42m1.4732445s) [noise=true , address=104.36.82.4:4822 , piece_id=CERZXPWJV34UJS5BPWZ4ELOT5JKDG5Q2M74WAQS6QYLDI3TEP6JA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.748823638 (121h42m1.480091268s) [noise=true , address=104.36.82.19:4434 , piece_id=7C7ICEZLJLXPLU65YHIBX6NMD6PNPM4X3NSNZM6CC6JGJEH2CZMA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.750729704 (121h42m1.481997324s) [noise=true , address=104.36.82.35:4585 , piece_id=HW2357J3QZ3YICLARU2VFKSZLG2YMKKKYIDBWNC5MFEZFWEJ3WIQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.751278897 (121h42m1.482546527s) [noise=true , address=104.36.82.20:4470 , piece_id=UF2IY6NHR2EAP45DBTEJWLWNYRCNUEVHE4YA5D2DHFBGDRARLVXQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.763551371 (121h42m1.494819001s) [noise=true , address=104.36.82.5:4872 , piece_id=XYC7VDDTO7DBULMXCROJKFRYHRFOFZZFVIZAEASGX3QEBDZJNZTA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.768221566 (121h42m1.499489196s) [noise=true , address=104.36.82.41:4785 , piece_id=XSQDURZJBFYYLX7TLSBKFORVUNCE3PU5JY3MN2LNN27CHX4NWGKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769131177 (121h42m1.500398808s) [noise=true , address=104.36.82.58:4286 , piece_id=73A4J2W2IFSLT2JI2KPRESN3JHZ6XVBI7VWJEHJIB43PU2XY3M6A, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.769654381 (121h42m1.500922002s) [noise=true , address=77.90.31.15:4728 , piece_id=3KMYHZHS5RLOI2ULXHMKMSORKBTH3P336B4H56CZSQEA2RYORNEQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:20.770436272 (121h42m1.501703892s) [noise=true , address=77.90.31.10:4523 , piece_id=RV2URRDNTCMX3BJ77XA6DOW7KIS44GI5BE7CYTSGKPEFMTISHSOQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.126424712 (121h42m1.857692362s) [noise=true , address=79.127.205.245:4234 , piece_id=OWNMZJ2YPNBQQ5CMHNAADBETMMCSP7WFS6NRNWMBYHKVYPEQOQTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.134590111 (121h42m1.865857762s) [noise=true , address=79.127.201.215:4347 , piece_id=LAAUJHHEM2VU4Z6YMEXCRY2AUWHE2ZR5T4G2RVQSVPBUJ3M6ONVA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150885924 (121h42m1.882153574s) [noise=true , address=104.36.82.47:4527 , piece_id=ZWFORB6AEWRNMJ7JDNJZW5E4D4NUDKQTA7ZIQKVB2O6HU2MNOVKA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: <nil> Aug 13 19:08:21.150912293 (121h42m1.882179944s) [seg_pos={0 0}, upload=126718]: Segment reached optimal threshold of 14 pieces. Aug 13 19:08:21.151075060 (121h42m1.88234271s) [noise=true , address=64.49.13.26:4946 , piece_id=32EYWMIQG6LIXIR67UBMD4J3YWK6BMNZ4OOUAU73V7VQW4MC3NIA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151110567 (121h42m1.882378216s) [noise=true , address=64.49.13.154:4926 , piece_id=PML6XWXIUMDZWVWSDWR7CMAFUJM75JPOJXV6RLAIHVD6YGCDLYTQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151167683 (121h42m1.882435334s) [noise=true , address=193.149.164.143:4700 , piece_id=XIU5AHDRELEPTWTILWIIF6WJ72R4RTXZNVEC4SE3PKV7665U26HQ, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tnTEYvqJ6PB2DsuXA28sEuEiGj11StA4qdhcYH1kuoaMkTVdY): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151282079 (121h42m1.882549729s) [noise=true , address=64.49.13.27:4960 , piece_id=JOTIMX5W3NC3MB7ZSJEG3XZWW22VD4DWMM2KQ42TWRDSWYRTT5BA, seg_pos={0 0}, upload=126718]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: expected piece hash; context canceled; EOF Aug 13 19:08:21.151301135 (121h42m1.882568775s) [seg_pos={0 0}, upload=126718]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 19:08:21.151371136 (121h42m1.882638776s) [upload=126718]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 19:08:21.151376356 (121h42m1.882644006s) [upload=126718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 19:08:21.328511696 (121h42m2.059779306s) [upload=126718]: Done uploading segments... Aug 13 19:08:21.328527987 (121h42m2.059795618s) [upload=126718]: Upload finished. err: <nil> Duration: 864.70421ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...........X......X........................X................] duration: 167.675518ms FAIL (2025-08-13 19:07:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests Duration:* 167.702047ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................X.........................X.......] duration: 427.660194ms FAIL (2025-08-13 19:07:34 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 19:00:45.896427783 (121h34m26.627695434s) [upload=126586]: Starting upload Aug 13 19:00:45.896515508 (121h34m26.627783158s) [upload=126586]: Done starting upload Aug 13 19:00:45.896609275 (121h34m26.627876925s) [upload=126586]: Uploading segments... Aug 13 19:00:45.896962429 (121h34m26.628230079s) [upload=126586]: Got next segment. Inline: false Aug 13 19:00:45.897056496 (121h34m26.628324216s) [upload=126586]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 19:00:45.897065923 (121h34m26.628333573s) [upload=126586]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 19:00:45.929375116 (121h34m26.660642776s) [seg_pos={0 0}, upload=126586]: Begin upload segment... Aug 13 19:00:45.930855281 (121h34m26.662122942s) [seg_pos={0 0}, upload=126586]: Done begin upload segment. Aug 13 19:00:45.930920724 (121h34m26.662188384s) [noise=true , address=66.23.193.175:4554 , piece_id=666XPJASF2WTWY3K6AHSYNKCTJIQ6BJTR6BC5SLDSW7THR2F67KA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.932026053 (121h34m26.663293703s) [noise=true , address=104.36.82.60:4351 , piece_id=2VU4ET3DMMY5NCEV7SFBBUNW2RAPFUYVSGLVRJGUPEGAQW6CQXIA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.932580125 (121h34m26.663847775s) [noise=true , address=79.127.201.215:4352 , piece_id=F3HJ3OFE345OS33RM5IVHSQ4T7XM7AD5E4L5K2HOHQDKSOR2NYWQ, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.933085436 (121h34m26.664353096s) [noise=true , address=45.91.116.6:4994 , piece_id=HYIPQESICOS235TLD7LPN7EIAEDERU6ZEUZMA6H4Z526HLB7HGRA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.933560479 (121h34m26.664828129s) [noise=true , address=104.36.82.13:4218 , piece_id=7Y76IWSWV7B75AE53AIIDW5ZMZBLSADPNZAK4EWZMVP75OGVBHDA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.933930936 (121h34m26.665198586s) [noise=true , address=104.36.82.36:4623 , piece_id=SGRDUUDKT76BKQMHD42QQWUGF7R4YS4LP7C4QAHICB2LMZKDKZIA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.934398065 (121h34m26.665665725s) [noise=true , address=104.36.82.35:4585 , piece_id=OGLKDWVLZJW5I7BTPBDALTFW6KEAUL5YHAI7KLSZRECEAAOTJXVQ, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.934962576 (121h34m26.666230237s) [noise=true , address=79.127.220.101:4060 , piece_id=X76XJ5MSNAUWWQYLIHTWU5SCF7AYMT2DEORIMAZ64RNVFHV4X4IQ, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.935571281 (121h34m26.666838932s) [noise=true , address=104.36.82.59:4304 , piece_id=F775QQYHZF2L5Z4GNXFDWPKSZXZ2GVD7LKR7AXQCT3LKUSPKM2SA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.941244673 (121h34m26.672512304s) [noise=true , address=104.36.82.23:4451 , piece_id=472EEST73KBBWBPSNEWTPRHPKRE62H6C5IEWGGATZC2YSMLSWUOQ, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.941585945 (121h34m26.672853565s) [noise=true , address=104.36.82.19:4434 , piece_id=MACD6KBTPEM73TW665UZJGBWLRYMUMDUHAA43NR4Y6PL6XCD7IPA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.941814365 (121h34m26.673081995s) [noise=true , address=66.23.193.175:4560 , piece_id=GFIDNYH3Y35V24K5JV752ZXLHDFUF2OX4OCA3LXYE77C7ML4N2JQ, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.942026303 (121h34m26.673293924s) [noise=true , address=104.36.82.6:4879 , piece_id=S3S2FXNJ7XQAAN4ANAXAXDQORY6VMAJXXJ652QS32W5QEX5RXARQ, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.942279560 (121h34m26.67354719s) [noise=true , address=104.36.82.47:4549 , piece_id=L5HQOCUEHCROKOWOE3QJXXAN7JW75LQQFLAJQ3CFNZ2NPIFTKWIA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.942556491 (121h34m26.673824121s) [noise=true , address=77.90.31.10:4536 , piece_id=J65MXPIO4LGRHPL5TL5OHMJE2ECHB4ZNJDOBFZXRNJSKRVJ62UWA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.942810118 (121h34m26.674077737s) [noise=true , address=104.36.82.61:4408 , piece_id=FTNNRVYGZHCMVCK4Z5QWG6ZUGASKE45KL25BGAC25V3NICE7JNJA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.943031433 (121h34m26.674299064s) [noise=true , address=104.36.82.17:4344 , piece_id=IWYP6LBK6A77M7HZHHD42O3CF37AJZU52433ADT4WU6MKKNYOG7Q, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.943311671 (121h34m26.674579292s) [noise=true , address=104.36.82.39:4745 , piece_id=TSKQALMPM7BVYVXJ6ERRG2XGNKIOO5NKT3XIMLY2NMMLYREU7DFA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:46.034419252 (121h34m26.765686882s) [upload=126586]: Next returned nil segment Aug 13 19:00:46.034433831 (121h34m26.765701461s) [upload=126586]: Waiting for error group managing segments... Aug 13 19:00:46.046381083 (121h34m26.777648703s) [noise=true , address=104.36.82.39:4745 , piece_id=TSKQALMPM7BVYVXJ6ERRG2XGNKIOO5NKT3XIMLY2NMMLYREU7DFA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.049614535 (121h34m26.780882166s) [noise=true , address=104.36.82.35:4585 , piece_id=OGLKDWVLZJW5I7BTPBDALTFW6KEAUL5YHAI7KLSZRECEAAOTJXVQ, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.057741672 (121h34m26.789009321s) [noise=true , address=104.36.82.6:4879 , piece_id=S3S2FXNJ7XQAAN4ANAXAXDQORY6VMAJXXJ652QS32W5QEX5RXARQ, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.062248469 (121h34m26.793516099s) [noise=true , address=45.91.116.6:4994 , piece_id=HYIPQESICOS235TLD7LPN7EIAEDERU6ZEUZMA6H4Z526HLB7HGRA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.065516336 (121h34m26.796783956s) [noise=true , address=104.36.82.23:4451 , piece_id=472EEST73KBBWBPSNEWTPRHPKRE62H6C5IEWGGATZC2YSMLSWUOQ, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.065845947 (121h34m26.797113577s) [noise=true , address=104.36.82.61:4408 , piece_id=FTNNRVYGZHCMVCK4Z5QWG6ZUGASKE45KL25BGAC25V3NICE7JNJA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.065971682 (121h34m26.797239332s) [noise=true , address=104.36.82.17:4344 , piece_id=IWYP6LBK6A77M7HZHHD42O3CF37AJZU52433ADT4WU6MKKNYOG7Q, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.072725256 (121h34m26.803992887s) [noise=true , address=104.36.82.36:4623 , piece_id=SGRDUUDKT76BKQMHD42QQWUGF7R4YS4LP7C4QAHICB2LMZKDKZIA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.073045047 (121h34m26.804312667s) [noise=true , address=104.36.82.13:4218 , piece_id=7Y76IWSWV7B75AE53AIIDW5ZMZBLSADPNZAK4EWZMVP75OGVBHDA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.075786824 (121h34m26.807054454s) [noise=true , address=104.36.82.19:4434 , piece_id=MACD6KBTPEM73TW665UZJGBWLRYMUMDUHAA43NR4Y6PL6XCD7IPA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.081500673 (121h34m26.812768292s) [noise=true , address=77.90.31.10:4536 , piece_id=J65MXPIO4LGRHPL5TL5OHMJE2ECHB4ZNJDOBFZXRNJSKRVJ62UWA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.113616031 (121h34m26.844883651s) [noise=true , address=79.127.220.101:4060 , piece_id=X76XJ5MSNAUWWQYLIHTWU5SCF7AYMT2DEORIMAZ64RNVFHV4X4IQ, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.185482842 (121h34m26.916750493s) [noise=true , address=104.36.82.59:4304 , piece_id=F775QQYHZF2L5Z4GNXFDWPKSZXZ2GVD7LKR7AXQCT3LKUSPKM2SA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.212513286 (121h34m26.943780936s) [noise=true , address=104.36.82.60:4351 , piece_id=2VU4ET3DMMY5NCEV7SFBBUNW2RAPFUYVSGLVRJGUPEGAQW6CQXIA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.212546929 (121h34m26.943814579s) [seg_pos={0 0}, upload=126586]: Segment reached optimal threshold of 14 pieces. Aug 13 19:00:46.212771922 (121h34m26.944039572s) [noise=true , address=79.127.201.215:4352 , piece_id=F3HJ3OFE345OS33RM5IVHSQ4T7XM7AD5E4L5K2HOHQDKSOR2NYWQ, seg_pos={0 0}, upload=126586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: expected piece hash; context canceled; EOF Aug 13 19:00:46.213155234 (121h34m26.944422884s) [noise=true , address=66.23.193.175:4560 , piece_id=GFIDNYH3Y35V24K5JV752ZXLHDFUF2OX4OCA3LXYE77C7ML4N2JQ, seg_pos={0 0}, upload=126586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JnJPYq3oApurPNBCfSqHzcEmtm4V2doRwfaPBPF3xBFtJoVny): protocol: read tcp 5.161.89.252:54574->66.23.193.175:4560: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 13 19:00:46.213249430 (121h34m26.944517081s) [noise=true , address=104.36.82.47:4549 , piece_id=L5HQOCUEHCROKOWOE3QJXXAN7JW75LQQFLAJQ3CFNZ2NPIFTKWIA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HWoyMKQ6v2XWUfEmfFh3m8AiGivAcYkkZ9na8kqHFzH2hPDeK): protocol: write tcp 5.161.89.252:15682->104.36.82.47:4549: use of closed network connection; write tcp 5.161.89.252:15682->104.36.82.47:4549: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:15682->104.36.82.47:4549: use of closed network connection Aug 13 19:00:46.213292782 (121h34m26.944560442s) [noise=true , address=66.23.193.175:4554 , piece_id=666XPJASF2WTWY3K6AHSYNKCTJIQ6BJTR6BC5SLDSW7THR2F67KA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CraGuuckkbKe5PDLUvwF5G2ATUbgdR5g192YjkZgmP3JpqgXi): protocol: read tcp 5.161.89.252:60322->66.23.193.175:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 13 19:00:46.213314012 (121h34m26.944581662s) [seg_pos={0 0}, upload=126586]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 19:00:46.213384454 (121h34m26.944652115s) [upload=126586]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 19:00:46.213390045 (121h34m26.944657695s) [upload=126586]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 19:00:46.344299064 (121h34m27.075566684s) [upload=126586]: Done uploading segments... Aug 13 19:00:46.344312700 (121h34m27.075580319s) [upload=126586]: Upload finished. err: <nil> Duration: 427.686284ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [............X......X........................X...............] duration: 190.687822ms FAIL (2025-08-13 19:07:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests Duration:* 190.70808ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........................X.........................X......] duration: 585.211073ms FAIL (2025-08-13 19:06:38 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 19:00:45.896427783 (121h34m26.627695434s) [upload=126586]: Starting upload Aug 13 19:00:45.896515508 (121h34m26.627783158s) [upload=126586]: Done starting upload Aug 13 19:00:45.896609275 (121h34m26.627876925s) [upload=126586]: Uploading segments... Aug 13 19:00:45.896962429 (121h34m26.628230079s) [upload=126586]: Got next segment. Inline: false Aug 13 19:00:45.897056496 (121h34m26.628324216s) [upload=126586]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 19:00:45.897065923 (121h34m26.628333573s) [upload=126586]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 19:00:45.929375116 (121h34m26.660642776s) [seg_pos={0 0}, upload=126586]: Begin upload segment... Aug 13 19:00:45.930855281 (121h34m26.662122942s) [seg_pos={0 0}, upload=126586]: Done begin upload segment. Aug 13 19:00:45.930920724 (121h34m26.662188384s) [noise=true , address=66.23.193.175:4554 , piece_id=666XPJASF2WTWY3K6AHSYNKCTJIQ6BJTR6BC5SLDSW7THR2F67KA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.932026053 (121h34m26.663293703s) [noise=true , address=104.36.82.60:4351 , piece_id=2VU4ET3DMMY5NCEV7SFBBUNW2RAPFUYVSGLVRJGUPEGAQW6CQXIA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.932580125 (121h34m26.663847775s) [noise=true , address=79.127.201.215:4352 , piece_id=F3HJ3OFE345OS33RM5IVHSQ4T7XM7AD5E4L5K2HOHQDKSOR2NYWQ, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.933085436 (121h34m26.664353096s) [noise=true , address=45.91.116.6:4994 , piece_id=HYIPQESICOS235TLD7LPN7EIAEDERU6ZEUZMA6H4Z526HLB7HGRA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.933560479 (121h34m26.664828129s) [noise=true , address=104.36.82.13:4218 , piece_id=7Y76IWSWV7B75AE53AIIDW5ZMZBLSADPNZAK4EWZMVP75OGVBHDA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.933930936 (121h34m26.665198586s) [noise=true , address=104.36.82.36:4623 , piece_id=SGRDUUDKT76BKQMHD42QQWUGF7R4YS4LP7C4QAHICB2LMZKDKZIA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.934398065 (121h34m26.665665725s) [noise=true , address=104.36.82.35:4585 , piece_id=OGLKDWVLZJW5I7BTPBDALTFW6KEAUL5YHAI7KLSZRECEAAOTJXVQ, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.934962576 (121h34m26.666230237s) [noise=true , address=79.127.220.101:4060 , piece_id=X76XJ5MSNAUWWQYLIHTWU5SCF7AYMT2DEORIMAZ64RNVFHV4X4IQ, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.935571281 (121h34m26.666838932s) [noise=true , address=104.36.82.59:4304 , piece_id=F775QQYHZF2L5Z4GNXFDWPKSZXZ2GVD7LKR7AXQCT3LKUSPKM2SA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.941244673 (121h34m26.672512304s) [noise=true , address=104.36.82.23:4451 , piece_id=472EEST73KBBWBPSNEWTPRHPKRE62H6C5IEWGGATZC2YSMLSWUOQ, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.941585945 (121h34m26.672853565s) [noise=true , address=104.36.82.19:4434 , piece_id=MACD6KBTPEM73TW665UZJGBWLRYMUMDUHAA43NR4Y6PL6XCD7IPA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.941814365 (121h34m26.673081995s) [noise=true , address=66.23.193.175:4560 , piece_id=GFIDNYH3Y35V24K5JV752ZXLHDFUF2OX4OCA3LXYE77C7ML4N2JQ, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.942026303 (121h34m26.673293924s) [noise=true , address=104.36.82.6:4879 , piece_id=S3S2FXNJ7XQAAN4ANAXAXDQORY6VMAJXXJ652QS32W5QEX5RXARQ, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.942279560 (121h34m26.67354719s) [noise=true , address=104.36.82.47:4549 , piece_id=L5HQOCUEHCROKOWOE3QJXXAN7JW75LQQFLAJQ3CFNZ2NPIFTKWIA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.942556491 (121h34m26.673824121s) [noise=true , address=77.90.31.10:4536 , piece_id=J65MXPIO4LGRHPL5TL5OHMJE2ECHB4ZNJDOBFZXRNJSKRVJ62UWA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.942810118 (121h34m26.674077737s) [noise=true , address=104.36.82.61:4408 , piece_id=FTNNRVYGZHCMVCK4Z5QWG6ZUGASKE45KL25BGAC25V3NICE7JNJA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.943031433 (121h34m26.674299064s) [noise=true , address=104.36.82.17:4344 , piece_id=IWYP6LBK6A77M7HZHHD42O3CF37AJZU52433ADT4WU6MKKNYOG7Q, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.943311671 (121h34m26.674579292s) [noise=true , address=104.36.82.39:4745 , piece_id=TSKQALMPM7BVYVXJ6ERRG2XGNKIOO5NKT3XIMLY2NMMLYREU7DFA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:46.034419252 (121h34m26.765686882s) [upload=126586]: Next returned nil segment Aug 13 19:00:46.034433831 (121h34m26.765701461s) [upload=126586]: Waiting for error group managing segments... Aug 13 19:00:46.046381083 (121h34m26.777648703s) [noise=true , address=104.36.82.39:4745 , piece_id=TSKQALMPM7BVYVXJ6ERRG2XGNKIOO5NKT3XIMLY2NMMLYREU7DFA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.049614535 (121h34m26.780882166s) [noise=true , address=104.36.82.35:4585 , piece_id=OGLKDWVLZJW5I7BTPBDALTFW6KEAUL5YHAI7KLSZRECEAAOTJXVQ, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.057741672 (121h34m26.789009321s) [noise=true , address=104.36.82.6:4879 , piece_id=S3S2FXNJ7XQAAN4ANAXAXDQORY6VMAJXXJ652QS32W5QEX5RXARQ, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.062248469 (121h34m26.793516099s) [noise=true , address=45.91.116.6:4994 , piece_id=HYIPQESICOS235TLD7LPN7EIAEDERU6ZEUZMA6H4Z526HLB7HGRA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.065516336 (121h34m26.796783956s) [noise=true , address=104.36.82.23:4451 , piece_id=472EEST73KBBWBPSNEWTPRHPKRE62H6C5IEWGGATZC2YSMLSWUOQ, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.065845947 (121h34m26.797113577s) [noise=true , address=104.36.82.61:4408 , piece_id=FTNNRVYGZHCMVCK4Z5QWG6ZUGASKE45KL25BGAC25V3NICE7JNJA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.065971682 (121h34m26.797239332s) [noise=true , address=104.36.82.17:4344 , piece_id=IWYP6LBK6A77M7HZHHD42O3CF37AJZU52433ADT4WU6MKKNYOG7Q, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.072725256 (121h34m26.803992887s) [noise=true , address=104.36.82.36:4623 , piece_id=SGRDUUDKT76BKQMHD42QQWUGF7R4YS4LP7C4QAHICB2LMZKDKZIA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.073045047 (121h34m26.804312667s) [noise=true , address=104.36.82.13:4218 , piece_id=7Y76IWSWV7B75AE53AIIDW5ZMZBLSADPNZAK4EWZMVP75OGVBHDA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.075786824 (121h34m26.807054454s) [noise=true , address=104.36.82.19:4434 , piece_id=MACD6KBTPEM73TW665UZJGBWLRYMUMDUHAA43NR4Y6PL6XCD7IPA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.081500673 (121h34m26.812768292s) [noise=true , address=77.90.31.10:4536 , piece_id=J65MXPIO4LGRHPL5TL5OHMJE2ECHB4ZNJDOBFZXRNJSKRVJ62UWA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.113616031 (121h34m26.844883651s) [noise=true , address=79.127.220.101:4060 , piece_id=X76XJ5MSNAUWWQYLIHTWU5SCF7AYMT2DEORIMAZ64RNVFHV4X4IQ, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.185482842 (121h34m26.916750493s) [noise=true , address=104.36.82.59:4304 , piece_id=F775QQYHZF2L5Z4GNXFDWPKSZXZ2GVD7LKR7AXQCT3LKUSPKM2SA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.212513286 (121h34m26.943780936s) [noise=true , address=104.36.82.60:4351 , piece_id=2VU4ET3DMMY5NCEV7SFBBUNW2RAPFUYVSGLVRJGUPEGAQW6CQXIA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.212546929 (121h34m26.943814579s) [seg_pos={0 0}, upload=126586]: Segment reached optimal threshold of 14 pieces. Aug 13 19:00:46.212771922 (121h34m26.944039572s) [noise=true , address=79.127.201.215:4352 , piece_id=F3HJ3OFE345OS33RM5IVHSQ4T7XM7AD5E4L5K2HOHQDKSOR2NYWQ, seg_pos={0 0}, upload=126586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: expected piece hash; context canceled; EOF Aug 13 19:00:46.213155234 (121h34m26.944422884s) [noise=true , address=66.23.193.175:4560 , piece_id=GFIDNYH3Y35V24K5JV752ZXLHDFUF2OX4OCA3LXYE77C7ML4N2JQ, seg_pos={0 0}, upload=126586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JnJPYq3oApurPNBCfSqHzcEmtm4V2doRwfaPBPF3xBFtJoVny): protocol: read tcp 5.161.89.252:54574->66.23.193.175:4560: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 13 19:00:46.213249430 (121h34m26.944517081s) [noise=true , address=104.36.82.47:4549 , piece_id=L5HQOCUEHCROKOWOE3QJXXAN7JW75LQQFLAJQ3CFNZ2NPIFTKWIA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HWoyMKQ6v2XWUfEmfFh3m8AiGivAcYkkZ9na8kqHFzH2hPDeK): protocol: write tcp 5.161.89.252:15682->104.36.82.47:4549: use of closed network connection; write tcp 5.161.89.252:15682->104.36.82.47:4549: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:15682->104.36.82.47:4549: use of closed network connection Aug 13 19:00:46.213292782 (121h34m26.944560442s) [noise=true , address=66.23.193.175:4554 , piece_id=666XPJASF2WTWY3K6AHSYNKCTJIQ6BJTR6BC5SLDSW7THR2F67KA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CraGuuckkbKe5PDLUvwF5G2ATUbgdR5g192YjkZgmP3JpqgXi): protocol: read tcp 5.161.89.252:60322->66.23.193.175:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 13 19:00:46.213314012 (121h34m26.944581662s) [seg_pos={0 0}, upload=126586]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 19:00:46.213384454 (121h34m26.944652115s) [upload=126586]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 19:00:46.213390045 (121h34m26.944657695s) [upload=126586]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 19:00:46.344299064 (121h34m27.075566684s) [upload=126586]: Done uploading segments... Aug 13 19:00:46.344312700 (121h34m27.075580319s) [upload=126586]: Upload finished. err: <nil> Duration: 585.254415ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.............X......X........................X..............] duration: 157.146904ms FAIL (2025-08-13 19:06:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests Duration:* 157.175999ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..............X......X........................X.............] duration: 312.606778ms FAIL (2025-08-13 19:05:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests Duration:* 312.628909ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [............................X.........................X.....] duration: 397.023487ms FAIL (2025-08-13 19:05:44 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 19:00:45.896427783 (121h34m26.627695434s) [upload=126586]: Starting upload Aug 13 19:00:45.896515508 (121h34m26.627783158s) [upload=126586]: Done starting upload Aug 13 19:00:45.896609275 (121h34m26.627876925s) [upload=126586]: Uploading segments... Aug 13 19:00:45.896962429 (121h34m26.628230079s) [upload=126586]: Got next segment. Inline: false Aug 13 19:00:45.897056496 (121h34m26.628324216s) [upload=126586]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 19:00:45.897065923 (121h34m26.628333573s) [upload=126586]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 19:00:45.929375116 (121h34m26.660642776s) [seg_pos={0 0}, upload=126586]: Begin upload segment... Aug 13 19:00:45.930855281 (121h34m26.662122942s) [seg_pos={0 0}, upload=126586]: Done begin upload segment. Aug 13 19:00:45.930920724 (121h34m26.662188384s) [noise=true , address=66.23.193.175:4554 , piece_id=666XPJASF2WTWY3K6AHSYNKCTJIQ6BJTR6BC5SLDSW7THR2F67KA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.932026053 (121h34m26.663293703s) [noise=true , address=104.36.82.60:4351 , piece_id=2VU4ET3DMMY5NCEV7SFBBUNW2RAPFUYVSGLVRJGUPEGAQW6CQXIA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.932580125 (121h34m26.663847775s) [noise=true , address=79.127.201.215:4352 , piece_id=F3HJ3OFE345OS33RM5IVHSQ4T7XM7AD5E4L5K2HOHQDKSOR2NYWQ, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.933085436 (121h34m26.664353096s) [noise=true , address=45.91.116.6:4994 , piece_id=HYIPQESICOS235TLD7LPN7EIAEDERU6ZEUZMA6H4Z526HLB7HGRA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.933560479 (121h34m26.664828129s) [noise=true , address=104.36.82.13:4218 , piece_id=7Y76IWSWV7B75AE53AIIDW5ZMZBLSADPNZAK4EWZMVP75OGVBHDA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.933930936 (121h34m26.665198586s) [noise=true , address=104.36.82.36:4623 , piece_id=SGRDUUDKT76BKQMHD42QQWUGF7R4YS4LP7C4QAHICB2LMZKDKZIA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.934398065 (121h34m26.665665725s) [noise=true , address=104.36.82.35:4585 , piece_id=OGLKDWVLZJW5I7BTPBDALTFW6KEAUL5YHAI7KLSZRECEAAOTJXVQ, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.934962576 (121h34m26.666230237s) [noise=true , address=79.127.220.101:4060 , piece_id=X76XJ5MSNAUWWQYLIHTWU5SCF7AYMT2DEORIMAZ64RNVFHV4X4IQ, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.935571281 (121h34m26.666838932s) [noise=true , address=104.36.82.59:4304 , piece_id=F775QQYHZF2L5Z4GNXFDWPKSZXZ2GVD7LKR7AXQCT3LKUSPKM2SA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.941244673 (121h34m26.672512304s) [noise=true , address=104.36.82.23:4451 , piece_id=472EEST73KBBWBPSNEWTPRHPKRE62H6C5IEWGGATZC2YSMLSWUOQ, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.941585945 (121h34m26.672853565s) [noise=true , address=104.36.82.19:4434 , piece_id=MACD6KBTPEM73TW665UZJGBWLRYMUMDUHAA43NR4Y6PL6XCD7IPA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.941814365 (121h34m26.673081995s) [noise=true , address=66.23.193.175:4560 , piece_id=GFIDNYH3Y35V24K5JV752ZXLHDFUF2OX4OCA3LXYE77C7ML4N2JQ, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.942026303 (121h34m26.673293924s) [noise=true , address=104.36.82.6:4879 , piece_id=S3S2FXNJ7XQAAN4ANAXAXDQORY6VMAJXXJ652QS32W5QEX5RXARQ, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.942279560 (121h34m26.67354719s) [noise=true , address=104.36.82.47:4549 , piece_id=L5HQOCUEHCROKOWOE3QJXXAN7JW75LQQFLAJQ3CFNZ2NPIFTKWIA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.942556491 (121h34m26.673824121s) [noise=true , address=77.90.31.10:4536 , piece_id=J65MXPIO4LGRHPL5TL5OHMJE2ECHB4ZNJDOBFZXRNJSKRVJ62UWA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.942810118 (121h34m26.674077737s) [noise=true , address=104.36.82.61:4408 , piece_id=FTNNRVYGZHCMVCK4Z5QWG6ZUGASKE45KL25BGAC25V3NICE7JNJA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.943031433 (121h34m26.674299064s) [noise=true , address=104.36.82.17:4344 , piece_id=IWYP6LBK6A77M7HZHHD42O3CF37AJZU52433ADT4WU6MKKNYOG7Q, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.943311671 (121h34m26.674579292s) [noise=true , address=104.36.82.39:4745 , piece_id=TSKQALMPM7BVYVXJ6ERRG2XGNKIOO5NKT3XIMLY2NMMLYREU7DFA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:46.034419252 (121h34m26.765686882s) [upload=126586]: Next returned nil segment Aug 13 19:00:46.034433831 (121h34m26.765701461s) [upload=126586]: Waiting for error group managing segments... Aug 13 19:00:46.046381083 (121h34m26.777648703s) [noise=true , address=104.36.82.39:4745 , piece_id=TSKQALMPM7BVYVXJ6ERRG2XGNKIOO5NKT3XIMLY2NMMLYREU7DFA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.049614535 (121h34m26.780882166s) [noise=true , address=104.36.82.35:4585 , piece_id=OGLKDWVLZJW5I7BTPBDALTFW6KEAUL5YHAI7KLSZRECEAAOTJXVQ, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.057741672 (121h34m26.789009321s) [noise=true , address=104.36.82.6:4879 , piece_id=S3S2FXNJ7XQAAN4ANAXAXDQORY6VMAJXXJ652QS32W5QEX5RXARQ, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.062248469 (121h34m26.793516099s) [noise=true , address=45.91.116.6:4994 , piece_id=HYIPQESICOS235TLD7LPN7EIAEDERU6ZEUZMA6H4Z526HLB7HGRA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.065516336 (121h34m26.796783956s) [noise=true , address=104.36.82.23:4451 , piece_id=472EEST73KBBWBPSNEWTPRHPKRE62H6C5IEWGGATZC2YSMLSWUOQ, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.065845947 (121h34m26.797113577s) [noise=true , address=104.36.82.61:4408 , piece_id=FTNNRVYGZHCMVCK4Z5QWG6ZUGASKE45KL25BGAC25V3NICE7JNJA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.065971682 (121h34m26.797239332s) [noise=true , address=104.36.82.17:4344 , piece_id=IWYP6LBK6A77M7HZHHD42O3CF37AJZU52433ADT4WU6MKKNYOG7Q, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.072725256 (121h34m26.803992887s) [noise=true , address=104.36.82.36:4623 , piece_id=SGRDUUDKT76BKQMHD42QQWUGF7R4YS4LP7C4QAHICB2LMZKDKZIA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.073045047 (121h34m26.804312667s) [noise=true , address=104.36.82.13:4218 , piece_id=7Y76IWSWV7B75AE53AIIDW5ZMZBLSADPNZAK4EWZMVP75OGVBHDA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.075786824 (121h34m26.807054454s) [noise=true , address=104.36.82.19:4434 , piece_id=MACD6KBTPEM73TW665UZJGBWLRYMUMDUHAA43NR4Y6PL6XCD7IPA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.081500673 (121h34m26.812768292s) [noise=true , address=77.90.31.10:4536 , piece_id=J65MXPIO4LGRHPL5TL5OHMJE2ECHB4ZNJDOBFZXRNJSKRVJ62UWA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.113616031 (121h34m26.844883651s) [noise=true , address=79.127.220.101:4060 , piece_id=X76XJ5MSNAUWWQYLIHTWU5SCF7AYMT2DEORIMAZ64RNVFHV4X4IQ, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.185482842 (121h34m26.916750493s) [noise=true , address=104.36.82.59:4304 , piece_id=F775QQYHZF2L5Z4GNXFDWPKSZXZ2GVD7LKR7AXQCT3LKUSPKM2SA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.212513286 (121h34m26.943780936s) [noise=true , address=104.36.82.60:4351 , piece_id=2VU4ET3DMMY5NCEV7SFBBUNW2RAPFUYVSGLVRJGUPEGAQW6CQXIA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.212546929 (121h34m26.943814579s) [seg_pos={0 0}, upload=126586]: Segment reached optimal threshold of 14 pieces. Aug 13 19:00:46.212771922 (121h34m26.944039572s) [noise=true , address=79.127.201.215:4352 , piece_id=F3HJ3OFE345OS33RM5IVHSQ4T7XM7AD5E4L5K2HOHQDKSOR2NYWQ, seg_pos={0 0}, upload=126586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: expected piece hash; context canceled; EOF Aug 13 19:00:46.213155234 (121h34m26.944422884s) [noise=true , address=66.23.193.175:4560 , piece_id=GFIDNYH3Y35V24K5JV752ZXLHDFUF2OX4OCA3LXYE77C7ML4N2JQ, seg_pos={0 0}, upload=126586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JnJPYq3oApurPNBCfSqHzcEmtm4V2doRwfaPBPF3xBFtJoVny): protocol: read tcp 5.161.89.252:54574->66.23.193.175:4560: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 13 19:00:46.213249430 (121h34m26.944517081s) [noise=true , address=104.36.82.47:4549 , piece_id=L5HQOCUEHCROKOWOE3QJXXAN7JW75LQQFLAJQ3CFNZ2NPIFTKWIA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HWoyMKQ6v2XWUfEmfFh3m8AiGivAcYkkZ9na8kqHFzH2hPDeK): protocol: write tcp 5.161.89.252:15682->104.36.82.47:4549: use of closed network connection; write tcp 5.161.89.252:15682->104.36.82.47:4549: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:15682->104.36.82.47:4549: use of closed network connection Aug 13 19:00:46.213292782 (121h34m26.944560442s) [noise=true , address=66.23.193.175:4554 , piece_id=666XPJASF2WTWY3K6AHSYNKCTJIQ6BJTR6BC5SLDSW7THR2F67KA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CraGuuckkbKe5PDLUvwF5G2ATUbgdR5g192YjkZgmP3JpqgXi): protocol: read tcp 5.161.89.252:60322->66.23.193.175:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 13 19:00:46.213314012 (121h34m26.944581662s) [seg_pos={0 0}, upload=126586]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 19:00:46.213384454 (121h34m26.944652115s) [upload=126586]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 19:00:46.213390045 (121h34m26.944657695s) [upload=126586]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 19:00:46.344299064 (121h34m27.075566684s) [upload=126586]: Done uploading segments... Aug 13 19:00:46.344312700 (121h34m27.075580319s) [upload=126586]: Upload finished. err: <nil> Duration: 397.051119ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...............X......X........................X............] duration: 134.01446ms FAIL (2025-08-13 19:04:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests Duration:* 134.035348ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [X............................X.........................X....] duration: 872.384065ms FAIL (2025-08-13 19:04:37 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 13 19:00:45.896427783 (121h34m26.627695434s) [upload=126586]: Starting upload Aug 13 19:00:45.896515508 (121h34m26.627783158s) [upload=126586]: Done starting upload Aug 13 19:00:45.896609275 (121h34m26.627876925s) [upload=126586]: Uploading segments... Aug 13 19:00:45.896962429 (121h34m26.628230079s) [upload=126586]: Got next segment. Inline: false Aug 13 19:00:45.897056496 (121h34m26.628324216s) [upload=126586]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 19:00:45.897065923 (121h34m26.628333573s) [upload=126586]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 19:00:45.929375116 (121h34m26.660642776s) [seg_pos={0 0}, upload=126586]: Begin upload segment... Aug 13 19:00:45.930855281 (121h34m26.662122942s) [seg_pos={0 0}, upload=126586]: Done begin upload segment. Aug 13 19:00:45.930920724 (121h34m26.662188384s) [noise=true , address=66.23.193.175:4554 , piece_id=666XPJASF2WTWY3K6AHSYNKCTJIQ6BJTR6BC5SLDSW7THR2F67KA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.932026053 (121h34m26.663293703s) [noise=true , address=104.36.82.60:4351 , piece_id=2VU4ET3DMMY5NCEV7SFBBUNW2RAPFUYVSGLVRJGUPEGAQW6CQXIA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.932580125 (121h34m26.663847775s) [noise=true , address=79.127.201.215:4352 , piece_id=F3HJ3OFE345OS33RM5IVHSQ4T7XM7AD5E4L5K2HOHQDKSOR2NYWQ, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.933085436 (121h34m26.664353096s) [noise=true , address=45.91.116.6:4994 , piece_id=HYIPQESICOS235TLD7LPN7EIAEDERU6ZEUZMA6H4Z526HLB7HGRA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.933560479 (121h34m26.664828129s) [noise=true , address=104.36.82.13:4218 , piece_id=7Y76IWSWV7B75AE53AIIDW5ZMZBLSADPNZAK4EWZMVP75OGVBHDA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.933930936 (121h34m26.665198586s) [noise=true , address=104.36.82.36:4623 , piece_id=SGRDUUDKT76BKQMHD42QQWUGF7R4YS4LP7C4QAHICB2LMZKDKZIA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.934398065 (121h34m26.665665725s) [noise=true , address=104.36.82.35:4585 , piece_id=OGLKDWVLZJW5I7BTPBDALTFW6KEAUL5YHAI7KLSZRECEAAOTJXVQ, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.934962576 (121h34m26.666230237s) [noise=true , address=79.127.220.101:4060 , piece_id=X76XJ5MSNAUWWQYLIHTWU5SCF7AYMT2DEORIMAZ64RNVFHV4X4IQ, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.935571281 (121h34m26.666838932s) [noise=true , address=104.36.82.59:4304 , piece_id=F775QQYHZF2L5Z4GNXFDWPKSZXZ2GVD7LKR7AXQCT3LKUSPKM2SA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.941244673 (121h34m26.672512304s) [noise=true , address=104.36.82.23:4451 , piece_id=472EEST73KBBWBPSNEWTPRHPKRE62H6C5IEWGGATZC2YSMLSWUOQ, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.941585945 (121h34m26.672853565s) [noise=true , address=104.36.82.19:4434 , piece_id=MACD6KBTPEM73TW665UZJGBWLRYMUMDUHAA43NR4Y6PL6XCD7IPA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.941814365 (121h34m26.673081995s) [noise=true , address=66.23.193.175:4560 , piece_id=GFIDNYH3Y35V24K5JV752ZXLHDFUF2OX4OCA3LXYE77C7ML4N2JQ, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.942026303 (121h34m26.673293924s) [noise=true , address=104.36.82.6:4879 , piece_id=S3S2FXNJ7XQAAN4ANAXAXDQORY6VMAJXXJ652QS32W5QEX5RXARQ, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.942279560 (121h34m26.67354719s) [noise=true , address=104.36.82.47:4549 , piece_id=L5HQOCUEHCROKOWOE3QJXXAN7JW75LQQFLAJQ3CFNZ2NPIFTKWIA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.942556491 (121h34m26.673824121s) [noise=true , address=77.90.31.10:4536 , piece_id=J65MXPIO4LGRHPL5TL5OHMJE2ECHB4ZNJDOBFZXRNJSKRVJ62UWA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.942810118 (121h34m26.674077737s) [noise=true , address=104.36.82.61:4408 , piece_id=FTNNRVYGZHCMVCK4Z5QWG6ZUGASKE45KL25BGAC25V3NICE7JNJA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.943031433 (121h34m26.674299064s) [noise=true , address=104.36.82.17:4344 , piece_id=IWYP6LBK6A77M7HZHHD42O3CF37AJZU52433ADT4WU6MKKNYOG7Q, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:45.943311671 (121h34m26.674579292s) [noise=true , address=104.36.82.39:4745 , piece_id=TSKQALMPM7BVYVXJ6ERRG2XGNKIOO5NKT3XIMLY2NMMLYREU7DFA, seg_pos={0 0}, upload=126586]: Uploading piece... Aug 13 19:00:46.034419252 (121h34m26.765686882s) [upload=126586]: Next returned nil segment Aug 13 19:00:46.034433831 (121h34m26.765701461s) [upload=126586]: Waiting for error group managing segments... Aug 13 19:00:46.046381083 (121h34m26.777648703s) [noise=true , address=104.36.82.39:4745 , piece_id=TSKQALMPM7BVYVXJ6ERRG2XGNKIOO5NKT3XIMLY2NMMLYREU7DFA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.049614535 (121h34m26.780882166s) [noise=true , address=104.36.82.35:4585 , piece_id=OGLKDWVLZJW5I7BTPBDALTFW6KEAUL5YHAI7KLSZRECEAAOTJXVQ, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.057741672 (121h34m26.789009321s) [noise=true , address=104.36.82.6:4879 , piece_id=S3S2FXNJ7XQAAN4ANAXAXDQORY6VMAJXXJ652QS32W5QEX5RXARQ, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.062248469 (121h34m26.793516099s) [noise=true , address=45.91.116.6:4994 , piece_id=HYIPQESICOS235TLD7LPN7EIAEDERU6ZEUZMA6H4Z526HLB7HGRA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.065516336 (121h34m26.796783956s) [noise=true , address=104.36.82.23:4451 , piece_id=472EEST73KBBWBPSNEWTPRHPKRE62H6C5IEWGGATZC2YSMLSWUOQ, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.065845947 (121h34m26.797113577s) [noise=true , address=104.36.82.61:4408 , piece_id=FTNNRVYGZHCMVCK4Z5QWG6ZUGASKE45KL25BGAC25V3NICE7JNJA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.065971682 (121h34m26.797239332s) [noise=true , address=104.36.82.17:4344 , piece_id=IWYP6LBK6A77M7HZHHD42O3CF37AJZU52433ADT4WU6MKKNYOG7Q, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.072725256 (121h34m26.803992887s) [noise=true , address=104.36.82.36:4623 , piece_id=SGRDUUDKT76BKQMHD42QQWUGF7R4YS4LP7C4QAHICB2LMZKDKZIA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.073045047 (121h34m26.804312667s) [noise=true , address=104.36.82.13:4218 , piece_id=7Y76IWSWV7B75AE53AIIDW5ZMZBLSADPNZAK4EWZMVP75OGVBHDA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.075786824 (121h34m26.807054454s) [noise=true , address=104.36.82.19:4434 , piece_id=MACD6KBTPEM73TW665UZJGBWLRYMUMDUHAA43NR4Y6PL6XCD7IPA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.081500673 (121h34m26.812768292s) [noise=true , address=77.90.31.10:4536 , piece_id=J65MXPIO4LGRHPL5TL5OHMJE2ECHB4ZNJDOBFZXRNJSKRVJ62UWA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.113616031 (121h34m26.844883651s) [noise=true , address=79.127.220.101:4060 , piece_id=X76XJ5MSNAUWWQYLIHTWU5SCF7AYMT2DEORIMAZ64RNVFHV4X4IQ, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.185482842 (121h34m26.916750493s) [noise=true , address=104.36.82.59:4304 , piece_id=F775QQYHZF2L5Z4GNXFDWPKSZXZ2GVD7LKR7AXQCT3LKUSPKM2SA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.212513286 (121h34m26.943780936s) [noise=true , address=104.36.82.60:4351 , piece_id=2VU4ET3DMMY5NCEV7SFBBUNW2RAPFUYVSGLVRJGUPEGAQW6CQXIA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: <nil> Aug 13 19:00:46.212546929 (121h34m26.943814579s) [seg_pos={0 0}, upload=126586]: Segment reached optimal threshold of 14 pieces. Aug 13 19:00:46.212771922 (121h34m26.944039572s) [noise=true , address=79.127.201.215:4352 , piece_id=F3HJ3OFE345OS33RM5IVHSQ4T7XM7AD5E4L5K2HOHQDKSOR2NYWQ, seg_pos={0 0}, upload=126586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: expected piece hash; context canceled; EOF Aug 13 19:00:46.213155234 (121h34m26.944422884s) [noise=true , address=66.23.193.175:4560 , piece_id=GFIDNYH3Y35V24K5JV752ZXLHDFUF2OX4OCA3LXYE77C7ML4N2JQ, seg_pos={0 0}, upload=126586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JnJPYq3oApurPNBCfSqHzcEmtm4V2doRwfaPBPF3xBFtJoVny): protocol: read tcp 5.161.89.252:54574->66.23.193.175:4560: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 13 19:00:46.213249430 (121h34m26.944517081s) [noise=true , address=104.36.82.47:4549 , piece_id=L5HQOCUEHCROKOWOE3QJXXAN7JW75LQQFLAJQ3CFNZ2NPIFTKWIA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HWoyMKQ6v2XWUfEmfFh3m8AiGivAcYkkZ9na8kqHFzH2hPDeK): protocol: write tcp 5.161.89.252:15682->104.36.82.47:4549: use of closed network connection; write tcp 5.161.89.252:15682->104.36.82.47:4549: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:15682->104.36.82.47:4549: use of closed network connection Aug 13 19:00:46.213292782 (121h34m26.944560442s) [noise=true , address=66.23.193.175:4554 , piece_id=666XPJASF2WTWY3K6AHSYNKCTJIQ6BJTR6BC5SLDSW7THR2F67KA, seg_pos={0 0}, upload=126586]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CraGuuckkbKe5PDLUvwF5G2ATUbgdR5g192YjkZgmP3JpqgXi): protocol: read tcp 5.161.89.252:60322->66.23.193.175:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 13 19:00:46.213314012 (121h34m26.944581662s) [seg_pos={0 0}, upload=126586]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 19:00:46.213384454 (121h34m26.944652115s) [upload=126586]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 19:00:46.213390045 (121h34m26.944657695s) [upload=126586]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 19:00:46.344299064 (121h34m27.075566684s) [upload=126586]: Done uploading segments... Aug 13 19:00:46.344312700 (121h34m27.075580319s) [upload=126586]: Upload finished. err: <nil> Duration: 872.41844ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [................X......X........................X...........] duration: 706.233931ms FAIL (2025-08-13 19:04:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 18:55:21.849790646 (121h29m2.581058266s) [upload=126500]: Starting upload Aug 13 18:55:21.849866529 (121h29m2.581134149s) [upload=126500]: Done starting upload Aug 13 18:55:21.849939096 (121h29m2.581206726s) [upload=126500]: Uploading segments... Aug 13 18:55:21.849977618 (121h29m2.581245248s) [upload=126500]: Got next segment. Inline: true Aug 13 18:55:21.849983399 (121h29m2.581251049s) [upload=126500]: Waiting for error group managing segments... Aug 13 18:55:21.850034435 (121h29m2.581302065s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 18:55:21.850040105 (121h29m2.581307765s) [upload=126500]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 18:55:21.850044223 (121h29m2.581311853s) [upload=126500]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 18:55:21.852506835 (121h29m2.583774465s) [upload=126500]: Done uploading segments... Aug 13 18:55:21.852521132 (121h29m2.583788762s) [upload=126500]: Upload finished. err: metaclient: Too Many Requests Duration:* 706.252806ms core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)