Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 397.667169ms FAIL (2025-08-08 06:43:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== XOBTOA7P67NE2JIELPZWQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065025521 (14h5m53.652081792s) [noise=true , address=104.36.82.23:4457 , piece_id=OOK6SCTGDGEMBOCXSBR2RC5IUS2EYPANIISO2IAPXNRWUFA4ORMQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065205998 (14h5m53.652262239s) [noise=true , address=104.36.82.62:4439 , piece_id=CMLMZQQLTVF3KHEIHNQTZAELFG3465HOYKMCK2UDYOQHPROML3SA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065455032 (14h5m53.652511273s) [noise=true , address=64.49.13.137:4504 , piece_id=UXR3Z5Q6AJWVIA27IZHNPMRTTKLC4ENHVUQHVANK5L3AXOYOOWIA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065786381 (14h5m53.652842622s) [noise=true , address=104.36.82.42:4808 , piece_id=5AGVDHXGAVLF6OPWT4KYTW6TFAPDPNADOPZ5C3KXAXRLI4OUNBDQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065845953 (14h5m53.652902193s) [noise=true , address=104.36.82.58:4273 , piece_id=H6VG6QUSKVNBAJRDQUV4PZIKBFGAM7OIX7BTB4UO5YW6EHVFR2FQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.066263101 (14h5m53.653319342s) [noise=true , address=64.49.13.154:4928 , piece_id=QDSHIQMF6WDJQZZKWQZZP4DVKFZUN2JAUVHRJOIZZ4SMNXQLVSZQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.066327521 (14h5m53.653383763s) [noise=true , address=104.36.82.59:4319 , piece_id=AIU65US456ESICJU42TGN43EC7KRVDXAQA4TXF3LEJ66ZQJSK3TQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.066919006 (14h5m53.653975247s) [noise=true , address=104.36.82.37:4657 , piece_id=DDJRHIGSD66WQQ3SAPQRKC7RHTHXASXDVNMIKQQDRTWKK5ADIUOQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067254953 (14h5m53.654311194s) [noise=true , address=64.49.13.27:4963 , piece_id=CEB52PLVGIB2RIXEBBSUJAQQUPGC4U2JVFQ3J7HW3LMRIFWXCAYA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067466127 (14h5m53.654522368s) [noise=true , address=104.36.82.36:4641 , piece_id=R7R33QBSBJUWWKVI2UXEDRKDCOCVYKMYVE2CEWK2MATSBZ3MGJIQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067873497 (14h5m53.654929738s) [noise=true , address=104.36.82.61:4404 , piece_id=DF4W6VI4HG7XX444VNPBKGDLK4EYJQZ5SKCZGBV6UNPJGGFA6BEA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067987530 (14h5m53.655043771s) [noise=true , address=104.36.82.45:4938 , piece_id=HYAUM7LFB7YKMLPBHD7PEBP6Y54JMZ2UAJTDTBCP3JAB3IBJHJEQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.068356108 (14h5m53.655412349s) [noise=true , address=104.36.82.60:4359 , piece_id=PT3LJH7ROPW2UXME5HDMDAHIFPZ3JILDNT6LUTNHYDSNFRRGIR4A, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.068429946 (14h5m53.655486187s) [noise=true , address=104.36.82.38:4693 , piece_id=QPR6POCGGHYGULCXPEOZBBSDBOV5DLTIW6ZUKMGPIJZLB3F3HNJA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.068896717 (14h5m53.655952958s) [noise=true , address=104.36.82.37:4684 , piece_id=PV6SS66AY2YJEC2CBYLQ4LQLWUS3KWVPIPPN46OAAFC4ZZQGX5XQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.069016020 (14h5m53.656072261s) [noise=true , address=104.36.82.43:4854 , piece_id=3YYPCYCMQQSKEG5WE6PD3QF5XJI3GN3FIAUNBQDOQ2URBGMHD7AA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.225413177 (14h5m53.812469418s) [upload=14568]: Next returned nil segment Aug 8 06:32:40.225429067 (14h5m53.812485298s) [upload=14568]: Waiting for error group managing segments... Aug 8 06:32:40.238535474 (14h5m53.825591705s) [noise=true , address=104.36.82.61:4404 , piece_id=DF4W6VI4HG7XX444VNPBKGDLK4EYJQZ5SKCZGBV6UNPJGGFA6BEA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.239293129 (14h5m53.826349371s) [noise=true , address=104.36.82.42:4808 , piece_id=5AGVDHXGAVLF6OPWT4KYTW6TFAPDPNADOPZ5C3KXAXRLI4OUNBDQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.241689332 (14h5m53.828745574s) [noise=true , address=104.36.82.23:4457 , piece_id=OOK6SCTGDGEMBOCXSBR2RC5IUS2EYPANIISO2IAPXNRWUFA4ORMQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.242096392 (14h5m53.829152623s) [noise=true , address=104.36.82.45:4938 , piece_id=HYAUM7LFB7YKMLPBHD7PEBP6Y54JMZ2UAJTDTBCP3JAB3IBJHJEQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.242267271 (14h5m53.829323512s) [noise=true , address=104.36.82.58:4273 , piece_id=H6VG6QUSKVNBAJRDQUV4PZIKBFGAM7OIX7BTB4UO5YW6EHVFR2FQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.242818750 (14h5m53.829874981s) [noise=true , address=104.36.82.37:4657 , piece_id=DDJRHIGSD66WQQ3SAPQRKC7RHTHXASXDVNMIKQQDRTWKK5ADIUOQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.243569251 (14h5m53.830625473s) [noise=true , address=104.36.82.38:4693 , piece_id=QPR6POCGGHYGULCXPEOZBBSDBOV5DLTIW6ZUKMGPIJZLB3F3HNJA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.244340481 (14h5m53.831396702s) [noise=true , address=104.36.82.60:4359 , piece_id=PT3LJH7ROPW2UXME5HDMDAHIFPZ3JILDNT6LUTNHYDSNFRRGIR4A, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.244984754 (14h5m53.832040985s) [noise=true , address=104.36.82.43:4854 , piece_id=3YYPCYCMQQSKEG5WE6PD3QF5XJI3GN3FIAUNBQDOQ2URBGMHD7AA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.245524792 (14h5m53.832581023s) [noise=true , address=104.36.82.37:4684 , piece_id=PV6SS66AY2YJEC2CBYLQ4LQLWUS3KWVPIPPN46OAAFC4ZZQGX5XQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.246872779 (14h5m53.83392901s) [noise=true , address=104.36.82.36:4641 , piece_id=R7R33QBSBJUWWKVI2UXEDRKDCOCVYKMYVE2CEWK2MATSBZ3MGJIQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.247331215 (14h5m53.834387456s) [noise=true , address=104.36.82.34:4561 , piece_id=D42SM3LJAAC7HHZWQEYBPWT6NOUQW3VUVHNPAODKKY54CWZWDQBQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.247891481 (14h5m53.834947722s) [noise=true , address=104.36.82.62:4439 , piece_id=CMLMZQQLTVF3KHEIHNQTZAELFG3465HOYKMCK2UDYOQHPROML3SA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.248431108 (14h5m53.835487338s) [noise=true , address=104.36.82.13:4204 , piece_id=WT2WD2ZAU5MBXXNBZFXLOVXMWUFOMPUXOBTOA7P67NE2JIELPZWQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.248441287 (14h5m53.835497528s) [seg_pos={0 0}, upload=14568]: Segment reached optimal threshold of 14 pieces. Aug 8 06:32:40.248563916 (14h5m53.835620157s) [noise=true , address=104.36.82.59:4319 , piece_id=AIU65US456ESICJU42TGN43EC7KRVDXAQA4TXF3LEJ66ZQJSK3TQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hzjVmYJbXH9yCxL2JUotjRKfWtgdUjSQKmPRByQAMjBkHqLRK): protocol: expected piece hash; context canceled; EOF Aug 8 06:32:40.249100268 (14h5m53.836156509s) [noise=true , address=64.49.13.154:4928 , piece_id=QDSHIQMF6WDJQZZKWQZZP4DVKFZUN2JAUVHRJOIZZ4SMNXQLVSZQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: read tcp 5.161.89.252:59898->64.49.13.154:4928: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 06:32:40.249154668 (14h5m53.83621091s) [noise=true , address=64.49.13.27:4963 , piece_id=CEB52PLVGIB2RIXEBBSUJAQQUPGC4U2JVFQ3J7HW3LMRIFWXCAYA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: read tcp 5.161.89.252:44876->64.49.13.27:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 06:32:40.249199352 (14h5m53.836255594s) [noise=true , address=64.49.13.137:4504 , piece_id=UXR3Z5Q6AJWVIA27IZHNPMRTTKLC4ENHVUQHVANK5L3AXOYOOWIA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:11LnrSYf8ZaxUgsdjt6jHzNgHjkq1bFCnDEFd14JzhParNTesZ): protocol: read tcp 5.161.89.252:19204->64.49.13.137:4504: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 06:32:40.249210163 (14h5m53.836266404s) [seg_pos={0 0}, upload=14568]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:32:40.249282678 (14h5m53.836338919s) [upload=14568]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:32:40.249287737 (14h5m53.836343968s) [upload=14568]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:32:40.302341870 (14h5m53.889398111s) [upload=14568]: Done uploading segments... Aug 8 06:32:40.302361056 (14h5m53.889417297s) [upload=14568]: Upload finished. err: <nil> Aug 8 06:33:19.671995961 (14h6m33.259052203s) [upload=14579]: Starting upload Aug 8 06:33:19.672056584 (14h6m33.259112826s) [upload=14579]: Done starting upload Aug 8 06:33:19.672119763 (14h6m33.259175994s) [upload=14579]: Uploading segments... Aug 8 06:33:19.672884900 (14h6m33.259941132s) [upload=14579]: Got next segment. Inline: false Aug 8 06:33:19.672932620 (14h6m33.259988862s) [upload=14579]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:33:19.672937719 (14h6m33.259993961s) [upload=14579]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:33:19.675836631 (14h6m33.262892862s) [upload=14579]: Next segment err: metaclient: Too Many Requests Aug 8 06:33:19.675851759 (14h6m33.262908s) [upload=14579]: Done uploading segments... Aug 8 06:33:19.675865856 (14h6m33.262922097s) [upload=14579]: Upload finished. err: metaclient: Too Many Requests Duration: 397.687517ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 1.043087001s FAIL (2025-08-08 06:42:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== XOBTOA7P67NE2JIELPZWQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065025521 (14h5m53.652081792s) [noise=true , address=104.36.82.23:4457 , piece_id=OOK6SCTGDGEMBOCXSBR2RC5IUS2EYPANIISO2IAPXNRWUFA4ORMQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065205998 (14h5m53.652262239s) [noise=true , address=104.36.82.62:4439 , piece_id=CMLMZQQLTVF3KHEIHNQTZAELFG3465HOYKMCK2UDYOQHPROML3SA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065455032 (14h5m53.652511273s) [noise=true , address=64.49.13.137:4504 , piece_id=UXR3Z5Q6AJWVIA27IZHNPMRTTKLC4ENHVUQHVANK5L3AXOYOOWIA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065786381 (14h5m53.652842622s) [noise=true , address=104.36.82.42:4808 , piece_id=5AGVDHXGAVLF6OPWT4KYTW6TFAPDPNADOPZ5C3KXAXRLI4OUNBDQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065845953 (14h5m53.652902193s) [noise=true , address=104.36.82.58:4273 , piece_id=H6VG6QUSKVNBAJRDQUV4PZIKBFGAM7OIX7BTB4UO5YW6EHVFR2FQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.066263101 (14h5m53.653319342s) [noise=true , address=64.49.13.154:4928 , piece_id=QDSHIQMF6WDJQZZKWQZZP4DVKFZUN2JAUVHRJOIZZ4SMNXQLVSZQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.066327521 (14h5m53.653383763s) [noise=true , address=104.36.82.59:4319 , piece_id=AIU65US456ESICJU42TGN43EC7KRVDXAQA4TXF3LEJ66ZQJSK3TQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.066919006 (14h5m53.653975247s) [noise=true , address=104.36.82.37:4657 , piece_id=DDJRHIGSD66WQQ3SAPQRKC7RHTHXASXDVNMIKQQDRTWKK5ADIUOQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067254953 (14h5m53.654311194s) [noise=true , address=64.49.13.27:4963 , piece_id=CEB52PLVGIB2RIXEBBSUJAQQUPGC4U2JVFQ3J7HW3LMRIFWXCAYA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067466127 (14h5m53.654522368s) [noise=true , address=104.36.82.36:4641 , piece_id=R7R33QBSBJUWWKVI2UXEDRKDCOCVYKMYVE2CEWK2MATSBZ3MGJIQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067873497 (14h5m53.654929738s) [noise=true , address=104.36.82.61:4404 , piece_id=DF4W6VI4HG7XX444VNPBKGDLK4EYJQZ5SKCZGBV6UNPJGGFA6BEA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067987530 (14h5m53.655043771s) [noise=true , address=104.36.82.45:4938 , piece_id=HYAUM7LFB7YKMLPBHD7PEBP6Y54JMZ2UAJTDTBCP3JAB3IBJHJEQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.068356108 (14h5m53.655412349s) [noise=true , address=104.36.82.60:4359 , piece_id=PT3LJH7ROPW2UXME5HDMDAHIFPZ3JILDNT6LUTNHYDSNFRRGIR4A, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.068429946 (14h5m53.655486187s) [noise=true , address=104.36.82.38:4693 , piece_id=QPR6POCGGHYGULCXPEOZBBSDBOV5DLTIW6ZUKMGPIJZLB3F3HNJA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.068896717 (14h5m53.655952958s) [noise=true , address=104.36.82.37:4684 , piece_id=PV6SS66AY2YJEC2CBYLQ4LQLWUS3KWVPIPPN46OAAFC4ZZQGX5XQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.069016020 (14h5m53.656072261s) [noise=true , address=104.36.82.43:4854 , piece_id=3YYPCYCMQQSKEG5WE6PD3QF5XJI3GN3FIAUNBQDOQ2URBGMHD7AA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.225413177 (14h5m53.812469418s) [upload=14568]: Next returned nil segment Aug 8 06:32:40.225429067 (14h5m53.812485298s) [upload=14568]: Waiting for error group managing segments... Aug 8 06:32:40.238535474 (14h5m53.825591705s) [noise=true , address=104.36.82.61:4404 , piece_id=DF4W6VI4HG7XX444VNPBKGDLK4EYJQZ5SKCZGBV6UNPJGGFA6BEA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.239293129 (14h5m53.826349371s) [noise=true , address=104.36.82.42:4808 , piece_id=5AGVDHXGAVLF6OPWT4KYTW6TFAPDPNADOPZ5C3KXAXRLI4OUNBDQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.241689332 (14h5m53.828745574s) [noise=true , address=104.36.82.23:4457 , piece_id=OOK6SCTGDGEMBOCXSBR2RC5IUS2EYPANIISO2IAPXNRWUFA4ORMQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.242096392 (14h5m53.829152623s) [noise=true , address=104.36.82.45:4938 , piece_id=HYAUM7LFB7YKMLPBHD7PEBP6Y54JMZ2UAJTDTBCP3JAB3IBJHJEQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.242267271 (14h5m53.829323512s) [noise=true , address=104.36.82.58:4273 , piece_id=H6VG6QUSKVNBAJRDQUV4PZIKBFGAM7OIX7BTB4UO5YW6EHVFR2FQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.242818750 (14h5m53.829874981s) [noise=true , address=104.36.82.37:4657 , piece_id=DDJRHIGSD66WQQ3SAPQRKC7RHTHXASXDVNMIKQQDRTWKK5ADIUOQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.243569251 (14h5m53.830625473s) [noise=true , address=104.36.82.38:4693 , piece_id=QPR6POCGGHYGULCXPEOZBBSDBOV5DLTIW6ZUKMGPIJZLB3F3HNJA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.244340481 (14h5m53.831396702s) [noise=true , address=104.36.82.60:4359 , piece_id=PT3LJH7ROPW2UXME5HDMDAHIFPZ3JILDNT6LUTNHYDSNFRRGIR4A, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.244984754 (14h5m53.832040985s) [noise=true , address=104.36.82.43:4854 , piece_id=3YYPCYCMQQSKEG5WE6PD3QF5XJI3GN3FIAUNBQDOQ2URBGMHD7AA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.245524792 (14h5m53.832581023s) [noise=true , address=104.36.82.37:4684 , piece_id=PV6SS66AY2YJEC2CBYLQ4LQLWUS3KWVPIPPN46OAAFC4ZZQGX5XQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.246872779 (14h5m53.83392901s) [noise=true , address=104.36.82.36:4641 , piece_id=R7R33QBSBJUWWKVI2UXEDRKDCOCVYKMYVE2CEWK2MATSBZ3MGJIQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.247331215 (14h5m53.834387456s) [noise=true , address=104.36.82.34:4561 , piece_id=D42SM3LJAAC7HHZWQEYBPWT6NOUQW3VUVHNPAODKKY54CWZWDQBQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.247891481 (14h5m53.834947722s) [noise=true , address=104.36.82.62:4439 , piece_id=CMLMZQQLTVF3KHEIHNQTZAELFG3465HOYKMCK2UDYOQHPROML3SA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.248431108 (14h5m53.835487338s) [noise=true , address=104.36.82.13:4204 , piece_id=WT2WD2ZAU5MBXXNBZFXLOVXMWUFOMPUXOBTOA7P67NE2JIELPZWQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.248441287 (14h5m53.835497528s) [seg_pos={0 0}, upload=14568]: Segment reached optimal threshold of 14 pieces. Aug 8 06:32:40.248563916 (14h5m53.835620157s) [noise=true , address=104.36.82.59:4319 , piece_id=AIU65US456ESICJU42TGN43EC7KRVDXAQA4TXF3LEJ66ZQJSK3TQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hzjVmYJbXH9yCxL2JUotjRKfWtgdUjSQKmPRByQAMjBkHqLRK): protocol: expected piece hash; context canceled; EOF Aug 8 06:32:40.249100268 (14h5m53.836156509s) [noise=true , address=64.49.13.154:4928 , piece_id=QDSHIQMF6WDJQZZKWQZZP4DVKFZUN2JAUVHRJOIZZ4SMNXQLVSZQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: read tcp 5.161.89.252:59898->64.49.13.154:4928: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 06:32:40.249154668 (14h5m53.83621091s) [noise=true , address=64.49.13.27:4963 , piece_id=CEB52PLVGIB2RIXEBBSUJAQQUPGC4U2JVFQ3J7HW3LMRIFWXCAYA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: read tcp 5.161.89.252:44876->64.49.13.27:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 06:32:40.249199352 (14h5m53.836255594s) [noise=true , address=64.49.13.137:4504 , piece_id=UXR3Z5Q6AJWVIA27IZHNPMRTTKLC4ENHVUQHVANK5L3AXOYOOWIA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:11LnrSYf8ZaxUgsdjt6jHzNgHjkq1bFCnDEFd14JzhParNTesZ): protocol: read tcp 5.161.89.252:19204->64.49.13.137:4504: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 06:32:40.249210163 (14h5m53.836266404s) [seg_pos={0 0}, upload=14568]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:32:40.249282678 (14h5m53.836338919s) [upload=14568]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:32:40.249287737 (14h5m53.836343968s) [upload=14568]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:32:40.302341870 (14h5m53.889398111s) [upload=14568]: Done uploading segments... Aug 8 06:32:40.302361056 (14h5m53.889417297s) [upload=14568]: Upload finished. err: <nil> Aug 8 06:33:19.671995961 (14h6m33.259052203s) [upload=14579]: Starting upload Aug 8 06:33:19.672056584 (14h6m33.259112826s) [upload=14579]: Done starting upload Aug 8 06:33:19.672119763 (14h6m33.259175994s) [upload=14579]: Uploading segments... Aug 8 06:33:19.672884900 (14h6m33.259941132s) [upload=14579]: Got next segment. Inline: false Aug 8 06:33:19.672932620 (14h6m33.259988862s) [upload=14579]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:33:19.672937719 (14h6m33.259993961s) [upload=14579]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:33:19.675836631 (14h6m33.262892862s) [upload=14579]: Next segment err: metaclient: Too Many Requests Aug 8 06:33:19.675851759 (14h6m33.262908s) [upload=14579]: Done uploading segments... Aug 8 06:33:19.675865856 (14h6m33.262922097s) [upload=14579]: Upload finished. err: metaclient: Too Many Requests Duration: 1.043120594s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 385.696511ms FAIL (2025-08-08 06:41:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== XOBTOA7P67NE2JIELPZWQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065025521 (14h5m53.652081792s) [noise=true , address=104.36.82.23:4457 , piece_id=OOK6SCTGDGEMBOCXSBR2RC5IUS2EYPANIISO2IAPXNRWUFA4ORMQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065205998 (14h5m53.652262239s) [noise=true , address=104.36.82.62:4439 , piece_id=CMLMZQQLTVF3KHEIHNQTZAELFG3465HOYKMCK2UDYOQHPROML3SA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065455032 (14h5m53.652511273s) [noise=true , address=64.49.13.137:4504 , piece_id=UXR3Z5Q6AJWVIA27IZHNPMRTTKLC4ENHVUQHVANK5L3AXOYOOWIA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065786381 (14h5m53.652842622s) [noise=true , address=104.36.82.42:4808 , piece_id=5AGVDHXGAVLF6OPWT4KYTW6TFAPDPNADOPZ5C3KXAXRLI4OUNBDQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065845953 (14h5m53.652902193s) [noise=true , address=104.36.82.58:4273 , piece_id=H6VG6QUSKVNBAJRDQUV4PZIKBFGAM7OIX7BTB4UO5YW6EHVFR2FQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.066263101 (14h5m53.653319342s) [noise=true , address=64.49.13.154:4928 , piece_id=QDSHIQMF6WDJQZZKWQZZP4DVKFZUN2JAUVHRJOIZZ4SMNXQLVSZQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.066327521 (14h5m53.653383763s) [noise=true , address=104.36.82.59:4319 , piece_id=AIU65US456ESICJU42TGN43EC7KRVDXAQA4TXF3LEJ66ZQJSK3TQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.066919006 (14h5m53.653975247s) [noise=true , address=104.36.82.37:4657 , piece_id=DDJRHIGSD66WQQ3SAPQRKC7RHTHXASXDVNMIKQQDRTWKK5ADIUOQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067254953 (14h5m53.654311194s) [noise=true , address=64.49.13.27:4963 , piece_id=CEB52PLVGIB2RIXEBBSUJAQQUPGC4U2JVFQ3J7HW3LMRIFWXCAYA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067466127 (14h5m53.654522368s) [noise=true , address=104.36.82.36:4641 , piece_id=R7R33QBSBJUWWKVI2UXEDRKDCOCVYKMYVE2CEWK2MATSBZ3MGJIQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067873497 (14h5m53.654929738s) [noise=true , address=104.36.82.61:4404 , piece_id=DF4W6VI4HG7XX444VNPBKGDLK4EYJQZ5SKCZGBV6UNPJGGFA6BEA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067987530 (14h5m53.655043771s) [noise=true , address=104.36.82.45:4938 , piece_id=HYAUM7LFB7YKMLPBHD7PEBP6Y54JMZ2UAJTDTBCP3JAB3IBJHJEQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.068356108 (14h5m53.655412349s) [noise=true , address=104.36.82.60:4359 , piece_id=PT3LJH7ROPW2UXME5HDMDAHIFPZ3JILDNT6LUTNHYDSNFRRGIR4A, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.068429946 (14h5m53.655486187s) [noise=true , address=104.36.82.38:4693 , piece_id=QPR6POCGGHYGULCXPEOZBBSDBOV5DLTIW6ZUKMGPIJZLB3F3HNJA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.068896717 (14h5m53.655952958s) [noise=true , address=104.36.82.37:4684 , piece_id=PV6SS66AY2YJEC2CBYLQ4LQLWUS3KWVPIPPN46OAAFC4ZZQGX5XQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.069016020 (14h5m53.656072261s) [noise=true , address=104.36.82.43:4854 , piece_id=3YYPCYCMQQSKEG5WE6PD3QF5XJI3GN3FIAUNBQDOQ2URBGMHD7AA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.225413177 (14h5m53.812469418s) [upload=14568]: Next returned nil segment Aug 8 06:32:40.225429067 (14h5m53.812485298s) [upload=14568]: Waiting for error group managing segments... Aug 8 06:32:40.238535474 (14h5m53.825591705s) [noise=true , address=104.36.82.61:4404 , piece_id=DF4W6VI4HG7XX444VNPBKGDLK4EYJQZ5SKCZGBV6UNPJGGFA6BEA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.239293129 (14h5m53.826349371s) [noise=true , address=104.36.82.42:4808 , piece_id=5AGVDHXGAVLF6OPWT4KYTW6TFAPDPNADOPZ5C3KXAXRLI4OUNBDQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.241689332 (14h5m53.828745574s) [noise=true , address=104.36.82.23:4457 , piece_id=OOK6SCTGDGEMBOCXSBR2RC5IUS2EYPANIISO2IAPXNRWUFA4ORMQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.242096392 (14h5m53.829152623s) [noise=true , address=104.36.82.45:4938 , piece_id=HYAUM7LFB7YKMLPBHD7PEBP6Y54JMZ2UAJTDTBCP3JAB3IBJHJEQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.242267271 (14h5m53.829323512s) [noise=true , address=104.36.82.58:4273 , piece_id=H6VG6QUSKVNBAJRDQUV4PZIKBFGAM7OIX7BTB4UO5YW6EHVFR2FQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.242818750 (14h5m53.829874981s) [noise=true , address=104.36.82.37:4657 , piece_id=DDJRHIGSD66WQQ3SAPQRKC7RHTHXASXDVNMIKQQDRTWKK5ADIUOQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.243569251 (14h5m53.830625473s) [noise=true , address=104.36.82.38:4693 , piece_id=QPR6POCGGHYGULCXPEOZBBSDBOV5DLTIW6ZUKMGPIJZLB3F3HNJA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.244340481 (14h5m53.831396702s) [noise=true , address=104.36.82.60:4359 , piece_id=PT3LJH7ROPW2UXME5HDMDAHIFPZ3JILDNT6LUTNHYDSNFRRGIR4A, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.244984754 (14h5m53.832040985s) [noise=true , address=104.36.82.43:4854 , piece_id=3YYPCYCMQQSKEG5WE6PD3QF5XJI3GN3FIAUNBQDOQ2URBGMHD7AA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.245524792 (14h5m53.832581023s) [noise=true , address=104.36.82.37:4684 , piece_id=PV6SS66AY2YJEC2CBYLQ4LQLWUS3KWVPIPPN46OAAFC4ZZQGX5XQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.246872779 (14h5m53.83392901s) [noise=true , address=104.36.82.36:4641 , piece_id=R7R33QBSBJUWWKVI2UXEDRKDCOCVYKMYVE2CEWK2MATSBZ3MGJIQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.247331215 (14h5m53.834387456s) [noise=true , address=104.36.82.34:4561 , piece_id=D42SM3LJAAC7HHZWQEYBPWT6NOUQW3VUVHNPAODKKY54CWZWDQBQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.247891481 (14h5m53.834947722s) [noise=true , address=104.36.82.62:4439 , piece_id=CMLMZQQLTVF3KHEIHNQTZAELFG3465HOYKMCK2UDYOQHPROML3SA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.248431108 (14h5m53.835487338s) [noise=true , address=104.36.82.13:4204 , piece_id=WT2WD2ZAU5MBXXNBZFXLOVXMWUFOMPUXOBTOA7P67NE2JIELPZWQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.248441287 (14h5m53.835497528s) [seg_pos={0 0}, upload=14568]: Segment reached optimal threshold of 14 pieces. Aug 8 06:32:40.248563916 (14h5m53.835620157s) [noise=true , address=104.36.82.59:4319 , piece_id=AIU65US456ESICJU42TGN43EC7KRVDXAQA4TXF3LEJ66ZQJSK3TQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hzjVmYJbXH9yCxL2JUotjRKfWtgdUjSQKmPRByQAMjBkHqLRK): protocol: expected piece hash; context canceled; EOF Aug 8 06:32:40.249100268 (14h5m53.836156509s) [noise=true , address=64.49.13.154:4928 , piece_id=QDSHIQMF6WDJQZZKWQZZP4DVKFZUN2JAUVHRJOIZZ4SMNXQLVSZQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: read tcp 5.161.89.252:59898->64.49.13.154:4928: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 06:32:40.249154668 (14h5m53.83621091s) [noise=true , address=64.49.13.27:4963 , piece_id=CEB52PLVGIB2RIXEBBSUJAQQUPGC4U2JVFQ3J7HW3LMRIFWXCAYA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: read tcp 5.161.89.252:44876->64.49.13.27:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 06:32:40.249199352 (14h5m53.836255594s) [noise=true , address=64.49.13.137:4504 , piece_id=UXR3Z5Q6AJWVIA27IZHNPMRTTKLC4ENHVUQHVANK5L3AXOYOOWIA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:11LnrSYf8ZaxUgsdjt6jHzNgHjkq1bFCnDEFd14JzhParNTesZ): protocol: read tcp 5.161.89.252:19204->64.49.13.137:4504: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 06:32:40.249210163 (14h5m53.836266404s) [seg_pos={0 0}, upload=14568]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:32:40.249282678 (14h5m53.836338919s) [upload=14568]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:32:40.249287737 (14h5m53.836343968s) [upload=14568]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:32:40.302341870 (14h5m53.889398111s) [upload=14568]: Done uploading segments... Aug 8 06:32:40.302361056 (14h5m53.889417297s) [upload=14568]: Upload finished. err: <nil> Aug 8 06:33:19.671995961 (14h6m33.259052203s) [upload=14579]: Starting upload Aug 8 06:33:19.672056584 (14h6m33.259112826s) [upload=14579]: Done starting upload Aug 8 06:33:19.672119763 (14h6m33.259175994s) [upload=14579]: Uploading segments... Aug 8 06:33:19.672884900 (14h6m33.259941132s) [upload=14579]: Got next segment. Inline: false Aug 8 06:33:19.672932620 (14h6m33.259988862s) [upload=14579]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:33:19.672937719 (14h6m33.259993961s) [upload=14579]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:33:19.675836631 (14h6m33.262892862s) [upload=14579]: Next segment err: metaclient: Too Many Requests Aug 8 06:33:19.675851759 (14h6m33.262908s) [upload=14579]: Done uploading segments... Aug 8 06:33:19.675865856 (14h6m33.262922097s) [upload=14579]: Upload finished. err: metaclient: Too Many Requests Duration: 385.719264ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 350.83487ms FAIL (2025-08-08 06:40:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== XOBTOA7P67NE2JIELPZWQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065025521 (14h5m53.652081792s) [noise=true , address=104.36.82.23:4457 , piece_id=OOK6SCTGDGEMBOCXSBR2RC5IUS2EYPANIISO2IAPXNRWUFA4ORMQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065205998 (14h5m53.652262239s) [noise=true , address=104.36.82.62:4439 , piece_id=CMLMZQQLTVF3KHEIHNQTZAELFG3465HOYKMCK2UDYOQHPROML3SA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065455032 (14h5m53.652511273s) [noise=true , address=64.49.13.137:4504 , piece_id=UXR3Z5Q6AJWVIA27IZHNPMRTTKLC4ENHVUQHVANK5L3AXOYOOWIA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065786381 (14h5m53.652842622s) [noise=true , address=104.36.82.42:4808 , piece_id=5AGVDHXGAVLF6OPWT4KYTW6TFAPDPNADOPZ5C3KXAXRLI4OUNBDQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065845953 (14h5m53.652902193s) [noise=true , address=104.36.82.58:4273 , piece_id=H6VG6QUSKVNBAJRDQUV4PZIKBFGAM7OIX7BTB4UO5YW6EHVFR2FQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.066263101 (14h5m53.653319342s) [noise=true , address=64.49.13.154:4928 , piece_id=QDSHIQMF6WDJQZZKWQZZP4DVKFZUN2JAUVHRJOIZZ4SMNXQLVSZQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.066327521 (14h5m53.653383763s) [noise=true , address=104.36.82.59:4319 , piece_id=AIU65US456ESICJU42TGN43EC7KRVDXAQA4TXF3LEJ66ZQJSK3TQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.066919006 (14h5m53.653975247s) [noise=true , address=104.36.82.37:4657 , piece_id=DDJRHIGSD66WQQ3SAPQRKC7RHTHXASXDVNMIKQQDRTWKK5ADIUOQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067254953 (14h5m53.654311194s) [noise=true , address=64.49.13.27:4963 , piece_id=CEB52PLVGIB2RIXEBBSUJAQQUPGC4U2JVFQ3J7HW3LMRIFWXCAYA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067466127 (14h5m53.654522368s) [noise=true , address=104.36.82.36:4641 , piece_id=R7R33QBSBJUWWKVI2UXEDRKDCOCVYKMYVE2CEWK2MATSBZ3MGJIQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067873497 (14h5m53.654929738s) [noise=true , address=104.36.82.61:4404 , piece_id=DF4W6VI4HG7XX444VNPBKGDLK4EYJQZ5SKCZGBV6UNPJGGFA6BEA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067987530 (14h5m53.655043771s) [noise=true , address=104.36.82.45:4938 , piece_id=HYAUM7LFB7YKMLPBHD7PEBP6Y54JMZ2UAJTDTBCP3JAB3IBJHJEQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.068356108 (14h5m53.655412349s) [noise=true , address=104.36.82.60:4359 , piece_id=PT3LJH7ROPW2UXME5HDMDAHIFPZ3JILDNT6LUTNHYDSNFRRGIR4A, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.068429946 (14h5m53.655486187s) [noise=true , address=104.36.82.38:4693 , piece_id=QPR6POCGGHYGULCXPEOZBBSDBOV5DLTIW6ZUKMGPIJZLB3F3HNJA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.068896717 (14h5m53.655952958s) [noise=true , address=104.36.82.37:4684 , piece_id=PV6SS66AY2YJEC2CBYLQ4LQLWUS3KWVPIPPN46OAAFC4ZZQGX5XQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.069016020 (14h5m53.656072261s) [noise=true , address=104.36.82.43:4854 , piece_id=3YYPCYCMQQSKEG5WE6PD3QF5XJI3GN3FIAUNBQDOQ2URBGMHD7AA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.225413177 (14h5m53.812469418s) [upload=14568]: Next returned nil segment Aug 8 06:32:40.225429067 (14h5m53.812485298s) [upload=14568]: Waiting for error group managing segments... Aug 8 06:32:40.238535474 (14h5m53.825591705s) [noise=true , address=104.36.82.61:4404 , piece_id=DF4W6VI4HG7XX444VNPBKGDLK4EYJQZ5SKCZGBV6UNPJGGFA6BEA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.239293129 (14h5m53.826349371s) [noise=true , address=104.36.82.42:4808 , piece_id=5AGVDHXGAVLF6OPWT4KYTW6TFAPDPNADOPZ5C3KXAXRLI4OUNBDQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.241689332 (14h5m53.828745574s) [noise=true , address=104.36.82.23:4457 , piece_id=OOK6SCTGDGEMBOCXSBR2RC5IUS2EYPANIISO2IAPXNRWUFA4ORMQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.242096392 (14h5m53.829152623s) [noise=true , address=104.36.82.45:4938 , piece_id=HYAUM7LFB7YKMLPBHD7PEBP6Y54JMZ2UAJTDTBCP3JAB3IBJHJEQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.242267271 (14h5m53.829323512s) [noise=true , address=104.36.82.58:4273 , piece_id=H6VG6QUSKVNBAJRDQUV4PZIKBFGAM7OIX7BTB4UO5YW6EHVFR2FQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.242818750 (14h5m53.829874981s) [noise=true , address=104.36.82.37:4657 , piece_id=DDJRHIGSD66WQQ3SAPQRKC7RHTHXASXDVNMIKQQDRTWKK5ADIUOQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.243569251 (14h5m53.830625473s) [noise=true , address=104.36.82.38:4693 , piece_id=QPR6POCGGHYGULCXPEOZBBSDBOV5DLTIW6ZUKMGPIJZLB3F3HNJA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.244340481 (14h5m53.831396702s) [noise=true , address=104.36.82.60:4359 , piece_id=PT3LJH7ROPW2UXME5HDMDAHIFPZ3JILDNT6LUTNHYDSNFRRGIR4A, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.244984754 (14h5m53.832040985s) [noise=true , address=104.36.82.43:4854 , piece_id=3YYPCYCMQQSKEG5WE6PD3QF5XJI3GN3FIAUNBQDOQ2URBGMHD7AA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.245524792 (14h5m53.832581023s) [noise=true , address=104.36.82.37:4684 , piece_id=PV6SS66AY2YJEC2CBYLQ4LQLWUS3KWVPIPPN46OAAFC4ZZQGX5XQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.246872779 (14h5m53.83392901s) [noise=true , address=104.36.82.36:4641 , piece_id=R7R33QBSBJUWWKVI2UXEDRKDCOCVYKMYVE2CEWK2MATSBZ3MGJIQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.247331215 (14h5m53.834387456s) [noise=true , address=104.36.82.34:4561 , piece_id=D42SM3LJAAC7HHZWQEYBPWT6NOUQW3VUVHNPAODKKY54CWZWDQBQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.247891481 (14h5m53.834947722s) [noise=true , address=104.36.82.62:4439 , piece_id=CMLMZQQLTVF3KHEIHNQTZAELFG3465HOYKMCK2UDYOQHPROML3SA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.248431108 (14h5m53.835487338s) [noise=true , address=104.36.82.13:4204 , piece_id=WT2WD2ZAU5MBXXNBZFXLOVXMWUFOMPUXOBTOA7P67NE2JIELPZWQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.248441287 (14h5m53.835497528s) [seg_pos={0 0}, upload=14568]: Segment reached optimal threshold of 14 pieces. Aug 8 06:32:40.248563916 (14h5m53.835620157s) [noise=true , address=104.36.82.59:4319 , piece_id=AIU65US456ESICJU42TGN43EC7KRVDXAQA4TXF3LEJ66ZQJSK3TQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hzjVmYJbXH9yCxL2JUotjRKfWtgdUjSQKmPRByQAMjBkHqLRK): protocol: expected piece hash; context canceled; EOF Aug 8 06:32:40.249100268 (14h5m53.836156509s) [noise=true , address=64.49.13.154:4928 , piece_id=QDSHIQMF6WDJQZZKWQZZP4DVKFZUN2JAUVHRJOIZZ4SMNXQLVSZQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: read tcp 5.161.89.252:59898->64.49.13.154:4928: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 06:32:40.249154668 (14h5m53.83621091s) [noise=true , address=64.49.13.27:4963 , piece_id=CEB52PLVGIB2RIXEBBSUJAQQUPGC4U2JVFQ3J7HW3LMRIFWXCAYA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: read tcp 5.161.89.252:44876->64.49.13.27:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 06:32:40.249199352 (14h5m53.836255594s) [noise=true , address=64.49.13.137:4504 , piece_id=UXR3Z5Q6AJWVIA27IZHNPMRTTKLC4ENHVUQHVANK5L3AXOYOOWIA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:11LnrSYf8ZaxUgsdjt6jHzNgHjkq1bFCnDEFd14JzhParNTesZ): protocol: read tcp 5.161.89.252:19204->64.49.13.137:4504: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 06:32:40.249210163 (14h5m53.836266404s) [seg_pos={0 0}, upload=14568]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:32:40.249282678 (14h5m53.836338919s) [upload=14568]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:32:40.249287737 (14h5m53.836343968s) [upload=14568]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:32:40.302341870 (14h5m53.889398111s) [upload=14568]: Done uploading segments... Aug 8 06:32:40.302361056 (14h5m53.889417297s) [upload=14568]: Upload finished. err: <nil> Aug 8 06:33:19.671995961 (14h6m33.259052203s) [upload=14579]: Starting upload Aug 8 06:33:19.672056584 (14h6m33.259112826s) [upload=14579]: Done starting upload Aug 8 06:33:19.672119763 (14h6m33.259175994s) [upload=14579]: Uploading segments... Aug 8 06:33:19.672884900 (14h6m33.259941132s) [upload=14579]: Got next segment. Inline: false Aug 8 06:33:19.672932620 (14h6m33.259988862s) [upload=14579]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:33:19.672937719 (14h6m33.259993961s) [upload=14579]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:33:19.675836631 (14h6m33.262892862s) [upload=14579]: Next segment err: metaclient: Too Many Requests Aug 8 06:33:19.675851759 (14h6m33.262908s) [upload=14579]: Done uploading segments... Aug 8 06:33:19.675865856 (14h6m33.262922097s) [upload=14579]: Upload finished. err: metaclient: Too Many Requests Duration: 350.857893ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 406.181505ms FAIL (2025-08-08 06:39:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== XOBTOA7P67NE2JIELPZWQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065025521 (14h5m53.652081792s) [noise=true , address=104.36.82.23:4457 , piece_id=OOK6SCTGDGEMBOCXSBR2RC5IUS2EYPANIISO2IAPXNRWUFA4ORMQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065205998 (14h5m53.652262239s) [noise=true , address=104.36.82.62:4439 , piece_id=CMLMZQQLTVF3KHEIHNQTZAELFG3465HOYKMCK2UDYOQHPROML3SA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065455032 (14h5m53.652511273s) [noise=true , address=64.49.13.137:4504 , piece_id=UXR3Z5Q6AJWVIA27IZHNPMRTTKLC4ENHVUQHVANK5L3AXOYOOWIA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065786381 (14h5m53.652842622s) [noise=true , address=104.36.82.42:4808 , piece_id=5AGVDHXGAVLF6OPWT4KYTW6TFAPDPNADOPZ5C3KXAXRLI4OUNBDQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065845953 (14h5m53.652902193s) [noise=true , address=104.36.82.58:4273 , piece_id=H6VG6QUSKVNBAJRDQUV4PZIKBFGAM7OIX7BTB4UO5YW6EHVFR2FQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.066263101 (14h5m53.653319342s) [noise=true , address=64.49.13.154:4928 , piece_id=QDSHIQMF6WDJQZZKWQZZP4DVKFZUN2JAUVHRJOIZZ4SMNXQLVSZQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.066327521 (14h5m53.653383763s) [noise=true , address=104.36.82.59:4319 , piece_id=AIU65US456ESICJU42TGN43EC7KRVDXAQA4TXF3LEJ66ZQJSK3TQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.066919006 (14h5m53.653975247s) [noise=true , address=104.36.82.37:4657 , piece_id=DDJRHIGSD66WQQ3SAPQRKC7RHTHXASXDVNMIKQQDRTWKK5ADIUOQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067254953 (14h5m53.654311194s) [noise=true , address=64.49.13.27:4963 , piece_id=CEB52PLVGIB2RIXEBBSUJAQQUPGC4U2JVFQ3J7HW3LMRIFWXCAYA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067466127 (14h5m53.654522368s) [noise=true , address=104.36.82.36:4641 , piece_id=R7R33QBSBJUWWKVI2UXEDRKDCOCVYKMYVE2CEWK2MATSBZ3MGJIQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067873497 (14h5m53.654929738s) [noise=true , address=104.36.82.61:4404 , piece_id=DF4W6VI4HG7XX444VNPBKGDLK4EYJQZ5SKCZGBV6UNPJGGFA6BEA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067987530 (14h5m53.655043771s) [noise=true , address=104.36.82.45:4938 , piece_id=HYAUM7LFB7YKMLPBHD7PEBP6Y54JMZ2UAJTDTBCP3JAB3IBJHJEQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.068356108 (14h5m53.655412349s) [noise=true , address=104.36.82.60:4359 , piece_id=PT3LJH7ROPW2UXME5HDMDAHIFPZ3JILDNT6LUTNHYDSNFRRGIR4A, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.068429946 (14h5m53.655486187s) [noise=true , address=104.36.82.38:4693 , piece_id=QPR6POCGGHYGULCXPEOZBBSDBOV5DLTIW6ZUKMGPIJZLB3F3HNJA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.068896717 (14h5m53.655952958s) [noise=true , address=104.36.82.37:4684 , piece_id=PV6SS66AY2YJEC2CBYLQ4LQLWUS3KWVPIPPN46OAAFC4ZZQGX5XQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.069016020 (14h5m53.656072261s) [noise=true , address=104.36.82.43:4854 , piece_id=3YYPCYCMQQSKEG5WE6PD3QF5XJI3GN3FIAUNBQDOQ2URBGMHD7AA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.225413177 (14h5m53.812469418s) [upload=14568]: Next returned nil segment Aug 8 06:32:40.225429067 (14h5m53.812485298s) [upload=14568]: Waiting for error group managing segments... Aug 8 06:32:40.238535474 (14h5m53.825591705s) [noise=true , address=104.36.82.61:4404 , piece_id=DF4W6VI4HG7XX444VNPBKGDLK4EYJQZ5SKCZGBV6UNPJGGFA6BEA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.239293129 (14h5m53.826349371s) [noise=true , address=104.36.82.42:4808 , piece_id=5AGVDHXGAVLF6OPWT4KYTW6TFAPDPNADOPZ5C3KXAXRLI4OUNBDQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.241689332 (14h5m53.828745574s) [noise=true , address=104.36.82.23:4457 , piece_id=OOK6SCTGDGEMBOCXSBR2RC5IUS2EYPANIISO2IAPXNRWUFA4ORMQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.242096392 (14h5m53.829152623s) [noise=true , address=104.36.82.45:4938 , piece_id=HYAUM7LFB7YKMLPBHD7PEBP6Y54JMZ2UAJTDTBCP3JAB3IBJHJEQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.242267271 (14h5m53.829323512s) [noise=true , address=104.36.82.58:4273 , piece_id=H6VG6QUSKVNBAJRDQUV4PZIKBFGAM7OIX7BTB4UO5YW6EHVFR2FQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.242818750 (14h5m53.829874981s) [noise=true , address=104.36.82.37:4657 , piece_id=DDJRHIGSD66WQQ3SAPQRKC7RHTHXASXDVNMIKQQDRTWKK5ADIUOQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.243569251 (14h5m53.830625473s) [noise=true , address=104.36.82.38:4693 , piece_id=QPR6POCGGHYGULCXPEOZBBSDBOV5DLTIW6ZUKMGPIJZLB3F3HNJA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.244340481 (14h5m53.831396702s) [noise=true , address=104.36.82.60:4359 , piece_id=PT3LJH7ROPW2UXME5HDMDAHIFPZ3JILDNT6LUTNHYDSNFRRGIR4A, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.244984754 (14h5m53.832040985s) [noise=true , address=104.36.82.43:4854 , piece_id=3YYPCYCMQQSKEG5WE6PD3QF5XJI3GN3FIAUNBQDOQ2URBGMHD7AA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.245524792 (14h5m53.832581023s) [noise=true , address=104.36.82.37:4684 , piece_id=PV6SS66AY2YJEC2CBYLQ4LQLWUS3KWVPIPPN46OAAFC4ZZQGX5XQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.246872779 (14h5m53.83392901s) [noise=true , address=104.36.82.36:4641 , piece_id=R7R33QBSBJUWWKVI2UXEDRKDCOCVYKMYVE2CEWK2MATSBZ3MGJIQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.247331215 (14h5m53.834387456s) [noise=true , address=104.36.82.34:4561 , piece_id=D42SM3LJAAC7HHZWQEYBPWT6NOUQW3VUVHNPAODKKY54CWZWDQBQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.247891481 (14h5m53.834947722s) [noise=true , address=104.36.82.62:4439 , piece_id=CMLMZQQLTVF3KHEIHNQTZAELFG3465HOYKMCK2UDYOQHPROML3SA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.248431108 (14h5m53.835487338s) [noise=true , address=104.36.82.13:4204 , piece_id=WT2WD2ZAU5MBXXNBZFXLOVXMWUFOMPUXOBTOA7P67NE2JIELPZWQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.248441287 (14h5m53.835497528s) [seg_pos={0 0}, upload=14568]: Segment reached optimal threshold of 14 pieces. Aug 8 06:32:40.248563916 (14h5m53.835620157s) [noise=true , address=104.36.82.59:4319 , piece_id=AIU65US456ESICJU42TGN43EC7KRVDXAQA4TXF3LEJ66ZQJSK3TQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hzjVmYJbXH9yCxL2JUotjRKfWtgdUjSQKmPRByQAMjBkHqLRK): protocol: expected piece hash; context canceled; EOF Aug 8 06:32:40.249100268 (14h5m53.836156509s) [noise=true , address=64.49.13.154:4928 , piece_id=QDSHIQMF6WDJQZZKWQZZP4DVKFZUN2JAUVHRJOIZZ4SMNXQLVSZQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: read tcp 5.161.89.252:59898->64.49.13.154:4928: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 06:32:40.249154668 (14h5m53.83621091s) [noise=true , address=64.49.13.27:4963 , piece_id=CEB52PLVGIB2RIXEBBSUJAQQUPGC4U2JVFQ3J7HW3LMRIFWXCAYA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: read tcp 5.161.89.252:44876->64.49.13.27:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 06:32:40.249199352 (14h5m53.836255594s) [noise=true , address=64.49.13.137:4504 , piece_id=UXR3Z5Q6AJWVIA27IZHNPMRTTKLC4ENHVUQHVANK5L3AXOYOOWIA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:11LnrSYf8ZaxUgsdjt6jHzNgHjkq1bFCnDEFd14JzhParNTesZ): protocol: read tcp 5.161.89.252:19204->64.49.13.137:4504: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 06:32:40.249210163 (14h5m53.836266404s) [seg_pos={0 0}, upload=14568]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:32:40.249282678 (14h5m53.836338919s) [upload=14568]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:32:40.249287737 (14h5m53.836343968s) [upload=14568]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:32:40.302341870 (14h5m53.889398111s) [upload=14568]: Done uploading segments... Aug 8 06:32:40.302361056 (14h5m53.889417297s) [upload=14568]: Upload finished. err: <nil> Aug 8 06:33:19.671995961 (14h6m33.259052203s) [upload=14579]: Starting upload Aug 8 06:33:19.672056584 (14h6m33.259112826s) [upload=14579]: Done starting upload Aug 8 06:33:19.672119763 (14h6m33.259175994s) [upload=14579]: Uploading segments... Aug 8 06:33:19.672884900 (14h6m33.259941132s) [upload=14579]: Got next segment. Inline: false Aug 8 06:33:19.672932620 (14h6m33.259988862s) [upload=14579]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:33:19.672937719 (14h6m33.259993961s) [upload=14579]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:33:19.675836631 (14h6m33.262892862s) [upload=14579]: Next segment err: metaclient: Too Many Requests Aug 8 06:33:19.675851759 (14h6m33.262908s) [upload=14579]: Done uploading segments... Aug 8 06:33:19.675865856 (14h6m33.262922097s) [upload=14579]: Upload finished. err: metaclient: Too Many Requests Duration: 406.215507ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 732.278242ms FAIL (2025-08-08 06:38:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== XOBTOA7P67NE2JIELPZWQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065025521 (14h5m53.652081792s) [noise=true , address=104.36.82.23:4457 , piece_id=OOK6SCTGDGEMBOCXSBR2RC5IUS2EYPANIISO2IAPXNRWUFA4ORMQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065205998 (14h5m53.652262239s) [noise=true , address=104.36.82.62:4439 , piece_id=CMLMZQQLTVF3KHEIHNQTZAELFG3465HOYKMCK2UDYOQHPROML3SA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065455032 (14h5m53.652511273s) [noise=true , address=64.49.13.137:4504 , piece_id=UXR3Z5Q6AJWVIA27IZHNPMRTTKLC4ENHVUQHVANK5L3AXOYOOWIA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065786381 (14h5m53.652842622s) [noise=true , address=104.36.82.42:4808 , piece_id=5AGVDHXGAVLF6OPWT4KYTW6TFAPDPNADOPZ5C3KXAXRLI4OUNBDQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065845953 (14h5m53.652902193s) [noise=true , address=104.36.82.58:4273 , piece_id=H6VG6QUSKVNBAJRDQUV4PZIKBFGAM7OIX7BTB4UO5YW6EHVFR2FQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.066263101 (14h5m53.653319342s) [noise=true , address=64.49.13.154:4928 , piece_id=QDSHIQMF6WDJQZZKWQZZP4DVKFZUN2JAUVHRJOIZZ4SMNXQLVSZQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.066327521 (14h5m53.653383763s) [noise=true , address=104.36.82.59:4319 , piece_id=AIU65US456ESICJU42TGN43EC7KRVDXAQA4TXF3LEJ66ZQJSK3TQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.066919006 (14h5m53.653975247s) [noise=true , address=104.36.82.37:4657 , piece_id=DDJRHIGSD66WQQ3SAPQRKC7RHTHXASXDVNMIKQQDRTWKK5ADIUOQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067254953 (14h5m53.654311194s) [noise=true , address=64.49.13.27:4963 , piece_id=CEB52PLVGIB2RIXEBBSUJAQQUPGC4U2JVFQ3J7HW3LMRIFWXCAYA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067466127 (14h5m53.654522368s) [noise=true , address=104.36.82.36:4641 , piece_id=R7R33QBSBJUWWKVI2UXEDRKDCOCVYKMYVE2CEWK2MATSBZ3MGJIQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067873497 (14h5m53.654929738s) [noise=true , address=104.36.82.61:4404 , piece_id=DF4W6VI4HG7XX444VNPBKGDLK4EYJQZ5SKCZGBV6UNPJGGFA6BEA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067987530 (14h5m53.655043771s) [noise=true , address=104.36.82.45:4938 , piece_id=HYAUM7LFB7YKMLPBHD7PEBP6Y54JMZ2UAJTDTBCP3JAB3IBJHJEQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.068356108 (14h5m53.655412349s) [noise=true , address=104.36.82.60:4359 , piece_id=PT3LJH7ROPW2UXME5HDMDAHIFPZ3JILDNT6LUTNHYDSNFRRGIR4A, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.068429946 (14h5m53.655486187s) [noise=true , address=104.36.82.38:4693 , piece_id=QPR6POCGGHYGULCXPEOZBBSDBOV5DLTIW6ZUKMGPIJZLB3F3HNJA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.068896717 (14h5m53.655952958s) [noise=true , address=104.36.82.37:4684 , piece_id=PV6SS66AY2YJEC2CBYLQ4LQLWUS3KWVPIPPN46OAAFC4ZZQGX5XQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.069016020 (14h5m53.656072261s) [noise=true , address=104.36.82.43:4854 , piece_id=3YYPCYCMQQSKEG5WE6PD3QF5XJI3GN3FIAUNBQDOQ2URBGMHD7AA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.225413177 (14h5m53.812469418s) [upload=14568]: Next returned nil segment Aug 8 06:32:40.225429067 (14h5m53.812485298s) [upload=14568]: Waiting for error group managing segments... Aug 8 06:32:40.238535474 (14h5m53.825591705s) [noise=true , address=104.36.82.61:4404 , piece_id=DF4W6VI4HG7XX444VNPBKGDLK4EYJQZ5SKCZGBV6UNPJGGFA6BEA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.239293129 (14h5m53.826349371s) [noise=true , address=104.36.82.42:4808 , piece_id=5AGVDHXGAVLF6OPWT4KYTW6TFAPDPNADOPZ5C3KXAXRLI4OUNBDQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.241689332 (14h5m53.828745574s) [noise=true , address=104.36.82.23:4457 , piece_id=OOK6SCTGDGEMBOCXSBR2RC5IUS2EYPANIISO2IAPXNRWUFA4ORMQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.242096392 (14h5m53.829152623s) [noise=true , address=104.36.82.45:4938 , piece_id=HYAUM7LFB7YKMLPBHD7PEBP6Y54JMZ2UAJTDTBCP3JAB3IBJHJEQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.242267271 (14h5m53.829323512s) [noise=true , address=104.36.82.58:4273 , piece_id=H6VG6QUSKVNBAJRDQUV4PZIKBFGAM7OIX7BTB4UO5YW6EHVFR2FQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.242818750 (14h5m53.829874981s) [noise=true , address=104.36.82.37:4657 , piece_id=DDJRHIGSD66WQQ3SAPQRKC7RHTHXASXDVNMIKQQDRTWKK5ADIUOQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.243569251 (14h5m53.830625473s) [noise=true , address=104.36.82.38:4693 , piece_id=QPR6POCGGHYGULCXPEOZBBSDBOV5DLTIW6ZUKMGPIJZLB3F3HNJA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.244340481 (14h5m53.831396702s) [noise=true , address=104.36.82.60:4359 , piece_id=PT3LJH7ROPW2UXME5HDMDAHIFPZ3JILDNT6LUTNHYDSNFRRGIR4A, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.244984754 (14h5m53.832040985s) [noise=true , address=104.36.82.43:4854 , piece_id=3YYPCYCMQQSKEG5WE6PD3QF5XJI3GN3FIAUNBQDOQ2URBGMHD7AA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.245524792 (14h5m53.832581023s) [noise=true , address=104.36.82.37:4684 , piece_id=PV6SS66AY2YJEC2CBYLQ4LQLWUS3KWVPIPPN46OAAFC4ZZQGX5XQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.246872779 (14h5m53.83392901s) [noise=true , address=104.36.82.36:4641 , piece_id=R7R33QBSBJUWWKVI2UXEDRKDCOCVYKMYVE2CEWK2MATSBZ3MGJIQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.247331215 (14h5m53.834387456s) [noise=true , address=104.36.82.34:4561 , piece_id=D42SM3LJAAC7HHZWQEYBPWT6NOUQW3VUVHNPAODKKY54CWZWDQBQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.247891481 (14h5m53.834947722s) [noise=true , address=104.36.82.62:4439 , piece_id=CMLMZQQLTVF3KHEIHNQTZAELFG3465HOYKMCK2UDYOQHPROML3SA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.248431108 (14h5m53.835487338s) [noise=true , address=104.36.82.13:4204 , piece_id=WT2WD2ZAU5MBXXNBZFXLOVXMWUFOMPUXOBTOA7P67NE2JIELPZWQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.248441287 (14h5m53.835497528s) [seg_pos={0 0}, upload=14568]: Segment reached optimal threshold of 14 pieces. Aug 8 06:32:40.248563916 (14h5m53.835620157s) [noise=true , address=104.36.82.59:4319 , piece_id=AIU65US456ESICJU42TGN43EC7KRVDXAQA4TXF3LEJ66ZQJSK3TQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hzjVmYJbXH9yCxL2JUotjRKfWtgdUjSQKmPRByQAMjBkHqLRK): protocol: expected piece hash; context canceled; EOF Aug 8 06:32:40.249100268 (14h5m53.836156509s) [noise=true , address=64.49.13.154:4928 , piece_id=QDSHIQMF6WDJQZZKWQZZP4DVKFZUN2JAUVHRJOIZZ4SMNXQLVSZQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: read tcp 5.161.89.252:59898->64.49.13.154:4928: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 06:32:40.249154668 (14h5m53.83621091s) [noise=true , address=64.49.13.27:4963 , piece_id=CEB52PLVGIB2RIXEBBSUJAQQUPGC4U2JVFQ3J7HW3LMRIFWXCAYA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: read tcp 5.161.89.252:44876->64.49.13.27:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 06:32:40.249199352 (14h5m53.836255594s) [noise=true , address=64.49.13.137:4504 , piece_id=UXR3Z5Q6AJWVIA27IZHNPMRTTKLC4ENHVUQHVANK5L3AXOYOOWIA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:11LnrSYf8ZaxUgsdjt6jHzNgHjkq1bFCnDEFd14JzhParNTesZ): protocol: read tcp 5.161.89.252:19204->64.49.13.137:4504: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 06:32:40.249210163 (14h5m53.836266404s) [seg_pos={0 0}, upload=14568]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:32:40.249282678 (14h5m53.836338919s) [upload=14568]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:32:40.249287737 (14h5m53.836343968s) [upload=14568]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:32:40.302341870 (14h5m53.889398111s) [upload=14568]: Done uploading segments... Aug 8 06:32:40.302361056 (14h5m53.889417297s) [upload=14568]: Upload finished. err: <nil> Aug 8 06:33:19.671995961 (14h6m33.259052203s) [upload=14579]: Starting upload Aug 8 06:33:19.672056584 (14h6m33.259112826s) [upload=14579]: Done starting upload Aug 8 06:33:19.672119763 (14h6m33.259175994s) [upload=14579]: Uploading segments... Aug 8 06:33:19.672884900 (14h6m33.259941132s) [upload=14579]: Got next segment. Inline: false Aug 8 06:33:19.672932620 (14h6m33.259988862s) [upload=14579]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:33:19.672937719 (14h6m33.259993961s) [upload=14579]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:33:19.675836631 (14h6m33.262892862s) [upload=14579]: Next segment err: metaclient: Too Many Requests Aug 8 06:33:19.675851759 (14h6m33.262908s) [upload=14579]: Done uploading segments... Aug 8 06:33:19.675865856 (14h6m33.262922097s) [upload=14579]: Upload finished. err: metaclient: Too Many Requests Duration: 732.305432ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 411.77171ms FAIL (2025-08-08 06:38:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== XOBTOA7P67NE2JIELPZWQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065025521 (14h5m53.652081792s) [noise=true , address=104.36.82.23:4457 , piece_id=OOK6SCTGDGEMBOCXSBR2RC5IUS2EYPANIISO2IAPXNRWUFA4ORMQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065205998 (14h5m53.652262239s) [noise=true , address=104.36.82.62:4439 , piece_id=CMLMZQQLTVF3KHEIHNQTZAELFG3465HOYKMCK2UDYOQHPROML3SA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065455032 (14h5m53.652511273s) [noise=true , address=64.49.13.137:4504 , piece_id=UXR3Z5Q6AJWVIA27IZHNPMRTTKLC4ENHVUQHVANK5L3AXOYOOWIA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065786381 (14h5m53.652842622s) [noise=true , address=104.36.82.42:4808 , piece_id=5AGVDHXGAVLF6OPWT4KYTW6TFAPDPNADOPZ5C3KXAXRLI4OUNBDQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065845953 (14h5m53.652902193s) [noise=true , address=104.36.82.58:4273 , piece_id=H6VG6QUSKVNBAJRDQUV4PZIKBFGAM7OIX7BTB4UO5YW6EHVFR2FQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.066263101 (14h5m53.653319342s) [noise=true , address=64.49.13.154:4928 , piece_id=QDSHIQMF6WDJQZZKWQZZP4DVKFZUN2JAUVHRJOIZZ4SMNXQLVSZQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.066327521 (14h5m53.653383763s) [noise=true , address=104.36.82.59:4319 , piece_id=AIU65US456ESICJU42TGN43EC7KRVDXAQA4TXF3LEJ66ZQJSK3TQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.066919006 (14h5m53.653975247s) [noise=true , address=104.36.82.37:4657 , piece_id=DDJRHIGSD66WQQ3SAPQRKC7RHTHXASXDVNMIKQQDRTWKK5ADIUOQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067254953 (14h5m53.654311194s) [noise=true , address=64.49.13.27:4963 , piece_id=CEB52PLVGIB2RIXEBBSUJAQQUPGC4U2JVFQ3J7HW3LMRIFWXCAYA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067466127 (14h5m53.654522368s) [noise=true , address=104.36.82.36:4641 , piece_id=R7R33QBSBJUWWKVI2UXEDRKDCOCVYKMYVE2CEWK2MATSBZ3MGJIQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067873497 (14h5m53.654929738s) [noise=true , address=104.36.82.61:4404 , piece_id=DF4W6VI4HG7XX444VNPBKGDLK4EYJQZ5SKCZGBV6UNPJGGFA6BEA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067987530 (14h5m53.655043771s) [noise=true , address=104.36.82.45:4938 , piece_id=HYAUM7LFB7YKMLPBHD7PEBP6Y54JMZ2UAJTDTBCP3JAB3IBJHJEQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.068356108 (14h5m53.655412349s) [noise=true , address=104.36.82.60:4359 , piece_id=PT3LJH7ROPW2UXME5HDMDAHIFPZ3JILDNT6LUTNHYDSNFRRGIR4A, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.068429946 (14h5m53.655486187s) [noise=true , address=104.36.82.38:4693 , piece_id=QPR6POCGGHYGULCXPEOZBBSDBOV5DLTIW6ZUKMGPIJZLB3F3HNJA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.068896717 (14h5m53.655952958s) [noise=true , address=104.36.82.37:4684 , piece_id=PV6SS66AY2YJEC2CBYLQ4LQLWUS3KWVPIPPN46OAAFC4ZZQGX5XQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.069016020 (14h5m53.656072261s) [noise=true , address=104.36.82.43:4854 , piece_id=3YYPCYCMQQSKEG5WE6PD3QF5XJI3GN3FIAUNBQDOQ2URBGMHD7AA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.225413177 (14h5m53.812469418s) [upload=14568]: Next returned nil segment Aug 8 06:32:40.225429067 (14h5m53.812485298s) [upload=14568]: Waiting for error group managing segments... Aug 8 06:32:40.238535474 (14h5m53.825591705s) [noise=true , address=104.36.82.61:4404 , piece_id=DF4W6VI4HG7XX444VNPBKGDLK4EYJQZ5SKCZGBV6UNPJGGFA6BEA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.239293129 (14h5m53.826349371s) [noise=true , address=104.36.82.42:4808 , piece_id=5AGVDHXGAVLF6OPWT4KYTW6TFAPDPNADOPZ5C3KXAXRLI4OUNBDQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.241689332 (14h5m53.828745574s) [noise=true , address=104.36.82.23:4457 , piece_id=OOK6SCTGDGEMBOCXSBR2RC5IUS2EYPANIISO2IAPXNRWUFA4ORMQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.242096392 (14h5m53.829152623s) [noise=true , address=104.36.82.45:4938 , piece_id=HYAUM7LFB7YKMLPBHD7PEBP6Y54JMZ2UAJTDTBCP3JAB3IBJHJEQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.242267271 (14h5m53.829323512s) [noise=true , address=104.36.82.58:4273 , piece_id=H6VG6QUSKVNBAJRDQUV4PZIKBFGAM7OIX7BTB4UO5YW6EHVFR2FQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.242818750 (14h5m53.829874981s) [noise=true , address=104.36.82.37:4657 , piece_id=DDJRHIGSD66WQQ3SAPQRKC7RHTHXASXDVNMIKQQDRTWKK5ADIUOQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.243569251 (14h5m53.830625473s) [noise=true , address=104.36.82.38:4693 , piece_id=QPR6POCGGHYGULCXPEOZBBSDBOV5DLTIW6ZUKMGPIJZLB3F3HNJA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.244340481 (14h5m53.831396702s) [noise=true , address=104.36.82.60:4359 , piece_id=PT3LJH7ROPW2UXME5HDMDAHIFPZ3JILDNT6LUTNHYDSNFRRGIR4A, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.244984754 (14h5m53.832040985s) [noise=true , address=104.36.82.43:4854 , piece_id=3YYPCYCMQQSKEG5WE6PD3QF5XJI3GN3FIAUNBQDOQ2URBGMHD7AA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.245524792 (14h5m53.832581023s) [noise=true , address=104.36.82.37:4684 , piece_id=PV6SS66AY2YJEC2CBYLQ4LQLWUS3KWVPIPPN46OAAFC4ZZQGX5XQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.246872779 (14h5m53.83392901s) [noise=true , address=104.36.82.36:4641 , piece_id=R7R33QBSBJUWWKVI2UXEDRKDCOCVYKMYVE2CEWK2MATSBZ3MGJIQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.247331215 (14h5m53.834387456s) [noise=true , address=104.36.82.34:4561 , piece_id=D42SM3LJAAC7HHZWQEYBPWT6NOUQW3VUVHNPAODKKY54CWZWDQBQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.247891481 (14h5m53.834947722s) [noise=true , address=104.36.82.62:4439 , piece_id=CMLMZQQLTVF3KHEIHNQTZAELFG3465HOYKMCK2UDYOQHPROML3SA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.248431108 (14h5m53.835487338s) [noise=true , address=104.36.82.13:4204 , piece_id=WT2WD2ZAU5MBXXNBZFXLOVXMWUFOMPUXOBTOA7P67NE2JIELPZWQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.248441287 (14h5m53.835497528s) [seg_pos={0 0}, upload=14568]: Segment reached optimal threshold of 14 pieces. Aug 8 06:32:40.248563916 (14h5m53.835620157s) [noise=true , address=104.36.82.59:4319 , piece_id=AIU65US456ESICJU42TGN43EC7KRVDXAQA4TXF3LEJ66ZQJSK3TQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hzjVmYJbXH9yCxL2JUotjRKfWtgdUjSQKmPRByQAMjBkHqLRK): protocol: expected piece hash; context canceled; EOF Aug 8 06:32:40.249100268 (14h5m53.836156509s) [noise=true , address=64.49.13.154:4928 , piece_id=QDSHIQMF6WDJQZZKWQZZP4DVKFZUN2JAUVHRJOIZZ4SMNXQLVSZQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: read tcp 5.161.89.252:59898->64.49.13.154:4928: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 06:32:40.249154668 (14h5m53.83621091s) [noise=true , address=64.49.13.27:4963 , piece_id=CEB52PLVGIB2RIXEBBSUJAQQUPGC4U2JVFQ3J7HW3LMRIFWXCAYA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: read tcp 5.161.89.252:44876->64.49.13.27:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 06:32:40.249199352 (14h5m53.836255594s) [noise=true , address=64.49.13.137:4504 , piece_id=UXR3Z5Q6AJWVIA27IZHNPMRTTKLC4ENHVUQHVANK5L3AXOYOOWIA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:11LnrSYf8ZaxUgsdjt6jHzNgHjkq1bFCnDEFd14JzhParNTesZ): protocol: read tcp 5.161.89.252:19204->64.49.13.137:4504: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 06:32:40.249210163 (14h5m53.836266404s) [seg_pos={0 0}, upload=14568]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:32:40.249282678 (14h5m53.836338919s) [upload=14568]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:32:40.249287737 (14h5m53.836343968s) [upload=14568]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:32:40.302341870 (14h5m53.889398111s) [upload=14568]: Done uploading segments... Aug 8 06:32:40.302361056 (14h5m53.889417297s) [upload=14568]: Upload finished. err: <nil> Aug 8 06:33:19.671995961 (14h6m33.259052203s) [upload=14579]: Starting upload Aug 8 06:33:19.672056584 (14h6m33.259112826s) [upload=14579]: Done starting upload Aug 8 06:33:19.672119763 (14h6m33.259175994s) [upload=14579]: Uploading segments... Aug 8 06:33:19.672884900 (14h6m33.259941132s) [upload=14579]: Got next segment. Inline: false Aug 8 06:33:19.672932620 (14h6m33.259988862s) [upload=14579]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:33:19.672937719 (14h6m33.259993961s) [upload=14579]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:33:19.675836631 (14h6m33.262892862s) [upload=14579]: Next segment err: metaclient: Too Many Requests Aug 8 06:33:19.675851759 (14h6m33.262908s) [upload=14579]: Done uploading segments... Aug 8 06:33:19.675865856 (14h6m33.262922097s) [upload=14579]: Upload finished. err: metaclient: Too Many Requests Duration: 411.801685ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 381.975534ms FAIL (2025-08-08 06:37:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== XOBTOA7P67NE2JIELPZWQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065025521 (14h5m53.652081792s) [noise=true , address=104.36.82.23:4457 , piece_id=OOK6SCTGDGEMBOCXSBR2RC5IUS2EYPANIISO2IAPXNRWUFA4ORMQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065205998 (14h5m53.652262239s) [noise=true , address=104.36.82.62:4439 , piece_id=CMLMZQQLTVF3KHEIHNQTZAELFG3465HOYKMCK2UDYOQHPROML3SA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065455032 (14h5m53.652511273s) [noise=true , address=64.49.13.137:4504 , piece_id=UXR3Z5Q6AJWVIA27IZHNPMRTTKLC4ENHVUQHVANK5L3AXOYOOWIA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065786381 (14h5m53.652842622s) [noise=true , address=104.36.82.42:4808 , piece_id=5AGVDHXGAVLF6OPWT4KYTW6TFAPDPNADOPZ5C3KXAXRLI4OUNBDQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065845953 (14h5m53.652902193s) [noise=true , address=104.36.82.58:4273 , piece_id=H6VG6QUSKVNBAJRDQUV4PZIKBFGAM7OIX7BTB4UO5YW6EHVFR2FQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.066263101 (14h5m53.653319342s) [noise=true , address=64.49.13.154:4928 , piece_id=QDSHIQMF6WDJQZZKWQZZP4DVKFZUN2JAUVHRJOIZZ4SMNXQLVSZQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.066327521 (14h5m53.653383763s) [noise=true , address=104.36.82.59:4319 , piece_id=AIU65US456ESICJU42TGN43EC7KRVDXAQA4TXF3LEJ66ZQJSK3TQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.066919006 (14h5m53.653975247s) [noise=true , address=104.36.82.37:4657 , piece_id=DDJRHIGSD66WQQ3SAPQRKC7RHTHXASXDVNMIKQQDRTWKK5ADIUOQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067254953 (14h5m53.654311194s) [noise=true , address=64.49.13.27:4963 , piece_id=CEB52PLVGIB2RIXEBBSUJAQQUPGC4U2JVFQ3J7HW3LMRIFWXCAYA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067466127 (14h5m53.654522368s) [noise=true , address=104.36.82.36:4641 , piece_id=R7R33QBSBJUWWKVI2UXEDRKDCOCVYKMYVE2CEWK2MATSBZ3MGJIQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067873497 (14h5m53.654929738s) [noise=true , address=104.36.82.61:4404 , piece_id=DF4W6VI4HG7XX444VNPBKGDLK4EYJQZ5SKCZGBV6UNPJGGFA6BEA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067987530 (14h5m53.655043771s) [noise=true , address=104.36.82.45:4938 , piece_id=HYAUM7LFB7YKMLPBHD7PEBP6Y54JMZ2UAJTDTBCP3JAB3IBJHJEQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.068356108 (14h5m53.655412349s) [noise=true , address=104.36.82.60:4359 , piece_id=PT3LJH7ROPW2UXME5HDMDAHIFPZ3JILDNT6LUTNHYDSNFRRGIR4A, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.068429946 (14h5m53.655486187s) [noise=true , address=104.36.82.38:4693 , piece_id=QPR6POCGGHYGULCXPEOZBBSDBOV5DLTIW6ZUKMGPIJZLB3F3HNJA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.068896717 (14h5m53.655952958s) [noise=true , address=104.36.82.37:4684 , piece_id=PV6SS66AY2YJEC2CBYLQ4LQLWUS3KWVPIPPN46OAAFC4ZZQGX5XQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.069016020 (14h5m53.656072261s) [noise=true , address=104.36.82.43:4854 , piece_id=3YYPCYCMQQSKEG5WE6PD3QF5XJI3GN3FIAUNBQDOQ2URBGMHD7AA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.225413177 (14h5m53.812469418s) [upload=14568]: Next returned nil segment Aug 8 06:32:40.225429067 (14h5m53.812485298s) [upload=14568]: Waiting for error group managing segments... Aug 8 06:32:40.238535474 (14h5m53.825591705s) [noise=true , address=104.36.82.61:4404 , piece_id=DF4W6VI4HG7XX444VNPBKGDLK4EYJQZ5SKCZGBV6UNPJGGFA6BEA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.239293129 (14h5m53.826349371s) [noise=true , address=104.36.82.42:4808 , piece_id=5AGVDHXGAVLF6OPWT4KYTW6TFAPDPNADOPZ5C3KXAXRLI4OUNBDQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.241689332 (14h5m53.828745574s) [noise=true , address=104.36.82.23:4457 , piece_id=OOK6SCTGDGEMBOCXSBR2RC5IUS2EYPANIISO2IAPXNRWUFA4ORMQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.242096392 (14h5m53.829152623s) [noise=true , address=104.36.82.45:4938 , piece_id=HYAUM7LFB7YKMLPBHD7PEBP6Y54JMZ2UAJTDTBCP3JAB3IBJHJEQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.242267271 (14h5m53.829323512s) [noise=true , address=104.36.82.58:4273 , piece_id=H6VG6QUSKVNBAJRDQUV4PZIKBFGAM7OIX7BTB4UO5YW6EHVFR2FQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.242818750 (14h5m53.829874981s) [noise=true , address=104.36.82.37:4657 , piece_id=DDJRHIGSD66WQQ3SAPQRKC7RHTHXASXDVNMIKQQDRTWKK5ADIUOQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.243569251 (14h5m53.830625473s) [noise=true , address=104.36.82.38:4693 , piece_id=QPR6POCGGHYGULCXPEOZBBSDBOV5DLTIW6ZUKMGPIJZLB3F3HNJA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.244340481 (14h5m53.831396702s) [noise=true , address=104.36.82.60:4359 , piece_id=PT3LJH7ROPW2UXME5HDMDAHIFPZ3JILDNT6LUTNHYDSNFRRGIR4A, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.244984754 (14h5m53.832040985s) [noise=true , address=104.36.82.43:4854 , piece_id=3YYPCYCMQQSKEG5WE6PD3QF5XJI3GN3FIAUNBQDOQ2URBGMHD7AA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.245524792 (14h5m53.832581023s) [noise=true , address=104.36.82.37:4684 , piece_id=PV6SS66AY2YJEC2CBYLQ4LQLWUS3KWVPIPPN46OAAFC4ZZQGX5XQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.246872779 (14h5m53.83392901s) [noise=true , address=104.36.82.36:4641 , piece_id=R7R33QBSBJUWWKVI2UXEDRKDCOCVYKMYVE2CEWK2MATSBZ3MGJIQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.247331215 (14h5m53.834387456s) [noise=true , address=104.36.82.34:4561 , piece_id=D42SM3LJAAC7HHZWQEYBPWT6NOUQW3VUVHNPAODKKY54CWZWDQBQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.247891481 (14h5m53.834947722s) [noise=true , address=104.36.82.62:4439 , piece_id=CMLMZQQLTVF3KHEIHNQTZAELFG3465HOYKMCK2UDYOQHPROML3SA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.248431108 (14h5m53.835487338s) [noise=true , address=104.36.82.13:4204 , piece_id=WT2WD2ZAU5MBXXNBZFXLOVXMWUFOMPUXOBTOA7P67NE2JIELPZWQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.248441287 (14h5m53.835497528s) [seg_pos={0 0}, upload=14568]: Segment reached optimal threshold of 14 pieces. Aug 8 06:32:40.248563916 (14h5m53.835620157s) [noise=true , address=104.36.82.59:4319 , piece_id=AIU65US456ESICJU42TGN43EC7KRVDXAQA4TXF3LEJ66ZQJSK3TQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hzjVmYJbXH9yCxL2JUotjRKfWtgdUjSQKmPRByQAMjBkHqLRK): protocol: expected piece hash; context canceled; EOF Aug 8 06:32:40.249100268 (14h5m53.836156509s) [noise=true , address=64.49.13.154:4928 , piece_id=QDSHIQMF6WDJQZZKWQZZP4DVKFZUN2JAUVHRJOIZZ4SMNXQLVSZQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: read tcp 5.161.89.252:59898->64.49.13.154:4928: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 06:32:40.249154668 (14h5m53.83621091s) [noise=true , address=64.49.13.27:4963 , piece_id=CEB52PLVGIB2RIXEBBSUJAQQUPGC4U2JVFQ3J7HW3LMRIFWXCAYA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: read tcp 5.161.89.252:44876->64.49.13.27:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 06:32:40.249199352 (14h5m53.836255594s) [noise=true , address=64.49.13.137:4504 , piece_id=UXR3Z5Q6AJWVIA27IZHNPMRTTKLC4ENHVUQHVANK5L3AXOYOOWIA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:11LnrSYf8ZaxUgsdjt6jHzNgHjkq1bFCnDEFd14JzhParNTesZ): protocol: read tcp 5.161.89.252:19204->64.49.13.137:4504: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 06:32:40.249210163 (14h5m53.836266404s) [seg_pos={0 0}, upload=14568]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:32:40.249282678 (14h5m53.836338919s) [upload=14568]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:32:40.249287737 (14h5m53.836343968s) [upload=14568]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:32:40.302341870 (14h5m53.889398111s) [upload=14568]: Done uploading segments... Aug 8 06:32:40.302361056 (14h5m53.889417297s) [upload=14568]: Upload finished. err: <nil> Aug 8 06:33:19.671995961 (14h6m33.259052203s) [upload=14579]: Starting upload Aug 8 06:33:19.672056584 (14h6m33.259112826s) [upload=14579]: Done starting upload Aug 8 06:33:19.672119763 (14h6m33.259175994s) [upload=14579]: Uploading segments... Aug 8 06:33:19.672884900 (14h6m33.259941132s) [upload=14579]: Got next segment. Inline: false Aug 8 06:33:19.672932620 (14h6m33.259988862s) [upload=14579]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:33:19.672937719 (14h6m33.259993961s) [upload=14579]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:33:19.675836631 (14h6m33.262892862s) [upload=14579]: Next segment err: metaclient: Too Many Requests Aug 8 06:33:19.675851759 (14h6m33.262908s) [upload=14579]: Done uploading segments... Aug 8 06:33:19.675865856 (14h6m33.262922097s) [upload=14579]: Upload finished. err: metaclient: Too Many Requests Duration: 381.994239ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 343.949214ms FAIL (2025-08-08 06:36:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== XOBTOA7P67NE2JIELPZWQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065025521 (14h5m53.652081792s) [noise=true , address=104.36.82.23:4457 , piece_id=OOK6SCTGDGEMBOCXSBR2RC5IUS2EYPANIISO2IAPXNRWUFA4ORMQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065205998 (14h5m53.652262239s) [noise=true , address=104.36.82.62:4439 , piece_id=CMLMZQQLTVF3KHEIHNQTZAELFG3465HOYKMCK2UDYOQHPROML3SA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065455032 (14h5m53.652511273s) [noise=true , address=64.49.13.137:4504 , piece_id=UXR3Z5Q6AJWVIA27IZHNPMRTTKLC4ENHVUQHVANK5L3AXOYOOWIA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065786381 (14h5m53.652842622s) [noise=true , address=104.36.82.42:4808 , piece_id=5AGVDHXGAVLF6OPWT4KYTW6TFAPDPNADOPZ5C3KXAXRLI4OUNBDQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065845953 (14h5m53.652902193s) [noise=true , address=104.36.82.58:4273 , piece_id=H6VG6QUSKVNBAJRDQUV4PZIKBFGAM7OIX7BTB4UO5YW6EHVFR2FQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.066263101 (14h5m53.653319342s) [noise=true , address=64.49.13.154:4928 , piece_id=QDSHIQMF6WDJQZZKWQZZP4DVKFZUN2JAUVHRJOIZZ4SMNXQLVSZQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.066327521 (14h5m53.653383763s) [noise=true , address=104.36.82.59:4319 , piece_id=AIU65US456ESICJU42TGN43EC7KRVDXAQA4TXF3LEJ66ZQJSK3TQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.066919006 (14h5m53.653975247s) [noise=true , address=104.36.82.37:4657 , piece_id=DDJRHIGSD66WQQ3SAPQRKC7RHTHXASXDVNMIKQQDRTWKK5ADIUOQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067254953 (14h5m53.654311194s) [noise=true , address=64.49.13.27:4963 , piece_id=CEB52PLVGIB2RIXEBBSUJAQQUPGC4U2JVFQ3J7HW3LMRIFWXCAYA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067466127 (14h5m53.654522368s) [noise=true , address=104.36.82.36:4641 , piece_id=R7R33QBSBJUWWKVI2UXEDRKDCOCVYKMYVE2CEWK2MATSBZ3MGJIQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067873497 (14h5m53.654929738s) [noise=true , address=104.36.82.61:4404 , piece_id=DF4W6VI4HG7XX444VNPBKGDLK4EYJQZ5SKCZGBV6UNPJGGFA6BEA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067987530 (14h5m53.655043771s) [noise=true , address=104.36.82.45:4938 , piece_id=HYAUM7LFB7YKMLPBHD7PEBP6Y54JMZ2UAJTDTBCP3JAB3IBJHJEQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.068356108 (14h5m53.655412349s) [noise=true , address=104.36.82.60:4359 , piece_id=PT3LJH7ROPW2UXME5HDMDAHIFPZ3JILDNT6LUTNHYDSNFRRGIR4A, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.068429946 (14h5m53.655486187s) [noise=true , address=104.36.82.38:4693 , piece_id=QPR6POCGGHYGULCXPEOZBBSDBOV5DLTIW6ZUKMGPIJZLB3F3HNJA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.068896717 (14h5m53.655952958s) [noise=true , address=104.36.82.37:4684 , piece_id=PV6SS66AY2YJEC2CBYLQ4LQLWUS3KWVPIPPN46OAAFC4ZZQGX5XQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.069016020 (14h5m53.656072261s) [noise=true , address=104.36.82.43:4854 , piece_id=3YYPCYCMQQSKEG5WE6PD3QF5XJI3GN3FIAUNBQDOQ2URBGMHD7AA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.225413177 (14h5m53.812469418s) [upload=14568]: Next returned nil segment Aug 8 06:32:40.225429067 (14h5m53.812485298s) [upload=14568]: Waiting for error group managing segments... Aug 8 06:32:40.238535474 (14h5m53.825591705s) [noise=true , address=104.36.82.61:4404 , piece_id=DF4W6VI4HG7XX444VNPBKGDLK4EYJQZ5SKCZGBV6UNPJGGFA6BEA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.239293129 (14h5m53.826349371s) [noise=true , address=104.36.82.42:4808 , piece_id=5AGVDHXGAVLF6OPWT4KYTW6TFAPDPNADOPZ5C3KXAXRLI4OUNBDQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.241689332 (14h5m53.828745574s) [noise=true , address=104.36.82.23:4457 , piece_id=OOK6SCTGDGEMBOCXSBR2RC5IUS2EYPANIISO2IAPXNRWUFA4ORMQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.242096392 (14h5m53.829152623s) [noise=true , address=104.36.82.45:4938 , piece_id=HYAUM7LFB7YKMLPBHD7PEBP6Y54JMZ2UAJTDTBCP3JAB3IBJHJEQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.242267271 (14h5m53.829323512s) [noise=true , address=104.36.82.58:4273 , piece_id=H6VG6QUSKVNBAJRDQUV4PZIKBFGAM7OIX7BTB4UO5YW6EHVFR2FQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.242818750 (14h5m53.829874981s) [noise=true , address=104.36.82.37:4657 , piece_id=DDJRHIGSD66WQQ3SAPQRKC7RHTHXASXDVNMIKQQDRTWKK5ADIUOQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.243569251 (14h5m53.830625473s) [noise=true , address=104.36.82.38:4693 , piece_id=QPR6POCGGHYGULCXPEOZBBSDBOV5DLTIW6ZUKMGPIJZLB3F3HNJA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.244340481 (14h5m53.831396702s) [noise=true , address=104.36.82.60:4359 , piece_id=PT3LJH7ROPW2UXME5HDMDAHIFPZ3JILDNT6LUTNHYDSNFRRGIR4A, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.244984754 (14h5m53.832040985s) [noise=true , address=104.36.82.43:4854 , piece_id=3YYPCYCMQQSKEG5WE6PD3QF5XJI3GN3FIAUNBQDOQ2URBGMHD7AA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.245524792 (14h5m53.832581023s) [noise=true , address=104.36.82.37:4684 , piece_id=PV6SS66AY2YJEC2CBYLQ4LQLWUS3KWVPIPPN46OAAFC4ZZQGX5XQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.246872779 (14h5m53.83392901s) [noise=true , address=104.36.82.36:4641 , piece_id=R7R33QBSBJUWWKVI2UXEDRKDCOCVYKMYVE2CEWK2MATSBZ3MGJIQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.247331215 (14h5m53.834387456s) [noise=true , address=104.36.82.34:4561 , piece_id=D42SM3LJAAC7HHZWQEYBPWT6NOUQW3VUVHNPAODKKY54CWZWDQBQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.247891481 (14h5m53.834947722s) [noise=true , address=104.36.82.62:4439 , piece_id=CMLMZQQLTVF3KHEIHNQTZAELFG3465HOYKMCK2UDYOQHPROML3SA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.248431108 (14h5m53.835487338s) [noise=true , address=104.36.82.13:4204 , piece_id=WT2WD2ZAU5MBXXNBZFXLOVXMWUFOMPUXOBTOA7P67NE2JIELPZWQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.248441287 (14h5m53.835497528s) [seg_pos={0 0}, upload=14568]: Segment reached optimal threshold of 14 pieces. Aug 8 06:32:40.248563916 (14h5m53.835620157s) [noise=true , address=104.36.82.59:4319 , piece_id=AIU65US456ESICJU42TGN43EC7KRVDXAQA4TXF3LEJ66ZQJSK3TQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hzjVmYJbXH9yCxL2JUotjRKfWtgdUjSQKmPRByQAMjBkHqLRK): protocol: expected piece hash; context canceled; EOF Aug 8 06:32:40.249100268 (14h5m53.836156509s) [noise=true , address=64.49.13.154:4928 , piece_id=QDSHIQMF6WDJQZZKWQZZP4DVKFZUN2JAUVHRJOIZZ4SMNXQLVSZQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: read tcp 5.161.89.252:59898->64.49.13.154:4928: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 06:32:40.249154668 (14h5m53.83621091s) [noise=true , address=64.49.13.27:4963 , piece_id=CEB52PLVGIB2RIXEBBSUJAQQUPGC4U2JVFQ3J7HW3LMRIFWXCAYA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: read tcp 5.161.89.252:44876->64.49.13.27:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 06:32:40.249199352 (14h5m53.836255594s) [noise=true , address=64.49.13.137:4504 , piece_id=UXR3Z5Q6AJWVIA27IZHNPMRTTKLC4ENHVUQHVANK5L3AXOYOOWIA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:11LnrSYf8ZaxUgsdjt6jHzNgHjkq1bFCnDEFd14JzhParNTesZ): protocol: read tcp 5.161.89.252:19204->64.49.13.137:4504: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 06:32:40.249210163 (14h5m53.836266404s) [seg_pos={0 0}, upload=14568]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:32:40.249282678 (14h5m53.836338919s) [upload=14568]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:32:40.249287737 (14h5m53.836343968s) [upload=14568]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:32:40.302341870 (14h5m53.889398111s) [upload=14568]: Done uploading segments... Aug 8 06:32:40.302361056 (14h5m53.889417297s) [upload=14568]: Upload finished. err: <nil> Aug 8 06:33:19.671995961 (14h6m33.259052203s) [upload=14579]: Starting upload Aug 8 06:33:19.672056584 (14h6m33.259112826s) [upload=14579]: Done starting upload Aug 8 06:33:19.672119763 (14h6m33.259175994s) [upload=14579]: Uploading segments... Aug 8 06:33:19.672884900 (14h6m33.259941132s) [upload=14579]: Got next segment. Inline: false Aug 8 06:33:19.672932620 (14h6m33.259988862s) [upload=14579]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:33:19.672937719 (14h6m33.259993961s) [upload=14579]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:33:19.675836631 (14h6m33.262892862s) [upload=14579]: Next segment err: metaclient: Too Many Requests Aug 8 06:33:19.675851759 (14h6m33.262908s) [upload=14579]: Done uploading segments... Aug 8 06:33:19.675865856 (14h6m33.262922097s) [upload=14579]: Upload finished. err: metaclient: Too Many Requests Duration: 343.969864ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 472.301674ms FAIL (2025-08-08 06:35:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== XOBTOA7P67NE2JIELPZWQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065025521 (14h5m53.652081792s) [noise=true , address=104.36.82.23:4457 , piece_id=OOK6SCTGDGEMBOCXSBR2RC5IUS2EYPANIISO2IAPXNRWUFA4ORMQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065205998 (14h5m53.652262239s) [noise=true , address=104.36.82.62:4439 , piece_id=CMLMZQQLTVF3KHEIHNQTZAELFG3465HOYKMCK2UDYOQHPROML3SA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065455032 (14h5m53.652511273s) [noise=true , address=64.49.13.137:4504 , piece_id=UXR3Z5Q6AJWVIA27IZHNPMRTTKLC4ENHVUQHVANK5L3AXOYOOWIA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065786381 (14h5m53.652842622s) [noise=true , address=104.36.82.42:4808 , piece_id=5AGVDHXGAVLF6OPWT4KYTW6TFAPDPNADOPZ5C3KXAXRLI4OUNBDQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065845953 (14h5m53.652902193s) [noise=true , address=104.36.82.58:4273 , piece_id=H6VG6QUSKVNBAJRDQUV4PZIKBFGAM7OIX7BTB4UO5YW6EHVFR2FQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.066263101 (14h5m53.653319342s) [noise=true , address=64.49.13.154:4928 , piece_id=QDSHIQMF6WDJQZZKWQZZP4DVKFZUN2JAUVHRJOIZZ4SMNXQLVSZQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.066327521 (14h5m53.653383763s) [noise=true , address=104.36.82.59:4319 , piece_id=AIU65US456ESICJU42TGN43EC7KRVDXAQA4TXF3LEJ66ZQJSK3TQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.066919006 (14h5m53.653975247s) [noise=true , address=104.36.82.37:4657 , piece_id=DDJRHIGSD66WQQ3SAPQRKC7RHTHXASXDVNMIKQQDRTWKK5ADIUOQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067254953 (14h5m53.654311194s) [noise=true , address=64.49.13.27:4963 , piece_id=CEB52PLVGIB2RIXEBBSUJAQQUPGC4U2JVFQ3J7HW3LMRIFWXCAYA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067466127 (14h5m53.654522368s) [noise=true , address=104.36.82.36:4641 , piece_id=R7R33QBSBJUWWKVI2UXEDRKDCOCVYKMYVE2CEWK2MATSBZ3MGJIQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067873497 (14h5m53.654929738s) [noise=true , address=104.36.82.61:4404 , piece_id=DF4W6VI4HG7XX444VNPBKGDLK4EYJQZ5SKCZGBV6UNPJGGFA6BEA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067987530 (14h5m53.655043771s) [noise=true , address=104.36.82.45:4938 , piece_id=HYAUM7LFB7YKMLPBHD7PEBP6Y54JMZ2UAJTDTBCP3JAB3IBJHJEQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.068356108 (14h5m53.655412349s) [noise=true , address=104.36.82.60:4359 , piece_id=PT3LJH7ROPW2UXME5HDMDAHIFPZ3JILDNT6LUTNHYDSNFRRGIR4A, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.068429946 (14h5m53.655486187s) [noise=true , address=104.36.82.38:4693 , piece_id=QPR6POCGGHYGULCXPEOZBBSDBOV5DLTIW6ZUKMGPIJZLB3F3HNJA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.068896717 (14h5m53.655952958s) [noise=true , address=104.36.82.37:4684 , piece_id=PV6SS66AY2YJEC2CBYLQ4LQLWUS3KWVPIPPN46OAAFC4ZZQGX5XQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.069016020 (14h5m53.656072261s) [noise=true , address=104.36.82.43:4854 , piece_id=3YYPCYCMQQSKEG5WE6PD3QF5XJI3GN3FIAUNBQDOQ2URBGMHD7AA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.225413177 (14h5m53.812469418s) [upload=14568]: Next returned nil segment Aug 8 06:32:40.225429067 (14h5m53.812485298s) [upload=14568]: Waiting for error group managing segments... Aug 8 06:32:40.238535474 (14h5m53.825591705s) [noise=true , address=104.36.82.61:4404 , piece_id=DF4W6VI4HG7XX444VNPBKGDLK4EYJQZ5SKCZGBV6UNPJGGFA6BEA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.239293129 (14h5m53.826349371s) [noise=true , address=104.36.82.42:4808 , piece_id=5AGVDHXGAVLF6OPWT4KYTW6TFAPDPNADOPZ5C3KXAXRLI4OUNBDQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.241689332 (14h5m53.828745574s) [noise=true , address=104.36.82.23:4457 , piece_id=OOK6SCTGDGEMBOCXSBR2RC5IUS2EYPANIISO2IAPXNRWUFA4ORMQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.242096392 (14h5m53.829152623s) [noise=true , address=104.36.82.45:4938 , piece_id=HYAUM7LFB7YKMLPBHD7PEBP6Y54JMZ2UAJTDTBCP3JAB3IBJHJEQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.242267271 (14h5m53.829323512s) [noise=true , address=104.36.82.58:4273 , piece_id=H6VG6QUSKVNBAJRDQUV4PZIKBFGAM7OIX7BTB4UO5YW6EHVFR2FQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.242818750 (14h5m53.829874981s) [noise=true , address=104.36.82.37:4657 , piece_id=DDJRHIGSD66WQQ3SAPQRKC7RHTHXASXDVNMIKQQDRTWKK5ADIUOQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.243569251 (14h5m53.830625473s) [noise=true , address=104.36.82.38:4693 , piece_id=QPR6POCGGHYGULCXPEOZBBSDBOV5DLTIW6ZUKMGPIJZLB3F3HNJA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.244340481 (14h5m53.831396702s) [noise=true , address=104.36.82.60:4359 , piece_id=PT3LJH7ROPW2UXME5HDMDAHIFPZ3JILDNT6LUTNHYDSNFRRGIR4A, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.244984754 (14h5m53.832040985s) [noise=true , address=104.36.82.43:4854 , piece_id=3YYPCYCMQQSKEG5WE6PD3QF5XJI3GN3FIAUNBQDOQ2URBGMHD7AA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.245524792 (14h5m53.832581023s) [noise=true , address=104.36.82.37:4684 , piece_id=PV6SS66AY2YJEC2CBYLQ4LQLWUS3KWVPIPPN46OAAFC4ZZQGX5XQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.246872779 (14h5m53.83392901s) [noise=true , address=104.36.82.36:4641 , piece_id=R7R33QBSBJUWWKVI2UXEDRKDCOCVYKMYVE2CEWK2MATSBZ3MGJIQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.247331215 (14h5m53.834387456s) [noise=true , address=104.36.82.34:4561 , piece_id=D42SM3LJAAC7HHZWQEYBPWT6NOUQW3VUVHNPAODKKY54CWZWDQBQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.247891481 (14h5m53.834947722s) [noise=true , address=104.36.82.62:4439 , piece_id=CMLMZQQLTVF3KHEIHNQTZAELFG3465HOYKMCK2UDYOQHPROML3SA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.248431108 (14h5m53.835487338s) [noise=true , address=104.36.82.13:4204 , piece_id=WT2WD2ZAU5MBXXNBZFXLOVXMWUFOMPUXOBTOA7P67NE2JIELPZWQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.248441287 (14h5m53.835497528s) [seg_pos={0 0}, upload=14568]: Segment reached optimal threshold of 14 pieces. Aug 8 06:32:40.248563916 (14h5m53.835620157s) [noise=true , address=104.36.82.59:4319 , piece_id=AIU65US456ESICJU42TGN43EC7KRVDXAQA4TXF3LEJ66ZQJSK3TQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hzjVmYJbXH9yCxL2JUotjRKfWtgdUjSQKmPRByQAMjBkHqLRK): protocol: expected piece hash; context canceled; EOF Aug 8 06:32:40.249100268 (14h5m53.836156509s) [noise=true , address=64.49.13.154:4928 , piece_id=QDSHIQMF6WDJQZZKWQZZP4DVKFZUN2JAUVHRJOIZZ4SMNXQLVSZQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: read tcp 5.161.89.252:59898->64.49.13.154:4928: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 06:32:40.249154668 (14h5m53.83621091s) [noise=true , address=64.49.13.27:4963 , piece_id=CEB52PLVGIB2RIXEBBSUJAQQUPGC4U2JVFQ3J7HW3LMRIFWXCAYA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: read tcp 5.161.89.252:44876->64.49.13.27:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 06:32:40.249199352 (14h5m53.836255594s) [noise=true , address=64.49.13.137:4504 , piece_id=UXR3Z5Q6AJWVIA27IZHNPMRTTKLC4ENHVUQHVANK5L3AXOYOOWIA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:11LnrSYf8ZaxUgsdjt6jHzNgHjkq1bFCnDEFd14JzhParNTesZ): protocol: read tcp 5.161.89.252:19204->64.49.13.137:4504: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 06:32:40.249210163 (14h5m53.836266404s) [seg_pos={0 0}, upload=14568]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:32:40.249282678 (14h5m53.836338919s) [upload=14568]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:32:40.249287737 (14h5m53.836343968s) [upload=14568]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:32:40.302341870 (14h5m53.889398111s) [upload=14568]: Done uploading segments... Aug 8 06:32:40.302361056 (14h5m53.889417297s) [upload=14568]: Upload finished. err: <nil> Aug 8 06:33:19.671995961 (14h6m33.259052203s) [upload=14579]: Starting upload Aug 8 06:33:19.672056584 (14h6m33.259112826s) [upload=14579]: Done starting upload Aug 8 06:33:19.672119763 (14h6m33.259175994s) [upload=14579]: Uploading segments... Aug 8 06:33:19.672884900 (14h6m33.259941132s) [upload=14579]: Got next segment. Inline: false Aug 8 06:33:19.672932620 (14h6m33.259988862s) [upload=14579]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:33:19.672937719 (14h6m33.259993961s) [upload=14579]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:33:19.675836631 (14h6m33.262892862s) [upload=14579]: Next segment err: metaclient: Too Many Requests Aug 8 06:33:19.675851759 (14h6m33.262908s) [upload=14579]: Done uploading segments... Aug 8 06:33:19.675865856 (14h6m33.262922097s) [upload=14579]: Upload finished. err: metaclient: Too Many Requests Duration: 472.322563ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 374.937927ms FAIL (2025-08-08 06:35:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== XOBTOA7P67NE2JIELPZWQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065025521 (14h5m53.652081792s) [noise=true , address=104.36.82.23:4457 , piece_id=OOK6SCTGDGEMBOCXSBR2RC5IUS2EYPANIISO2IAPXNRWUFA4ORMQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065205998 (14h5m53.652262239s) [noise=true , address=104.36.82.62:4439 , piece_id=CMLMZQQLTVF3KHEIHNQTZAELFG3465HOYKMCK2UDYOQHPROML3SA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065455032 (14h5m53.652511273s) [noise=true , address=64.49.13.137:4504 , piece_id=UXR3Z5Q6AJWVIA27IZHNPMRTTKLC4ENHVUQHVANK5L3AXOYOOWIA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065786381 (14h5m53.652842622s) [noise=true , address=104.36.82.42:4808 , piece_id=5AGVDHXGAVLF6OPWT4KYTW6TFAPDPNADOPZ5C3KXAXRLI4OUNBDQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065845953 (14h5m53.652902193s) [noise=true , address=104.36.82.58:4273 , piece_id=H6VG6QUSKVNBAJRDQUV4PZIKBFGAM7OIX7BTB4UO5YW6EHVFR2FQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.066263101 (14h5m53.653319342s) [noise=true , address=64.49.13.154:4928 , piece_id=QDSHIQMF6WDJQZZKWQZZP4DVKFZUN2JAUVHRJOIZZ4SMNXQLVSZQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.066327521 (14h5m53.653383763s) [noise=true , address=104.36.82.59:4319 , piece_id=AIU65US456ESICJU42TGN43EC7KRVDXAQA4TXF3LEJ66ZQJSK3TQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.066919006 (14h5m53.653975247s) [noise=true , address=104.36.82.37:4657 , piece_id=DDJRHIGSD66WQQ3SAPQRKC7RHTHXASXDVNMIKQQDRTWKK5ADIUOQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067254953 (14h5m53.654311194s) [noise=true , address=64.49.13.27:4963 , piece_id=CEB52PLVGIB2RIXEBBSUJAQQUPGC4U2JVFQ3J7HW3LMRIFWXCAYA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067466127 (14h5m53.654522368s) [noise=true , address=104.36.82.36:4641 , piece_id=R7R33QBSBJUWWKVI2UXEDRKDCOCVYKMYVE2CEWK2MATSBZ3MGJIQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067873497 (14h5m53.654929738s) [noise=true , address=104.36.82.61:4404 , piece_id=DF4W6VI4HG7XX444VNPBKGDLK4EYJQZ5SKCZGBV6UNPJGGFA6BEA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067987530 (14h5m53.655043771s) [noise=true , address=104.36.82.45:4938 , piece_id=HYAUM7LFB7YKMLPBHD7PEBP6Y54JMZ2UAJTDTBCP3JAB3IBJHJEQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.068356108 (14h5m53.655412349s) [noise=true , address=104.36.82.60:4359 , piece_id=PT3LJH7ROPW2UXME5HDMDAHIFPZ3JILDNT6LUTNHYDSNFRRGIR4A, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.068429946 (14h5m53.655486187s) [noise=true , address=104.36.82.38:4693 , piece_id=QPR6POCGGHYGULCXPEOZBBSDBOV5DLTIW6ZUKMGPIJZLB3F3HNJA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.068896717 (14h5m53.655952958s) [noise=true , address=104.36.82.37:4684 , piece_id=PV6SS66AY2YJEC2CBYLQ4LQLWUS3KWVPIPPN46OAAFC4ZZQGX5XQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.069016020 (14h5m53.656072261s) [noise=true , address=104.36.82.43:4854 , piece_id=3YYPCYCMQQSKEG5WE6PD3QF5XJI3GN3FIAUNBQDOQ2URBGMHD7AA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.225413177 (14h5m53.812469418s) [upload=14568]: Next returned nil segment Aug 8 06:32:40.225429067 (14h5m53.812485298s) [upload=14568]: Waiting for error group managing segments... Aug 8 06:32:40.238535474 (14h5m53.825591705s) [noise=true , address=104.36.82.61:4404 , piece_id=DF4W6VI4HG7XX444VNPBKGDLK4EYJQZ5SKCZGBV6UNPJGGFA6BEA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.239293129 (14h5m53.826349371s) [noise=true , address=104.36.82.42:4808 , piece_id=5AGVDHXGAVLF6OPWT4KYTW6TFAPDPNADOPZ5C3KXAXRLI4OUNBDQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.241689332 (14h5m53.828745574s) [noise=true , address=104.36.82.23:4457 , piece_id=OOK6SCTGDGEMBOCXSBR2RC5IUS2EYPANIISO2IAPXNRWUFA4ORMQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.242096392 (14h5m53.829152623s) [noise=true , address=104.36.82.45:4938 , piece_id=HYAUM7LFB7YKMLPBHD7PEBP6Y54JMZ2UAJTDTBCP3JAB3IBJHJEQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.242267271 (14h5m53.829323512s) [noise=true , address=104.36.82.58:4273 , piece_id=H6VG6QUSKVNBAJRDQUV4PZIKBFGAM7OIX7BTB4UO5YW6EHVFR2FQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.242818750 (14h5m53.829874981s) [noise=true , address=104.36.82.37:4657 , piece_id=DDJRHIGSD66WQQ3SAPQRKC7RHTHXASXDVNMIKQQDRTWKK5ADIUOQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.243569251 (14h5m53.830625473s) [noise=true , address=104.36.82.38:4693 , piece_id=QPR6POCGGHYGULCXPEOZBBSDBOV5DLTIW6ZUKMGPIJZLB3F3HNJA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.244340481 (14h5m53.831396702s) [noise=true , address=104.36.82.60:4359 , piece_id=PT3LJH7ROPW2UXME5HDMDAHIFPZ3JILDNT6LUTNHYDSNFRRGIR4A, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.244984754 (14h5m53.832040985s) [noise=true , address=104.36.82.43:4854 , piece_id=3YYPCYCMQQSKEG5WE6PD3QF5XJI3GN3FIAUNBQDOQ2URBGMHD7AA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.245524792 (14h5m53.832581023s) [noise=true , address=104.36.82.37:4684 , piece_id=PV6SS66AY2YJEC2CBYLQ4LQLWUS3KWVPIPPN46OAAFC4ZZQGX5XQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.246872779 (14h5m53.83392901s) [noise=true , address=104.36.82.36:4641 , piece_id=R7R33QBSBJUWWKVI2UXEDRKDCOCVYKMYVE2CEWK2MATSBZ3MGJIQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.247331215 (14h5m53.834387456s) [noise=true , address=104.36.82.34:4561 , piece_id=D42SM3LJAAC7HHZWQEYBPWT6NOUQW3VUVHNPAODKKY54CWZWDQBQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.247891481 (14h5m53.834947722s) [noise=true , address=104.36.82.62:4439 , piece_id=CMLMZQQLTVF3KHEIHNQTZAELFG3465HOYKMCK2UDYOQHPROML3SA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.248431108 (14h5m53.835487338s) [noise=true , address=104.36.82.13:4204 , piece_id=WT2WD2ZAU5MBXXNBZFXLOVXMWUFOMPUXOBTOA7P67NE2JIELPZWQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.248441287 (14h5m53.835497528s) [seg_pos={0 0}, upload=14568]: Segment reached optimal threshold of 14 pieces. Aug 8 06:32:40.248563916 (14h5m53.835620157s) [noise=true , address=104.36.82.59:4319 , piece_id=AIU65US456ESICJU42TGN43EC7KRVDXAQA4TXF3LEJ66ZQJSK3TQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hzjVmYJbXH9yCxL2JUotjRKfWtgdUjSQKmPRByQAMjBkHqLRK): protocol: expected piece hash; context canceled; EOF Aug 8 06:32:40.249100268 (14h5m53.836156509s) [noise=true , address=64.49.13.154:4928 , piece_id=QDSHIQMF6WDJQZZKWQZZP4DVKFZUN2JAUVHRJOIZZ4SMNXQLVSZQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: read tcp 5.161.89.252:59898->64.49.13.154:4928: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 06:32:40.249154668 (14h5m53.83621091s) [noise=true , address=64.49.13.27:4963 , piece_id=CEB52PLVGIB2RIXEBBSUJAQQUPGC4U2JVFQ3J7HW3LMRIFWXCAYA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: read tcp 5.161.89.252:44876->64.49.13.27:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 06:32:40.249199352 (14h5m53.836255594s) [noise=true , address=64.49.13.137:4504 , piece_id=UXR3Z5Q6AJWVIA27IZHNPMRTTKLC4ENHVUQHVANK5L3AXOYOOWIA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:11LnrSYf8ZaxUgsdjt6jHzNgHjkq1bFCnDEFd14JzhParNTesZ): protocol: read tcp 5.161.89.252:19204->64.49.13.137:4504: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 06:32:40.249210163 (14h5m53.836266404s) [seg_pos={0 0}, upload=14568]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:32:40.249282678 (14h5m53.836338919s) [upload=14568]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:32:40.249287737 (14h5m53.836343968s) [upload=14568]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:32:40.302341870 (14h5m53.889398111s) [upload=14568]: Done uploading segments... Aug 8 06:32:40.302361056 (14h5m53.889417297s) [upload=14568]: Upload finished. err: <nil> Aug 8 06:33:19.671995961 (14h6m33.259052203s) [upload=14579]: Starting upload Aug 8 06:33:19.672056584 (14h6m33.259112826s) [upload=14579]: Done starting upload Aug 8 06:33:19.672119763 (14h6m33.259175994s) [upload=14579]: Uploading segments... Aug 8 06:33:19.672884900 (14h6m33.259941132s) [upload=14579]: Got next segment. Inline: false Aug 8 06:33:19.672932620 (14h6m33.259988862s) [upload=14579]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:33:19.672937719 (14h6m33.259993961s) [upload=14579]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:33:19.675836631 (14h6m33.262892862s) [upload=14579]: Next segment err: metaclient: Too Many Requests Aug 8 06:33:19.675851759 (14h6m33.262908s) [upload=14579]: Done uploading segments... Aug 8 06:33:19.675865856 (14h6m33.262922097s) [upload=14579]: Upload finished. err: metaclient: Too Many Requests Duration: 374.963325ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 306.64197ms FAIL (2025-08-08 06:34:37 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== XOBTOA7P67NE2JIELPZWQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065025521 (14h5m53.652081792s) [noise=true , address=104.36.82.23:4457 , piece_id=OOK6SCTGDGEMBOCXSBR2RC5IUS2EYPANIISO2IAPXNRWUFA4ORMQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065205998 (14h5m53.652262239s) [noise=true , address=104.36.82.62:4439 , piece_id=CMLMZQQLTVF3KHEIHNQTZAELFG3465HOYKMCK2UDYOQHPROML3SA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065455032 (14h5m53.652511273s) [noise=true , address=64.49.13.137:4504 , piece_id=UXR3Z5Q6AJWVIA27IZHNPMRTTKLC4ENHVUQHVANK5L3AXOYOOWIA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065786381 (14h5m53.652842622s) [noise=true , address=104.36.82.42:4808 , piece_id=5AGVDHXGAVLF6OPWT4KYTW6TFAPDPNADOPZ5C3KXAXRLI4OUNBDQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065845953 (14h5m53.652902193s) [noise=true , address=104.36.82.58:4273 , piece_id=H6VG6QUSKVNBAJRDQUV4PZIKBFGAM7OIX7BTB4UO5YW6EHVFR2FQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.066263101 (14h5m53.653319342s) [noise=true , address=64.49.13.154:4928 , piece_id=QDSHIQMF6WDJQZZKWQZZP4DVKFZUN2JAUVHRJOIZZ4SMNXQLVSZQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.066327521 (14h5m53.653383763s) [noise=true , address=104.36.82.59:4319 , piece_id=AIU65US456ESICJU42TGN43EC7KRVDXAQA4TXF3LEJ66ZQJSK3TQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.066919006 (14h5m53.653975247s) [noise=true , address=104.36.82.37:4657 , piece_id=DDJRHIGSD66WQQ3SAPQRKC7RHTHXASXDVNMIKQQDRTWKK5ADIUOQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067254953 (14h5m53.654311194s) [noise=true , address=64.49.13.27:4963 , piece_id=CEB52PLVGIB2RIXEBBSUJAQQUPGC4U2JVFQ3J7HW3LMRIFWXCAYA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067466127 (14h5m53.654522368s) [noise=true , address=104.36.82.36:4641 , piece_id=R7R33QBSBJUWWKVI2UXEDRKDCOCVYKMYVE2CEWK2MATSBZ3MGJIQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067873497 (14h5m53.654929738s) [noise=true , address=104.36.82.61:4404 , piece_id=DF4W6VI4HG7XX444VNPBKGDLK4EYJQZ5SKCZGBV6UNPJGGFA6BEA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067987530 (14h5m53.655043771s) [noise=true , address=104.36.82.45:4938 , piece_id=HYAUM7LFB7YKMLPBHD7PEBP6Y54JMZ2UAJTDTBCP3JAB3IBJHJEQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.068356108 (14h5m53.655412349s) [noise=true , address=104.36.82.60:4359 , piece_id=PT3LJH7ROPW2UXME5HDMDAHIFPZ3JILDNT6LUTNHYDSNFRRGIR4A, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.068429946 (14h5m53.655486187s) [noise=true , address=104.36.82.38:4693 , piece_id=QPR6POCGGHYGULCXPEOZBBSDBOV5DLTIW6ZUKMGPIJZLB3F3HNJA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.068896717 (14h5m53.655952958s) [noise=true , address=104.36.82.37:4684 , piece_id=PV6SS66AY2YJEC2CBYLQ4LQLWUS3KWVPIPPN46OAAFC4ZZQGX5XQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.069016020 (14h5m53.656072261s) [noise=true , address=104.36.82.43:4854 , piece_id=3YYPCYCMQQSKEG5WE6PD3QF5XJI3GN3FIAUNBQDOQ2URBGMHD7AA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.225413177 (14h5m53.812469418s) [upload=14568]: Next returned nil segment Aug 8 06:32:40.225429067 (14h5m53.812485298s) [upload=14568]: Waiting for error group managing segments... Aug 8 06:32:40.238535474 (14h5m53.825591705s) [noise=true , address=104.36.82.61:4404 , piece_id=DF4W6VI4HG7XX444VNPBKGDLK4EYJQZ5SKCZGBV6UNPJGGFA6BEA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.239293129 (14h5m53.826349371s) [noise=true , address=104.36.82.42:4808 , piece_id=5AGVDHXGAVLF6OPWT4KYTW6TFAPDPNADOPZ5C3KXAXRLI4OUNBDQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.241689332 (14h5m53.828745574s) [noise=true , address=104.36.82.23:4457 , piece_id=OOK6SCTGDGEMBOCXSBR2RC5IUS2EYPANIISO2IAPXNRWUFA4ORMQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.242096392 (14h5m53.829152623s) [noise=true , address=104.36.82.45:4938 , piece_id=HYAUM7LFB7YKMLPBHD7PEBP6Y54JMZ2UAJTDTBCP3JAB3IBJHJEQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.242267271 (14h5m53.829323512s) [noise=true , address=104.36.82.58:4273 , piece_id=H6VG6QUSKVNBAJRDQUV4PZIKBFGAM7OIX7BTB4UO5YW6EHVFR2FQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.242818750 (14h5m53.829874981s) [noise=true , address=104.36.82.37:4657 , piece_id=DDJRHIGSD66WQQ3SAPQRKC7RHTHXASXDVNMIKQQDRTWKK5ADIUOQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.243569251 (14h5m53.830625473s) [noise=true , address=104.36.82.38:4693 , piece_id=QPR6POCGGHYGULCXPEOZBBSDBOV5DLTIW6ZUKMGPIJZLB3F3HNJA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.244340481 (14h5m53.831396702s) [noise=true , address=104.36.82.60:4359 , piece_id=PT3LJH7ROPW2UXME5HDMDAHIFPZ3JILDNT6LUTNHYDSNFRRGIR4A, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.244984754 (14h5m53.832040985s) [noise=true , address=104.36.82.43:4854 , piece_id=3YYPCYCMQQSKEG5WE6PD3QF5XJI3GN3FIAUNBQDOQ2URBGMHD7AA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.245524792 (14h5m53.832581023s) [noise=true , address=104.36.82.37:4684 , piece_id=PV6SS66AY2YJEC2CBYLQ4LQLWUS3KWVPIPPN46OAAFC4ZZQGX5XQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.246872779 (14h5m53.83392901s) [noise=true , address=104.36.82.36:4641 , piece_id=R7R33QBSBJUWWKVI2UXEDRKDCOCVYKMYVE2CEWK2MATSBZ3MGJIQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.247331215 (14h5m53.834387456s) [noise=true , address=104.36.82.34:4561 , piece_id=D42SM3LJAAC7HHZWQEYBPWT6NOUQW3VUVHNPAODKKY54CWZWDQBQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.247891481 (14h5m53.834947722s) [noise=true , address=104.36.82.62:4439 , piece_id=CMLMZQQLTVF3KHEIHNQTZAELFG3465HOYKMCK2UDYOQHPROML3SA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.248431108 (14h5m53.835487338s) [noise=true , address=104.36.82.13:4204 , piece_id=WT2WD2ZAU5MBXXNBZFXLOVXMWUFOMPUXOBTOA7P67NE2JIELPZWQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.248441287 (14h5m53.835497528s) [seg_pos={0 0}, upload=14568]: Segment reached optimal threshold of 14 pieces. Aug 8 06:32:40.248563916 (14h5m53.835620157s) [noise=true , address=104.36.82.59:4319 , piece_id=AIU65US456ESICJU42TGN43EC7KRVDXAQA4TXF3LEJ66ZQJSK3TQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hzjVmYJbXH9yCxL2JUotjRKfWtgdUjSQKmPRByQAMjBkHqLRK): protocol: expected piece hash; context canceled; EOF Aug 8 06:32:40.249100268 (14h5m53.836156509s) [noise=true , address=64.49.13.154:4928 , piece_id=QDSHIQMF6WDJQZZKWQZZP4DVKFZUN2JAUVHRJOIZZ4SMNXQLVSZQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: read tcp 5.161.89.252:59898->64.49.13.154:4928: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 06:32:40.249154668 (14h5m53.83621091s) [noise=true , address=64.49.13.27:4963 , piece_id=CEB52PLVGIB2RIXEBBSUJAQQUPGC4U2JVFQ3J7HW3LMRIFWXCAYA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: read tcp 5.161.89.252:44876->64.49.13.27:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 06:32:40.249199352 (14h5m53.836255594s) [noise=true , address=64.49.13.137:4504 , piece_id=UXR3Z5Q6AJWVIA27IZHNPMRTTKLC4ENHVUQHVANK5L3AXOYOOWIA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:11LnrSYf8ZaxUgsdjt6jHzNgHjkq1bFCnDEFd14JzhParNTesZ): protocol: read tcp 5.161.89.252:19204->64.49.13.137:4504: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 06:32:40.249210163 (14h5m53.836266404s) [seg_pos={0 0}, upload=14568]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:32:40.249282678 (14h5m53.836338919s) [upload=14568]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:32:40.249287737 (14h5m53.836343968s) [upload=14568]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:32:40.302341870 (14h5m53.889398111s) [upload=14568]: Done uploading segments... Aug 8 06:32:40.302361056 (14h5m53.889417297s) [upload=14568]: Upload finished. err: <nil> Aug 8 06:33:19.671995961 (14h6m33.259052203s) [upload=14579]: Starting upload Aug 8 06:33:19.672056584 (14h6m33.259112826s) [upload=14579]: Done starting upload Aug 8 06:33:19.672119763 (14h6m33.259175994s) [upload=14579]: Uploading segments... Aug 8 06:33:19.672884900 (14h6m33.259941132s) [upload=14579]: Got next segment. Inline: false Aug 8 06:33:19.672932620 (14h6m33.259988862s) [upload=14579]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:33:19.672937719 (14h6m33.259993961s) [upload=14579]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:33:19.675836631 (14h6m33.262892862s) [upload=14579]: Next segment err: metaclient: Too Many Requests Aug 8 06:33:19.675851759 (14h6m33.262908s) [upload=14579]: Done uploading segments... Aug 8 06:33:19.675865856 (14h6m33.262922097s) [upload=14579]: Upload finished. err: metaclient: Too Many Requests Duration: 306.664462ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 350.827316ms FAIL (2025-08-08 06:33:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== XOBTOA7P67NE2JIELPZWQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065025521 (14h5m53.652081792s) [noise=true , address=104.36.82.23:4457 , piece_id=OOK6SCTGDGEMBOCXSBR2RC5IUS2EYPANIISO2IAPXNRWUFA4ORMQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065205998 (14h5m53.652262239s) [noise=true , address=104.36.82.62:4439 , piece_id=CMLMZQQLTVF3KHEIHNQTZAELFG3465HOYKMCK2UDYOQHPROML3SA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065455032 (14h5m53.652511273s) [noise=true , address=64.49.13.137:4504 , piece_id=UXR3Z5Q6AJWVIA27IZHNPMRTTKLC4ENHVUQHVANK5L3AXOYOOWIA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065786381 (14h5m53.652842622s) [noise=true , address=104.36.82.42:4808 , piece_id=5AGVDHXGAVLF6OPWT4KYTW6TFAPDPNADOPZ5C3KXAXRLI4OUNBDQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065845953 (14h5m53.652902193s) [noise=true , address=104.36.82.58:4273 , piece_id=H6VG6QUSKVNBAJRDQUV4PZIKBFGAM7OIX7BTB4UO5YW6EHVFR2FQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.066263101 (14h5m53.653319342s) [noise=true , address=64.49.13.154:4928 , piece_id=QDSHIQMF6WDJQZZKWQZZP4DVKFZUN2JAUVHRJOIZZ4SMNXQLVSZQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.066327521 (14h5m53.653383763s) [noise=true , address=104.36.82.59:4319 , piece_id=AIU65US456ESICJU42TGN43EC7KRVDXAQA4TXF3LEJ66ZQJSK3TQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.066919006 (14h5m53.653975247s) [noise=true , address=104.36.82.37:4657 , piece_id=DDJRHIGSD66WQQ3SAPQRKC7RHTHXASXDVNMIKQQDRTWKK5ADIUOQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067254953 (14h5m53.654311194s) [noise=true , address=64.49.13.27:4963 , piece_id=CEB52PLVGIB2RIXEBBSUJAQQUPGC4U2JVFQ3J7HW3LMRIFWXCAYA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067466127 (14h5m53.654522368s) [noise=true , address=104.36.82.36:4641 , piece_id=R7R33QBSBJUWWKVI2UXEDRKDCOCVYKMYVE2CEWK2MATSBZ3MGJIQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067873497 (14h5m53.654929738s) [noise=true , address=104.36.82.61:4404 , piece_id=DF4W6VI4HG7XX444VNPBKGDLK4EYJQZ5SKCZGBV6UNPJGGFA6BEA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067987530 (14h5m53.655043771s) [noise=true , address=104.36.82.45:4938 , piece_id=HYAUM7LFB7YKMLPBHD7PEBP6Y54JMZ2UAJTDTBCP3JAB3IBJHJEQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.068356108 (14h5m53.655412349s) [noise=true , address=104.36.82.60:4359 , piece_id=PT3LJH7ROPW2UXME5HDMDAHIFPZ3JILDNT6LUTNHYDSNFRRGIR4A, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.068429946 (14h5m53.655486187s) [noise=true , address=104.36.82.38:4693 , piece_id=QPR6POCGGHYGULCXPEOZBBSDBOV5DLTIW6ZUKMGPIJZLB3F3HNJA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.068896717 (14h5m53.655952958s) [noise=true , address=104.36.82.37:4684 , piece_id=PV6SS66AY2YJEC2CBYLQ4LQLWUS3KWVPIPPN46OAAFC4ZZQGX5XQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.069016020 (14h5m53.656072261s) [noise=true , address=104.36.82.43:4854 , piece_id=3YYPCYCMQQSKEG5WE6PD3QF5XJI3GN3FIAUNBQDOQ2URBGMHD7AA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.225413177 (14h5m53.812469418s) [upload=14568]: Next returned nil segment Aug 8 06:32:40.225429067 (14h5m53.812485298s) [upload=14568]: Waiting for error group managing segments... Aug 8 06:32:40.238535474 (14h5m53.825591705s) [noise=true , address=104.36.82.61:4404 , piece_id=DF4W6VI4HG7XX444VNPBKGDLK4EYJQZ5SKCZGBV6UNPJGGFA6BEA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.239293129 (14h5m53.826349371s) [noise=true , address=104.36.82.42:4808 , piece_id=5AGVDHXGAVLF6OPWT4KYTW6TFAPDPNADOPZ5C3KXAXRLI4OUNBDQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.241689332 (14h5m53.828745574s) [noise=true , address=104.36.82.23:4457 , piece_id=OOK6SCTGDGEMBOCXSBR2RC5IUS2EYPANIISO2IAPXNRWUFA4ORMQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.242096392 (14h5m53.829152623s) [noise=true , address=104.36.82.45:4938 , piece_id=HYAUM7LFB7YKMLPBHD7PEBP6Y54JMZ2UAJTDTBCP3JAB3IBJHJEQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.242267271 (14h5m53.829323512s) [noise=true , address=104.36.82.58:4273 , piece_id=H6VG6QUSKVNBAJRDQUV4PZIKBFGAM7OIX7BTB4UO5YW6EHVFR2FQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.242818750 (14h5m53.829874981s) [noise=true , address=104.36.82.37:4657 , piece_id=DDJRHIGSD66WQQ3SAPQRKC7RHTHXASXDVNMIKQQDRTWKK5ADIUOQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.243569251 (14h5m53.830625473s) [noise=true , address=104.36.82.38:4693 , piece_id=QPR6POCGGHYGULCXPEOZBBSDBOV5DLTIW6ZUKMGPIJZLB3F3HNJA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.244340481 (14h5m53.831396702s) [noise=true , address=104.36.82.60:4359 , piece_id=PT3LJH7ROPW2UXME5HDMDAHIFPZ3JILDNT6LUTNHYDSNFRRGIR4A, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.244984754 (14h5m53.832040985s) [noise=true , address=104.36.82.43:4854 , piece_id=3YYPCYCMQQSKEG5WE6PD3QF5XJI3GN3FIAUNBQDOQ2URBGMHD7AA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.245524792 (14h5m53.832581023s) [noise=true , address=104.36.82.37:4684 , piece_id=PV6SS66AY2YJEC2CBYLQ4LQLWUS3KWVPIPPN46OAAFC4ZZQGX5XQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.246872779 (14h5m53.83392901s) [noise=true , address=104.36.82.36:4641 , piece_id=R7R33QBSBJUWWKVI2UXEDRKDCOCVYKMYVE2CEWK2MATSBZ3MGJIQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.247331215 (14h5m53.834387456s) [noise=true , address=104.36.82.34:4561 , piece_id=D42SM3LJAAC7HHZWQEYBPWT6NOUQW3VUVHNPAODKKY54CWZWDQBQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.247891481 (14h5m53.834947722s) [noise=true , address=104.36.82.62:4439 , piece_id=CMLMZQQLTVF3KHEIHNQTZAELFG3465HOYKMCK2UDYOQHPROML3SA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.248431108 (14h5m53.835487338s) [noise=true , address=104.36.82.13:4204 , piece_id=WT2WD2ZAU5MBXXNBZFXLOVXMWUFOMPUXOBTOA7P67NE2JIELPZWQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.248441287 (14h5m53.835497528s) [seg_pos={0 0}, upload=14568]: Segment reached optimal threshold of 14 pieces. Aug 8 06:32:40.248563916 (14h5m53.835620157s) [noise=true , address=104.36.82.59:4319 , piece_id=AIU65US456ESICJU42TGN43EC7KRVDXAQA4TXF3LEJ66ZQJSK3TQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hzjVmYJbXH9yCxL2JUotjRKfWtgdUjSQKmPRByQAMjBkHqLRK): protocol: expected piece hash; context canceled; EOF Aug 8 06:32:40.249100268 (14h5m53.836156509s) [noise=true , address=64.49.13.154:4928 , piece_id=QDSHIQMF6WDJQZZKWQZZP4DVKFZUN2JAUVHRJOIZZ4SMNXQLVSZQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: read tcp 5.161.89.252:59898->64.49.13.154:4928: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 06:32:40.249154668 (14h5m53.83621091s) [noise=true , address=64.49.13.27:4963 , piece_id=CEB52PLVGIB2RIXEBBSUJAQQUPGC4U2JVFQ3J7HW3LMRIFWXCAYA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: read tcp 5.161.89.252:44876->64.49.13.27:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 06:32:40.249199352 (14h5m53.836255594s) [noise=true , address=64.49.13.137:4504 , piece_id=UXR3Z5Q6AJWVIA27IZHNPMRTTKLC4ENHVUQHVANK5L3AXOYOOWIA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:11LnrSYf8ZaxUgsdjt6jHzNgHjkq1bFCnDEFd14JzhParNTesZ): protocol: read tcp 5.161.89.252:19204->64.49.13.137:4504: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 06:32:40.249210163 (14h5m53.836266404s) [seg_pos={0 0}, upload=14568]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:32:40.249282678 (14h5m53.836338919s) [upload=14568]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:32:40.249287737 (14h5m53.836343968s) [upload=14568]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:32:40.302341870 (14h5m53.889398111s) [upload=14568]: Done uploading segments... Aug 8 06:32:40.302361056 (14h5m53.889417297s) [upload=14568]: Upload finished. err: <nil> Aug 8 06:33:19.671995961 (14h6m33.259052203s) [upload=14579]: Starting upload Aug 8 06:33:19.672056584 (14h6m33.259112826s) [upload=14579]: Done starting upload Aug 8 06:33:19.672119763 (14h6m33.259175994s) [upload=14579]: Uploading segments... Aug 8 06:33:19.672884900 (14h6m33.259941132s) [upload=14579]: Got next segment. Inline: false Aug 8 06:33:19.672932620 (14h6m33.259988862s) [upload=14579]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:33:19.672937719 (14h6m33.259993961s) [upload=14579]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:33:19.675836631 (14h6m33.262892862s) [upload=14579]: Next segment err: metaclient: Too Many Requests Aug 8 06:33:19.675851759 (14h6m33.262908s) [upload=14579]: Done uploading segments... Aug 8 06:33:19.675865856 (14h6m33.262922097s) [upload=14579]: Upload finished. err: metaclient: Too Many Requests Duration: 350.852624ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 19.563541ms FAIL (2025-08-08 06:33:19 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== XOBTOA7P67NE2JIELPZWQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065025521 (14h5m53.652081792s) [noise=true , address=104.36.82.23:4457 , piece_id=OOK6SCTGDGEMBOCXSBR2RC5IUS2EYPANIISO2IAPXNRWUFA4ORMQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065205998 (14h5m53.652262239s) [noise=true , address=104.36.82.62:4439 , piece_id=CMLMZQQLTVF3KHEIHNQTZAELFG3465HOYKMCK2UDYOQHPROML3SA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065455032 (14h5m53.652511273s) [noise=true , address=64.49.13.137:4504 , piece_id=UXR3Z5Q6AJWVIA27IZHNPMRTTKLC4ENHVUQHVANK5L3AXOYOOWIA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065786381 (14h5m53.652842622s) [noise=true , address=104.36.82.42:4808 , piece_id=5AGVDHXGAVLF6OPWT4KYTW6TFAPDPNADOPZ5C3KXAXRLI4OUNBDQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.065845953 (14h5m53.652902193s) [noise=true , address=104.36.82.58:4273 , piece_id=H6VG6QUSKVNBAJRDQUV4PZIKBFGAM7OIX7BTB4UO5YW6EHVFR2FQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.066263101 (14h5m53.653319342s) [noise=true , address=64.49.13.154:4928 , piece_id=QDSHIQMF6WDJQZZKWQZZP4DVKFZUN2JAUVHRJOIZZ4SMNXQLVSZQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.066327521 (14h5m53.653383763s) [noise=true , address=104.36.82.59:4319 , piece_id=AIU65US456ESICJU42TGN43EC7KRVDXAQA4TXF3LEJ66ZQJSK3TQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.066919006 (14h5m53.653975247s) [noise=true , address=104.36.82.37:4657 , piece_id=DDJRHIGSD66WQQ3SAPQRKC7RHTHXASXDVNMIKQQDRTWKK5ADIUOQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067254953 (14h5m53.654311194s) [noise=true , address=64.49.13.27:4963 , piece_id=CEB52PLVGIB2RIXEBBSUJAQQUPGC4U2JVFQ3J7HW3LMRIFWXCAYA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067466127 (14h5m53.654522368s) [noise=true , address=104.36.82.36:4641 , piece_id=R7R33QBSBJUWWKVI2UXEDRKDCOCVYKMYVE2CEWK2MATSBZ3MGJIQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067873497 (14h5m53.654929738s) [noise=true , address=104.36.82.61:4404 , piece_id=DF4W6VI4HG7XX444VNPBKGDLK4EYJQZ5SKCZGBV6UNPJGGFA6BEA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.067987530 (14h5m53.655043771s) [noise=true , address=104.36.82.45:4938 , piece_id=HYAUM7LFB7YKMLPBHD7PEBP6Y54JMZ2UAJTDTBCP3JAB3IBJHJEQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.068356108 (14h5m53.655412349s) [noise=true , address=104.36.82.60:4359 , piece_id=PT3LJH7ROPW2UXME5HDMDAHIFPZ3JILDNT6LUTNHYDSNFRRGIR4A, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.068429946 (14h5m53.655486187s) [noise=true , address=104.36.82.38:4693 , piece_id=QPR6POCGGHYGULCXPEOZBBSDBOV5DLTIW6ZUKMGPIJZLB3F3HNJA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.068896717 (14h5m53.655952958s) [noise=true , address=104.36.82.37:4684 , piece_id=PV6SS66AY2YJEC2CBYLQ4LQLWUS3KWVPIPPN46OAAFC4ZZQGX5XQ, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.069016020 (14h5m53.656072261s) [noise=true , address=104.36.82.43:4854 , piece_id=3YYPCYCMQQSKEG5WE6PD3QF5XJI3GN3FIAUNBQDOQ2URBGMHD7AA, seg_pos={0 0}, upload=14568]: Uploading piece... Aug 8 06:32:40.225413177 (14h5m53.812469418s) [upload=14568]: Next returned nil segment Aug 8 06:32:40.225429067 (14h5m53.812485298s) [upload=14568]: Waiting for error group managing segments... Aug 8 06:32:40.238535474 (14h5m53.825591705s) [noise=true , address=104.36.82.61:4404 , piece_id=DF4W6VI4HG7XX444VNPBKGDLK4EYJQZ5SKCZGBV6UNPJGGFA6BEA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.239293129 (14h5m53.826349371s) [noise=true , address=104.36.82.42:4808 , piece_id=5AGVDHXGAVLF6OPWT4KYTW6TFAPDPNADOPZ5C3KXAXRLI4OUNBDQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.241689332 (14h5m53.828745574s) [noise=true , address=104.36.82.23:4457 , piece_id=OOK6SCTGDGEMBOCXSBR2RC5IUS2EYPANIISO2IAPXNRWUFA4ORMQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.242096392 (14h5m53.829152623s) [noise=true , address=104.36.82.45:4938 , piece_id=HYAUM7LFB7YKMLPBHD7PEBP6Y54JMZ2UAJTDTBCP3JAB3IBJHJEQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.242267271 (14h5m53.829323512s) [noise=true , address=104.36.82.58:4273 , piece_id=H6VG6QUSKVNBAJRDQUV4PZIKBFGAM7OIX7BTB4UO5YW6EHVFR2FQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.242818750 (14h5m53.829874981s) [noise=true , address=104.36.82.37:4657 , piece_id=DDJRHIGSD66WQQ3SAPQRKC7RHTHXASXDVNMIKQQDRTWKK5ADIUOQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.243569251 (14h5m53.830625473s) [noise=true , address=104.36.82.38:4693 , piece_id=QPR6POCGGHYGULCXPEOZBBSDBOV5DLTIW6ZUKMGPIJZLB3F3HNJA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.244340481 (14h5m53.831396702s) [noise=true , address=104.36.82.60:4359 , piece_id=PT3LJH7ROPW2UXME5HDMDAHIFPZ3JILDNT6LUTNHYDSNFRRGIR4A, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.244984754 (14h5m53.832040985s) [noise=true , address=104.36.82.43:4854 , piece_id=3YYPCYCMQQSKEG5WE6PD3QF5XJI3GN3FIAUNBQDOQ2URBGMHD7AA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.245524792 (14h5m53.832581023s) [noise=true , address=104.36.82.37:4684 , piece_id=PV6SS66AY2YJEC2CBYLQ4LQLWUS3KWVPIPPN46OAAFC4ZZQGX5XQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.246872779 (14h5m53.83392901s) [noise=true , address=104.36.82.36:4641 , piece_id=R7R33QBSBJUWWKVI2UXEDRKDCOCVYKMYVE2CEWK2MATSBZ3MGJIQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.247331215 (14h5m53.834387456s) [noise=true , address=104.36.82.34:4561 , piece_id=D42SM3LJAAC7HHZWQEYBPWT6NOUQW3VUVHNPAODKKY54CWZWDQBQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.247891481 (14h5m53.834947722s) [noise=true , address=104.36.82.62:4439 , piece_id=CMLMZQQLTVF3KHEIHNQTZAELFG3465HOYKMCK2UDYOQHPROML3SA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.248431108 (14h5m53.835487338s) [noise=true , address=104.36.82.13:4204 , piece_id=WT2WD2ZAU5MBXXNBZFXLOVXMWUFOMPUXOBTOA7P67NE2JIELPZWQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: <nil> Aug 8 06:32:40.248441287 (14h5m53.835497528s) [seg_pos={0 0}, upload=14568]: Segment reached optimal threshold of 14 pieces. Aug 8 06:32:40.248563916 (14h5m53.835620157s) [noise=true , address=104.36.82.59:4319 , piece_id=AIU65US456ESICJU42TGN43EC7KRVDXAQA4TXF3LEJ66ZQJSK3TQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hzjVmYJbXH9yCxL2JUotjRKfWtgdUjSQKmPRByQAMjBkHqLRK): protocol: expected piece hash; context canceled; EOF Aug 8 06:32:40.249100268 (14h5m53.836156509s) [noise=true , address=64.49.13.154:4928 , piece_id=QDSHIQMF6WDJQZZKWQZZP4DVKFZUN2JAUVHRJOIZZ4SMNXQLVSZQ, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126yMXrtihbzi2iQB399nmL6ARMD7NJp6Bg1YYhhVPJ7kE1DQSD): protocol: read tcp 5.161.89.252:59898->64.49.13.154:4928: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 06:32:40.249154668 (14h5m53.83621091s) [noise=true , address=64.49.13.27:4963 , piece_id=CEB52PLVGIB2RIXEBBSUJAQQUPGC4U2JVFQ3J7HW3LMRIFWXCAYA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: read tcp 5.161.89.252:44876->64.49.13.27:4963: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 06:32:40.249199352 (14h5m53.836255594s) [noise=true , address=64.49.13.137:4504 , piece_id=UXR3Z5Q6AJWVIA27IZHNPMRTTKLC4ENHVUQHVANK5L3AXOYOOWIA, seg_pos={0 0}, upload=14568]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:11LnrSYf8ZaxUgsdjt6jHzNgHjkq1bFCnDEFd14JzhParNTesZ): protocol: read tcp 5.161.89.252:19204->64.49.13.137:4504: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 06:32:40.249210163 (14h5m53.836266404s) [seg_pos={0 0}, upload=14568]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:32:40.249282678 (14h5m53.836338919s) [upload=14568]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:32:40.249287737 (14h5m53.836343968s) [upload=14568]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:32:40.302341870 (14h5m53.889398111s) [upload=14568]: Done uploading segments... Aug 8 06:32:40.302361056 (14h5m53.889417297s) [upload=14568]: Upload finished. err: <nil> Aug 8 06:33:19.671995961 (14h6m33.259052203s) [upload=14579]: Starting upload Aug 8 06:33:19.672056584 (14h6m33.259112826s) [upload=14579]: Done starting upload Aug 8 06:33:19.672119763 (14h6m33.259175994s) [upload=14579]: Uploading segments... Aug 8 06:33:19.672884900 (14h6m33.259941132s) [upload=14579]: Got next segment. Inline: false Aug 8 06:33:19.672932620 (14h6m33.259988862s) [upload=14579]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:33:19.672937719 (14h6m33.259993961s) [upload=14579]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:33:19.675836631 (14h6m33.262892862s) [upload=14579]: Next segment err: metaclient: Too Many Requests Aug 8 06:33:19.675851759 (14h6m33.262908s) [upload=14579]: Done uploading segments... Aug 8 06:33:19.675865856 (14h6m33.262922097s) [upload=14579]: Upload finished. err: metaclient: Too Many Requests Duration: 19.584271ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 412.388839ms FAIL (2025-08-08 05:47:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== FUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902886958 (12h38m23.489943169s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902968320 (12h38m23.490024531s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903203899 (12h38m23.49026011s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903277728 (12h38m23.490333949s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903887185 (12h38m23.490943396s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904280910 (12h38m23.491337121s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904741781 (12h38m23.491798002s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.905445835 (12h38m23.492502056s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908065075 (12h38m23.495121286s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908337784 (12h38m23.495394005s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908596446 (12h38m23.495652667s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908863415 (12h38m23.495919626s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909095087 (12h38m23.496151298s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909564894 (12h38m23.496621105s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909798521 (12h38m23.496854732s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913123327 (12h38m23.500179539s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913897903 (12h38m23.500954124s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.994958464 (12h38m23.582014675s) [upload=13052]: Next returned nil segment Aug 8 05:05:09.994970847 (12h38m23.582027059s) [upload=13052]: Waiting for error group managing segments... Aug 8 05:05:10.004228059 (12h38m23.591284269s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.006942486 (12h38m23.593998707s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.007054394 (12h38m23.594110606s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008056936 (12h38m23.595113157s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008229177 (12h38m23.595285388s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008399085 (12h38m23.595455295s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.009486263 (12h38m23.596542475s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.010095211 (12h38m23.597151421s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012507043 (12h38m23.599563255s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012930493 (12h38m23.599986714s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016274496 (12h38m23.603330717s) [noise=true , address=104.36.82.46:4484 , piece_id=6XF4A3CJFEIR7YYJRKQEGKEMQRHZL2476NYKBDCRLVFUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016318107 (12h38m23.603374318s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.017348971 (12h38m23.604405192s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019251644 (12h38m23.606307865s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019271681 (12h38m23.606327902s) [seg_pos={0 0}, upload=13052]: Segment reached optimal threshold of 14 pieces. Aug 8 05:05:10.019364094 (12h38m23.606420315s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HZjKTnjpeNU5B6muVHGrmWQS8GsyuYTW6cLxzNk5CGt3b8PJS): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019419366 (12h38m23.606475587s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ArPftAghEJaoHeAEPqGK9QDhRguh3yEovFUjkEMSDBdsfAVnC): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019436980 (12h38m23.606493201s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019551794 (12h38m23.606608015s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:34900->64.49.13.139:4471: use of closed network connection; context canceled Aug 8 05:05:10.019574186 (12h38m23.606630407s) [seg_pos={0 0}, upload=13052]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:05:10.019623639 (12h38m23.60667986s) [upload=13052]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:05:10.019627686 (12h38m23.606683908s) [upload=13052]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:05:10.062625493 (12h38m23.649681704s) [upload=13052]: Done uploading segments... Aug 8 05:05:10.062638988 (12h38m23.649695199s) [upload=13052]: Upload finished. err: <nil> Aug 8 05:05:59.222059876 (12h39m12.809116097s) [upload=13062]: Starting upload Aug 8 05:05:59.222115750 (12h39m12.809171971s) [upload=13062]: Done starting upload Aug 8 05:05:59.222204426 (12h39m12.809260667s) [upload=13062]: Uploading segments... Aug 8 05:05:59.222357882 (12h39m12.809414094s) [upload=13062]: Got next segment. Inline: false Aug 8 05:05:59.222388720 (12h39m12.809444941s) [upload=13062]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:05:59.222392987 (12h39m12.809449198s) [upload=13062]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:05:59.224964628 (12h39m12.81202087s) [upload=13062]: Next segment err: metaclient: Too Many Requests Aug 8 05:05:59.224998492 (12h39m12.812054733s) [upload=13062]: Done uploading segments... Aug 8 05:05:59.225016314 (12h39m12.812072566s) [upload=13062]: Upload finished. err: metaclient: Too Many Requests Duration: 412.417051ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 402.569935ms FAIL (2025-08-08 05:46:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== FUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902886958 (12h38m23.489943169s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902968320 (12h38m23.490024531s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903203899 (12h38m23.49026011s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903277728 (12h38m23.490333949s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903887185 (12h38m23.490943396s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904280910 (12h38m23.491337121s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904741781 (12h38m23.491798002s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.905445835 (12h38m23.492502056s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908065075 (12h38m23.495121286s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908337784 (12h38m23.495394005s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908596446 (12h38m23.495652667s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908863415 (12h38m23.495919626s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909095087 (12h38m23.496151298s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909564894 (12h38m23.496621105s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909798521 (12h38m23.496854732s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913123327 (12h38m23.500179539s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913897903 (12h38m23.500954124s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.994958464 (12h38m23.582014675s) [upload=13052]: Next returned nil segment Aug 8 05:05:09.994970847 (12h38m23.582027059s) [upload=13052]: Waiting for error group managing segments... Aug 8 05:05:10.004228059 (12h38m23.591284269s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.006942486 (12h38m23.593998707s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.007054394 (12h38m23.594110606s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008056936 (12h38m23.595113157s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008229177 (12h38m23.595285388s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008399085 (12h38m23.595455295s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.009486263 (12h38m23.596542475s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.010095211 (12h38m23.597151421s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012507043 (12h38m23.599563255s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012930493 (12h38m23.599986714s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016274496 (12h38m23.603330717s) [noise=true , address=104.36.82.46:4484 , piece_id=6XF4A3CJFEIR7YYJRKQEGKEMQRHZL2476NYKBDCRLVFUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016318107 (12h38m23.603374318s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.017348971 (12h38m23.604405192s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019251644 (12h38m23.606307865s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019271681 (12h38m23.606327902s) [seg_pos={0 0}, upload=13052]: Segment reached optimal threshold of 14 pieces. Aug 8 05:05:10.019364094 (12h38m23.606420315s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HZjKTnjpeNU5B6muVHGrmWQS8GsyuYTW6cLxzNk5CGt3b8PJS): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019419366 (12h38m23.606475587s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ArPftAghEJaoHeAEPqGK9QDhRguh3yEovFUjkEMSDBdsfAVnC): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019436980 (12h38m23.606493201s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019551794 (12h38m23.606608015s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:34900->64.49.13.139:4471: use of closed network connection; context canceled Aug 8 05:05:10.019574186 (12h38m23.606630407s) [seg_pos={0 0}, upload=13052]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:05:10.019623639 (12h38m23.60667986s) [upload=13052]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:05:10.019627686 (12h38m23.606683908s) [upload=13052]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:05:10.062625493 (12h38m23.649681704s) [upload=13052]: Done uploading segments... Aug 8 05:05:10.062638988 (12h38m23.649695199s) [upload=13052]: Upload finished. err: <nil> Aug 8 05:05:59.222059876 (12h39m12.809116097s) [upload=13062]: Starting upload Aug 8 05:05:59.222115750 (12h39m12.809171971s) [upload=13062]: Done starting upload Aug 8 05:05:59.222204426 (12h39m12.809260667s) [upload=13062]: Uploading segments... Aug 8 05:05:59.222357882 (12h39m12.809414094s) [upload=13062]: Got next segment. Inline: false Aug 8 05:05:59.222388720 (12h39m12.809444941s) [upload=13062]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:05:59.222392987 (12h39m12.809449198s) [upload=13062]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:05:59.224964628 (12h39m12.81202087s) [upload=13062]: Next segment err: metaclient: Too Many Requests Aug 8 05:05:59.224998492 (12h39m12.812054733s) [upload=13062]: Done uploading segments... Aug 8 05:05:59.225016314 (12h39m12.812072566s) [upload=13062]: Upload finished. err: metaclient: Too Many Requests Duration: 402.636388ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 367.033768ms FAIL (2025-08-08 05:45:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== FUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902886958 (12h38m23.489943169s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902968320 (12h38m23.490024531s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903203899 (12h38m23.49026011s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903277728 (12h38m23.490333949s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903887185 (12h38m23.490943396s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904280910 (12h38m23.491337121s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904741781 (12h38m23.491798002s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.905445835 (12h38m23.492502056s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908065075 (12h38m23.495121286s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908337784 (12h38m23.495394005s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908596446 (12h38m23.495652667s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908863415 (12h38m23.495919626s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909095087 (12h38m23.496151298s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909564894 (12h38m23.496621105s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909798521 (12h38m23.496854732s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913123327 (12h38m23.500179539s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913897903 (12h38m23.500954124s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.994958464 (12h38m23.582014675s) [upload=13052]: Next returned nil segment Aug 8 05:05:09.994970847 (12h38m23.582027059s) [upload=13052]: Waiting for error group managing segments... Aug 8 05:05:10.004228059 (12h38m23.591284269s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.006942486 (12h38m23.593998707s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.007054394 (12h38m23.594110606s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008056936 (12h38m23.595113157s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008229177 (12h38m23.595285388s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008399085 (12h38m23.595455295s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.009486263 (12h38m23.596542475s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.010095211 (12h38m23.597151421s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012507043 (12h38m23.599563255s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012930493 (12h38m23.599986714s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016274496 (12h38m23.603330717s) [noise=true , address=104.36.82.46:4484 , piece_id=6XF4A3CJFEIR7YYJRKQEGKEMQRHZL2476NYKBDCRLVFUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016318107 (12h38m23.603374318s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.017348971 (12h38m23.604405192s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019251644 (12h38m23.606307865s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019271681 (12h38m23.606327902s) [seg_pos={0 0}, upload=13052]: Segment reached optimal threshold of 14 pieces. Aug 8 05:05:10.019364094 (12h38m23.606420315s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HZjKTnjpeNU5B6muVHGrmWQS8GsyuYTW6cLxzNk5CGt3b8PJS): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019419366 (12h38m23.606475587s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ArPftAghEJaoHeAEPqGK9QDhRguh3yEovFUjkEMSDBdsfAVnC): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019436980 (12h38m23.606493201s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019551794 (12h38m23.606608015s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:34900->64.49.13.139:4471: use of closed network connection; context canceled Aug 8 05:05:10.019574186 (12h38m23.606630407s) [seg_pos={0 0}, upload=13052]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:05:10.019623639 (12h38m23.60667986s) [upload=13052]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:05:10.019627686 (12h38m23.606683908s) [upload=13052]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:05:10.062625493 (12h38m23.649681704s) [upload=13052]: Done uploading segments... Aug 8 05:05:10.062638988 (12h38m23.649695199s) [upload=13052]: Upload finished. err: <nil> Aug 8 05:05:59.222059876 (12h39m12.809116097s) [upload=13062]: Starting upload Aug 8 05:05:59.222115750 (12h39m12.809171971s) [upload=13062]: Done starting upload Aug 8 05:05:59.222204426 (12h39m12.809260667s) [upload=13062]: Uploading segments... Aug 8 05:05:59.222357882 (12h39m12.809414094s) [upload=13062]: Got next segment. Inline: false Aug 8 05:05:59.222388720 (12h39m12.809444941s) [upload=13062]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:05:59.222392987 (12h39m12.809449198s) [upload=13062]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:05:59.224964628 (12h39m12.81202087s) [upload=13062]: Next segment err: metaclient: Too Many Requests Aug 8 05:05:59.224998492 (12h39m12.812054733s) [upload=13062]: Done uploading segments... Aug 8 05:05:59.225016314 (12h39m12.812072566s) [upload=13062]: Upload finished. err: metaclient: Too Many Requests Duration: 367.059476ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 363.939231ms FAIL (2025-08-08 05:44:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== FUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902886958 (12h38m23.489943169s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902968320 (12h38m23.490024531s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903203899 (12h38m23.49026011s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903277728 (12h38m23.490333949s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903887185 (12h38m23.490943396s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904280910 (12h38m23.491337121s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904741781 (12h38m23.491798002s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.905445835 (12h38m23.492502056s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908065075 (12h38m23.495121286s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908337784 (12h38m23.495394005s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908596446 (12h38m23.495652667s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908863415 (12h38m23.495919626s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909095087 (12h38m23.496151298s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909564894 (12h38m23.496621105s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909798521 (12h38m23.496854732s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913123327 (12h38m23.500179539s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913897903 (12h38m23.500954124s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.994958464 (12h38m23.582014675s) [upload=13052]: Next returned nil segment Aug 8 05:05:09.994970847 (12h38m23.582027059s) [upload=13052]: Waiting for error group managing segments... Aug 8 05:05:10.004228059 (12h38m23.591284269s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.006942486 (12h38m23.593998707s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.007054394 (12h38m23.594110606s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008056936 (12h38m23.595113157s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008229177 (12h38m23.595285388s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008399085 (12h38m23.595455295s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.009486263 (12h38m23.596542475s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.010095211 (12h38m23.597151421s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012507043 (12h38m23.599563255s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012930493 (12h38m23.599986714s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016274496 (12h38m23.603330717s) [noise=true , address=104.36.82.46:4484 , piece_id=6XF4A3CJFEIR7YYJRKQEGKEMQRHZL2476NYKBDCRLVFUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016318107 (12h38m23.603374318s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.017348971 (12h38m23.604405192s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019251644 (12h38m23.606307865s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019271681 (12h38m23.606327902s) [seg_pos={0 0}, upload=13052]: Segment reached optimal threshold of 14 pieces. Aug 8 05:05:10.019364094 (12h38m23.606420315s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HZjKTnjpeNU5B6muVHGrmWQS8GsyuYTW6cLxzNk5CGt3b8PJS): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019419366 (12h38m23.606475587s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ArPftAghEJaoHeAEPqGK9QDhRguh3yEovFUjkEMSDBdsfAVnC): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019436980 (12h38m23.606493201s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019551794 (12h38m23.606608015s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:34900->64.49.13.139:4471: use of closed network connection; context canceled Aug 8 05:05:10.019574186 (12h38m23.606630407s) [seg_pos={0 0}, upload=13052]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:05:10.019623639 (12h38m23.60667986s) [upload=13052]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:05:10.019627686 (12h38m23.606683908s) [upload=13052]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:05:10.062625493 (12h38m23.649681704s) [upload=13052]: Done uploading segments... Aug 8 05:05:10.062638988 (12h38m23.649695199s) [upload=13052]: Upload finished. err: <nil> Aug 8 05:05:59.222059876 (12h39m12.809116097s) [upload=13062]: Starting upload Aug 8 05:05:59.222115750 (12h39m12.809171971s) [upload=13062]: Done starting upload Aug 8 05:05:59.222204426 (12h39m12.809260667s) [upload=13062]: Uploading segments... Aug 8 05:05:59.222357882 (12h39m12.809414094s) [upload=13062]: Got next segment. Inline: false Aug 8 05:05:59.222388720 (12h39m12.809444941s) [upload=13062]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:05:59.222392987 (12h39m12.809449198s) [upload=13062]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:05:59.224964628 (12h39m12.81202087s) [upload=13062]: Next segment err: metaclient: Too Many Requests Aug 8 05:05:59.224998492 (12h39m12.812054733s) [upload=13062]: Done uploading segments... Aug 8 05:05:59.225016314 (12h39m12.812072566s) [upload=13062]: Upload finished. err: metaclient: Too Many Requests Duration: 363.957343ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 355.058522ms FAIL (2025-08-08 05:44:19 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== FUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902886958 (12h38m23.489943169s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902968320 (12h38m23.490024531s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903203899 (12h38m23.49026011s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903277728 (12h38m23.490333949s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903887185 (12h38m23.490943396s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904280910 (12h38m23.491337121s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904741781 (12h38m23.491798002s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.905445835 (12h38m23.492502056s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908065075 (12h38m23.495121286s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908337784 (12h38m23.495394005s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908596446 (12h38m23.495652667s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908863415 (12h38m23.495919626s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909095087 (12h38m23.496151298s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909564894 (12h38m23.496621105s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909798521 (12h38m23.496854732s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913123327 (12h38m23.500179539s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913897903 (12h38m23.500954124s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.994958464 (12h38m23.582014675s) [upload=13052]: Next returned nil segment Aug 8 05:05:09.994970847 (12h38m23.582027059s) [upload=13052]: Waiting for error group managing segments... Aug 8 05:05:10.004228059 (12h38m23.591284269s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.006942486 (12h38m23.593998707s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.007054394 (12h38m23.594110606s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008056936 (12h38m23.595113157s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008229177 (12h38m23.595285388s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008399085 (12h38m23.595455295s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.009486263 (12h38m23.596542475s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.010095211 (12h38m23.597151421s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012507043 (12h38m23.599563255s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012930493 (12h38m23.599986714s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016274496 (12h38m23.603330717s) [noise=true , address=104.36.82.46:4484 , piece_id=6XF4A3CJFEIR7YYJRKQEGKEMQRHZL2476NYKBDCRLVFUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016318107 (12h38m23.603374318s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.017348971 (12h38m23.604405192s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019251644 (12h38m23.606307865s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019271681 (12h38m23.606327902s) [seg_pos={0 0}, upload=13052]: Segment reached optimal threshold of 14 pieces. Aug 8 05:05:10.019364094 (12h38m23.606420315s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HZjKTnjpeNU5B6muVHGrmWQS8GsyuYTW6cLxzNk5CGt3b8PJS): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019419366 (12h38m23.606475587s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ArPftAghEJaoHeAEPqGK9QDhRguh3yEovFUjkEMSDBdsfAVnC): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019436980 (12h38m23.606493201s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019551794 (12h38m23.606608015s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:34900->64.49.13.139:4471: use of closed network connection; context canceled Aug 8 05:05:10.019574186 (12h38m23.606630407s) [seg_pos={0 0}, upload=13052]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:05:10.019623639 (12h38m23.60667986s) [upload=13052]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:05:10.019627686 (12h38m23.606683908s) [upload=13052]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:05:10.062625493 (12h38m23.649681704s) [upload=13052]: Done uploading segments... Aug 8 05:05:10.062638988 (12h38m23.649695199s) [upload=13052]: Upload finished. err: <nil> Aug 8 05:05:59.222059876 (12h39m12.809116097s) [upload=13062]: Starting upload Aug 8 05:05:59.222115750 (12h39m12.809171971s) [upload=13062]: Done starting upload Aug 8 05:05:59.222204426 (12h39m12.809260667s) [upload=13062]: Uploading segments... Aug 8 05:05:59.222357882 (12h39m12.809414094s) [upload=13062]: Got next segment. Inline: false Aug 8 05:05:59.222388720 (12h39m12.809444941s) [upload=13062]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:05:59.222392987 (12h39m12.809449198s) [upload=13062]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:05:59.224964628 (12h39m12.81202087s) [upload=13062]: Next segment err: metaclient: Too Many Requests Aug 8 05:05:59.224998492 (12h39m12.812054733s) [upload=13062]: Done uploading segments... Aug 8 05:05:59.225016314 (12h39m12.812072566s) [upload=13062]: Upload finished. err: metaclient: Too Many Requests Duration: 355.086384ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 401.745768ms FAIL (2025-08-08 05:43:37 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== FUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902886958 (12h38m23.489943169s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902968320 (12h38m23.490024531s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903203899 (12h38m23.49026011s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903277728 (12h38m23.490333949s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903887185 (12h38m23.490943396s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904280910 (12h38m23.491337121s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904741781 (12h38m23.491798002s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.905445835 (12h38m23.492502056s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908065075 (12h38m23.495121286s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908337784 (12h38m23.495394005s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908596446 (12h38m23.495652667s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908863415 (12h38m23.495919626s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909095087 (12h38m23.496151298s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909564894 (12h38m23.496621105s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909798521 (12h38m23.496854732s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913123327 (12h38m23.500179539s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913897903 (12h38m23.500954124s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.994958464 (12h38m23.582014675s) [upload=13052]: Next returned nil segment Aug 8 05:05:09.994970847 (12h38m23.582027059s) [upload=13052]: Waiting for error group managing segments... Aug 8 05:05:10.004228059 (12h38m23.591284269s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.006942486 (12h38m23.593998707s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.007054394 (12h38m23.594110606s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008056936 (12h38m23.595113157s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008229177 (12h38m23.595285388s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008399085 (12h38m23.595455295s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.009486263 (12h38m23.596542475s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.010095211 (12h38m23.597151421s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012507043 (12h38m23.599563255s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012930493 (12h38m23.599986714s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016274496 (12h38m23.603330717s) [noise=true , address=104.36.82.46:4484 , piece_id=6XF4A3CJFEIR7YYJRKQEGKEMQRHZL2476NYKBDCRLVFUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016318107 (12h38m23.603374318s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.017348971 (12h38m23.604405192s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019251644 (12h38m23.606307865s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019271681 (12h38m23.606327902s) [seg_pos={0 0}, upload=13052]: Segment reached optimal threshold of 14 pieces. Aug 8 05:05:10.019364094 (12h38m23.606420315s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HZjKTnjpeNU5B6muVHGrmWQS8GsyuYTW6cLxzNk5CGt3b8PJS): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019419366 (12h38m23.606475587s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ArPftAghEJaoHeAEPqGK9QDhRguh3yEovFUjkEMSDBdsfAVnC): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019436980 (12h38m23.606493201s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019551794 (12h38m23.606608015s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:34900->64.49.13.139:4471: use of closed network connection; context canceled Aug 8 05:05:10.019574186 (12h38m23.606630407s) [seg_pos={0 0}, upload=13052]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:05:10.019623639 (12h38m23.60667986s) [upload=13052]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:05:10.019627686 (12h38m23.606683908s) [upload=13052]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:05:10.062625493 (12h38m23.649681704s) [upload=13052]: Done uploading segments... Aug 8 05:05:10.062638988 (12h38m23.649695199s) [upload=13052]: Upload finished. err: <nil> Aug 8 05:05:59.222059876 (12h39m12.809116097s) [upload=13062]: Starting upload Aug 8 05:05:59.222115750 (12h39m12.809171971s) [upload=13062]: Done starting upload Aug 8 05:05:59.222204426 (12h39m12.809260667s) [upload=13062]: Uploading segments... Aug 8 05:05:59.222357882 (12h39m12.809414094s) [upload=13062]: Got next segment. Inline: false Aug 8 05:05:59.222388720 (12h39m12.809444941s) [upload=13062]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:05:59.222392987 (12h39m12.809449198s) [upload=13062]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:05:59.224964628 (12h39m12.81202087s) [upload=13062]: Next segment err: metaclient: Too Many Requests Aug 8 05:05:59.224998492 (12h39m12.812054733s) [upload=13062]: Done uploading segments... Aug 8 05:05:59.225016314 (12h39m12.812072566s) [upload=13062]: Upload finished. err: metaclient: Too Many Requests Duration: 401.779502ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 349.987354ms FAIL (2025-08-08 05:42:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== FUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902886958 (12h38m23.489943169s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902968320 (12h38m23.490024531s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903203899 (12h38m23.49026011s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903277728 (12h38m23.490333949s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903887185 (12h38m23.490943396s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904280910 (12h38m23.491337121s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904741781 (12h38m23.491798002s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.905445835 (12h38m23.492502056s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908065075 (12h38m23.495121286s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908337784 (12h38m23.495394005s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908596446 (12h38m23.495652667s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908863415 (12h38m23.495919626s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909095087 (12h38m23.496151298s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909564894 (12h38m23.496621105s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909798521 (12h38m23.496854732s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913123327 (12h38m23.500179539s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913897903 (12h38m23.500954124s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.994958464 (12h38m23.582014675s) [upload=13052]: Next returned nil segment Aug 8 05:05:09.994970847 (12h38m23.582027059s) [upload=13052]: Waiting for error group managing segments... Aug 8 05:05:10.004228059 (12h38m23.591284269s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.006942486 (12h38m23.593998707s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.007054394 (12h38m23.594110606s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008056936 (12h38m23.595113157s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008229177 (12h38m23.595285388s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008399085 (12h38m23.595455295s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.009486263 (12h38m23.596542475s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.010095211 (12h38m23.597151421s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012507043 (12h38m23.599563255s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012930493 (12h38m23.599986714s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016274496 (12h38m23.603330717s) [noise=true , address=104.36.82.46:4484 , piece_id=6XF4A3CJFEIR7YYJRKQEGKEMQRHZL2476NYKBDCRLVFUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016318107 (12h38m23.603374318s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.017348971 (12h38m23.604405192s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019251644 (12h38m23.606307865s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019271681 (12h38m23.606327902s) [seg_pos={0 0}, upload=13052]: Segment reached optimal threshold of 14 pieces. Aug 8 05:05:10.019364094 (12h38m23.606420315s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HZjKTnjpeNU5B6muVHGrmWQS8GsyuYTW6cLxzNk5CGt3b8PJS): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019419366 (12h38m23.606475587s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ArPftAghEJaoHeAEPqGK9QDhRguh3yEovFUjkEMSDBdsfAVnC): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019436980 (12h38m23.606493201s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019551794 (12h38m23.606608015s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:34900->64.49.13.139:4471: use of closed network connection; context canceled Aug 8 05:05:10.019574186 (12h38m23.606630407s) [seg_pos={0 0}, upload=13052]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:05:10.019623639 (12h38m23.60667986s) [upload=13052]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:05:10.019627686 (12h38m23.606683908s) [upload=13052]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:05:10.062625493 (12h38m23.649681704s) [upload=13052]: Done uploading segments... Aug 8 05:05:10.062638988 (12h38m23.649695199s) [upload=13052]: Upload finished. err: <nil> Aug 8 05:05:59.222059876 (12h39m12.809116097s) [upload=13062]: Starting upload Aug 8 05:05:59.222115750 (12h39m12.809171971s) [upload=13062]: Done starting upload Aug 8 05:05:59.222204426 (12h39m12.809260667s) [upload=13062]: Uploading segments... Aug 8 05:05:59.222357882 (12h39m12.809414094s) [upload=13062]: Got next segment. Inline: false Aug 8 05:05:59.222388720 (12h39m12.809444941s) [upload=13062]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:05:59.222392987 (12h39m12.809449198s) [upload=13062]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:05:59.224964628 (12h39m12.81202087s) [upload=13062]: Next segment err: metaclient: Too Many Requests Aug 8 05:05:59.224998492 (12h39m12.812054733s) [upload=13062]: Done uploading segments... Aug 8 05:05:59.225016314 (12h39m12.812072566s) [upload=13062]: Upload finished. err: metaclient: Too Many Requests Duration: 350.005327ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 341.495802ms FAIL (2025-08-08 05:42:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== FUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902886958 (12h38m23.489943169s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902968320 (12h38m23.490024531s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903203899 (12h38m23.49026011s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903277728 (12h38m23.490333949s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903887185 (12h38m23.490943396s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904280910 (12h38m23.491337121s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904741781 (12h38m23.491798002s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.905445835 (12h38m23.492502056s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908065075 (12h38m23.495121286s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908337784 (12h38m23.495394005s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908596446 (12h38m23.495652667s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908863415 (12h38m23.495919626s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909095087 (12h38m23.496151298s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909564894 (12h38m23.496621105s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909798521 (12h38m23.496854732s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913123327 (12h38m23.500179539s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913897903 (12h38m23.500954124s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.994958464 (12h38m23.582014675s) [upload=13052]: Next returned nil segment Aug 8 05:05:09.994970847 (12h38m23.582027059s) [upload=13052]: Waiting for error group managing segments... Aug 8 05:05:10.004228059 (12h38m23.591284269s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.006942486 (12h38m23.593998707s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.007054394 (12h38m23.594110606s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008056936 (12h38m23.595113157s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008229177 (12h38m23.595285388s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008399085 (12h38m23.595455295s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.009486263 (12h38m23.596542475s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.010095211 (12h38m23.597151421s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012507043 (12h38m23.599563255s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012930493 (12h38m23.599986714s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016274496 (12h38m23.603330717s) [noise=true , address=104.36.82.46:4484 , piece_id=6XF4A3CJFEIR7YYJRKQEGKEMQRHZL2476NYKBDCRLVFUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016318107 (12h38m23.603374318s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.017348971 (12h38m23.604405192s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019251644 (12h38m23.606307865s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019271681 (12h38m23.606327902s) [seg_pos={0 0}, upload=13052]: Segment reached optimal threshold of 14 pieces. Aug 8 05:05:10.019364094 (12h38m23.606420315s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HZjKTnjpeNU5B6muVHGrmWQS8GsyuYTW6cLxzNk5CGt3b8PJS): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019419366 (12h38m23.606475587s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ArPftAghEJaoHeAEPqGK9QDhRguh3yEovFUjkEMSDBdsfAVnC): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019436980 (12h38m23.606493201s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019551794 (12h38m23.606608015s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:34900->64.49.13.139:4471: use of closed network connection; context canceled Aug 8 05:05:10.019574186 (12h38m23.606630407s) [seg_pos={0 0}, upload=13052]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:05:10.019623639 (12h38m23.60667986s) [upload=13052]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:05:10.019627686 (12h38m23.606683908s) [upload=13052]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:05:10.062625493 (12h38m23.649681704s) [upload=13052]: Done uploading segments... Aug 8 05:05:10.062638988 (12h38m23.649695199s) [upload=13052]: Upload finished. err: <nil> Aug 8 05:05:59.222059876 (12h39m12.809116097s) [upload=13062]: Starting upload Aug 8 05:05:59.222115750 (12h39m12.809171971s) [upload=13062]: Done starting upload Aug 8 05:05:59.222204426 (12h39m12.809260667s) [upload=13062]: Uploading segments... Aug 8 05:05:59.222357882 (12h39m12.809414094s) [upload=13062]: Got next segment. Inline: false Aug 8 05:05:59.222388720 (12h39m12.809444941s) [upload=13062]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:05:59.222392987 (12h39m12.809449198s) [upload=13062]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:05:59.224964628 (12h39m12.81202087s) [upload=13062]: Next segment err: metaclient: Too Many Requests Aug 8 05:05:59.224998492 (12h39m12.812054733s) [upload=13062]: Done uploading segments... Aug 8 05:05:59.225016314 (12h39m12.812072566s) [upload=13062]: Upload finished. err: metaclient: Too Many Requests Duration: 341.518926ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 1.828708421s FAIL (2025-08-08 05:42:19 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== FUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902886958 (12h38m23.489943169s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902968320 (12h38m23.490024531s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903203899 (12h38m23.49026011s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903277728 (12h38m23.490333949s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903887185 (12h38m23.490943396s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904280910 (12h38m23.491337121s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904741781 (12h38m23.491798002s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.905445835 (12h38m23.492502056s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908065075 (12h38m23.495121286s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908337784 (12h38m23.495394005s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908596446 (12h38m23.495652667s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908863415 (12h38m23.495919626s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909095087 (12h38m23.496151298s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909564894 (12h38m23.496621105s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909798521 (12h38m23.496854732s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913123327 (12h38m23.500179539s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913897903 (12h38m23.500954124s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.994958464 (12h38m23.582014675s) [upload=13052]: Next returned nil segment Aug 8 05:05:09.994970847 (12h38m23.582027059s) [upload=13052]: Waiting for error group managing segments... Aug 8 05:05:10.004228059 (12h38m23.591284269s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.006942486 (12h38m23.593998707s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.007054394 (12h38m23.594110606s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008056936 (12h38m23.595113157s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008229177 (12h38m23.595285388s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008399085 (12h38m23.595455295s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.009486263 (12h38m23.596542475s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.010095211 (12h38m23.597151421s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012507043 (12h38m23.599563255s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012930493 (12h38m23.599986714s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016274496 (12h38m23.603330717s) [noise=true , address=104.36.82.46:4484 , piece_id=6XF4A3CJFEIR7YYJRKQEGKEMQRHZL2476NYKBDCRLVFUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016318107 (12h38m23.603374318s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.017348971 (12h38m23.604405192s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019251644 (12h38m23.606307865s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019271681 (12h38m23.606327902s) [seg_pos={0 0}, upload=13052]: Segment reached optimal threshold of 14 pieces. Aug 8 05:05:10.019364094 (12h38m23.606420315s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HZjKTnjpeNU5B6muVHGrmWQS8GsyuYTW6cLxzNk5CGt3b8PJS): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019419366 (12h38m23.606475587s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ArPftAghEJaoHeAEPqGK9QDhRguh3yEovFUjkEMSDBdsfAVnC): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019436980 (12h38m23.606493201s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019551794 (12h38m23.606608015s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:34900->64.49.13.139:4471: use of closed network connection; context canceled Aug 8 05:05:10.019574186 (12h38m23.606630407s) [seg_pos={0 0}, upload=13052]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:05:10.019623639 (12h38m23.60667986s) [upload=13052]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:05:10.019627686 (12h38m23.606683908s) [upload=13052]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:05:10.062625493 (12h38m23.649681704s) [upload=13052]: Done uploading segments... Aug 8 05:05:10.062638988 (12h38m23.649695199s) [upload=13052]: Upload finished. err: <nil> Aug 8 05:05:59.222059876 (12h39m12.809116097s) [upload=13062]: Starting upload Aug 8 05:05:59.222115750 (12h39m12.809171971s) [upload=13062]: Done starting upload Aug 8 05:05:59.222204426 (12h39m12.809260667s) [upload=13062]: Uploading segments... Aug 8 05:05:59.222357882 (12h39m12.809414094s) [upload=13062]: Got next segment. Inline: false Aug 8 05:05:59.222388720 (12h39m12.809444941s) [upload=13062]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:05:59.222392987 (12h39m12.809449198s) [upload=13062]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:05:59.224964628 (12h39m12.81202087s) [upload=13062]: Next segment err: metaclient: Too Many Requests Aug 8 05:05:59.224998492 (12h39m12.812054733s) [upload=13062]: Done uploading segments... Aug 8 05:05:59.225016314 (12h39m12.812072566s) [upload=13062]: Upload finished. err: metaclient: Too Many Requests Duration: 1.828731645s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 354.036252ms FAIL (2025-08-08 05:42:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== FUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902886958 (12h38m23.489943169s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902968320 (12h38m23.490024531s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903203899 (12h38m23.49026011s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903277728 (12h38m23.490333949s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903887185 (12h38m23.490943396s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904280910 (12h38m23.491337121s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904741781 (12h38m23.491798002s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.905445835 (12h38m23.492502056s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908065075 (12h38m23.495121286s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908337784 (12h38m23.495394005s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908596446 (12h38m23.495652667s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908863415 (12h38m23.495919626s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909095087 (12h38m23.496151298s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909564894 (12h38m23.496621105s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909798521 (12h38m23.496854732s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913123327 (12h38m23.500179539s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913897903 (12h38m23.500954124s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.994958464 (12h38m23.582014675s) [upload=13052]: Next returned nil segment Aug 8 05:05:09.994970847 (12h38m23.582027059s) [upload=13052]: Waiting for error group managing segments... Aug 8 05:05:10.004228059 (12h38m23.591284269s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.006942486 (12h38m23.593998707s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.007054394 (12h38m23.594110606s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008056936 (12h38m23.595113157s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008229177 (12h38m23.595285388s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008399085 (12h38m23.595455295s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.009486263 (12h38m23.596542475s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.010095211 (12h38m23.597151421s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012507043 (12h38m23.599563255s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012930493 (12h38m23.599986714s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016274496 (12h38m23.603330717s) [noise=true , address=104.36.82.46:4484 , piece_id=6XF4A3CJFEIR7YYJRKQEGKEMQRHZL2476NYKBDCRLVFUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016318107 (12h38m23.603374318s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.017348971 (12h38m23.604405192s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019251644 (12h38m23.606307865s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019271681 (12h38m23.606327902s) [seg_pos={0 0}, upload=13052]: Segment reached optimal threshold of 14 pieces. Aug 8 05:05:10.019364094 (12h38m23.606420315s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HZjKTnjpeNU5B6muVHGrmWQS8GsyuYTW6cLxzNk5CGt3b8PJS): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019419366 (12h38m23.606475587s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ArPftAghEJaoHeAEPqGK9QDhRguh3yEovFUjkEMSDBdsfAVnC): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019436980 (12h38m23.606493201s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019551794 (12h38m23.606608015s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:34900->64.49.13.139:4471: use of closed network connection; context canceled Aug 8 05:05:10.019574186 (12h38m23.606630407s) [seg_pos={0 0}, upload=13052]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:05:10.019623639 (12h38m23.60667986s) [upload=13052]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:05:10.019627686 (12h38m23.606683908s) [upload=13052]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:05:10.062625493 (12h38m23.649681704s) [upload=13052]: Done uploading segments... Aug 8 05:05:10.062638988 (12h38m23.649695199s) [upload=13052]: Upload finished. err: <nil> Aug 8 05:05:59.222059876 (12h39m12.809116097s) [upload=13062]: Starting upload Aug 8 05:05:59.222115750 (12h39m12.809171971s) [upload=13062]: Done starting upload Aug 8 05:05:59.222204426 (12h39m12.809260667s) [upload=13062]: Uploading segments... Aug 8 05:05:59.222357882 (12h39m12.809414094s) [upload=13062]: Got next segment. Inline: false Aug 8 05:05:59.222388720 (12h39m12.809444941s) [upload=13062]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:05:59.222392987 (12h39m12.809449198s) [upload=13062]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:05:59.224964628 (12h39m12.81202087s) [upload=13062]: Next segment err: metaclient: Too Many Requests Aug 8 05:05:59.224998492 (12h39m12.812054733s) [upload=13062]: Done uploading segments... Aug 8 05:05:59.225016314 (12h39m12.812072566s) [upload=13062]: Upload finished. err: metaclient: Too Many Requests Duration: 354.056379ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 316.761607ms FAIL (2025-08-08 05:41:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== FUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902886958 (12h38m23.489943169s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902968320 (12h38m23.490024531s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903203899 (12h38m23.49026011s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903277728 (12h38m23.490333949s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903887185 (12h38m23.490943396s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904280910 (12h38m23.491337121s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904741781 (12h38m23.491798002s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.905445835 (12h38m23.492502056s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908065075 (12h38m23.495121286s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908337784 (12h38m23.495394005s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908596446 (12h38m23.495652667s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908863415 (12h38m23.495919626s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909095087 (12h38m23.496151298s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909564894 (12h38m23.496621105s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909798521 (12h38m23.496854732s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913123327 (12h38m23.500179539s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913897903 (12h38m23.500954124s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.994958464 (12h38m23.582014675s) [upload=13052]: Next returned nil segment Aug 8 05:05:09.994970847 (12h38m23.582027059s) [upload=13052]: Waiting for error group managing segments... Aug 8 05:05:10.004228059 (12h38m23.591284269s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.006942486 (12h38m23.593998707s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.007054394 (12h38m23.594110606s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008056936 (12h38m23.595113157s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008229177 (12h38m23.595285388s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008399085 (12h38m23.595455295s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.009486263 (12h38m23.596542475s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.010095211 (12h38m23.597151421s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012507043 (12h38m23.599563255s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012930493 (12h38m23.599986714s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016274496 (12h38m23.603330717s) [noise=true , address=104.36.82.46:4484 , piece_id=6XF4A3CJFEIR7YYJRKQEGKEMQRHZL2476NYKBDCRLVFUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016318107 (12h38m23.603374318s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.017348971 (12h38m23.604405192s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019251644 (12h38m23.606307865s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019271681 (12h38m23.606327902s) [seg_pos={0 0}, upload=13052]: Segment reached optimal threshold of 14 pieces. Aug 8 05:05:10.019364094 (12h38m23.606420315s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HZjKTnjpeNU5B6muVHGrmWQS8GsyuYTW6cLxzNk5CGt3b8PJS): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019419366 (12h38m23.606475587s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ArPftAghEJaoHeAEPqGK9QDhRguh3yEovFUjkEMSDBdsfAVnC): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019436980 (12h38m23.606493201s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019551794 (12h38m23.606608015s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:34900->64.49.13.139:4471: use of closed network connection; context canceled Aug 8 05:05:10.019574186 (12h38m23.606630407s) [seg_pos={0 0}, upload=13052]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:05:10.019623639 (12h38m23.60667986s) [upload=13052]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:05:10.019627686 (12h38m23.606683908s) [upload=13052]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:05:10.062625493 (12h38m23.649681704s) [upload=13052]: Done uploading segments... Aug 8 05:05:10.062638988 (12h38m23.649695199s) [upload=13052]: Upload finished. err: <nil> Aug 8 05:05:59.222059876 (12h39m12.809116097s) [upload=13062]: Starting upload Aug 8 05:05:59.222115750 (12h39m12.809171971s) [upload=13062]: Done starting upload Aug 8 05:05:59.222204426 (12h39m12.809260667s) [upload=13062]: Uploading segments... Aug 8 05:05:59.222357882 (12h39m12.809414094s) [upload=13062]: Got next segment. Inline: false Aug 8 05:05:59.222388720 (12h39m12.809444941s) [upload=13062]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:05:59.222392987 (12h39m12.809449198s) [upload=13062]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:05:59.224964628 (12h39m12.81202087s) [upload=13062]: Next segment err: metaclient: Too Many Requests Aug 8 05:05:59.224998492 (12h39m12.812054733s) [upload=13062]: Done uploading segments... Aug 8 05:05:59.225016314 (12h39m12.812072566s) [upload=13062]: Upload finished. err: metaclient: Too Many Requests Duration: 316.789558ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 350.575798ms FAIL (2025-08-08 05:41:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== FUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902886958 (12h38m23.489943169s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902968320 (12h38m23.490024531s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903203899 (12h38m23.49026011s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903277728 (12h38m23.490333949s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903887185 (12h38m23.490943396s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904280910 (12h38m23.491337121s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904741781 (12h38m23.491798002s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.905445835 (12h38m23.492502056s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908065075 (12h38m23.495121286s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908337784 (12h38m23.495394005s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908596446 (12h38m23.495652667s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908863415 (12h38m23.495919626s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909095087 (12h38m23.496151298s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909564894 (12h38m23.496621105s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909798521 (12h38m23.496854732s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913123327 (12h38m23.500179539s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913897903 (12h38m23.500954124s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.994958464 (12h38m23.582014675s) [upload=13052]: Next returned nil segment Aug 8 05:05:09.994970847 (12h38m23.582027059s) [upload=13052]: Waiting for error group managing segments... Aug 8 05:05:10.004228059 (12h38m23.591284269s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.006942486 (12h38m23.593998707s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.007054394 (12h38m23.594110606s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008056936 (12h38m23.595113157s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008229177 (12h38m23.595285388s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008399085 (12h38m23.595455295s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.009486263 (12h38m23.596542475s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.010095211 (12h38m23.597151421s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012507043 (12h38m23.599563255s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012930493 (12h38m23.599986714s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016274496 (12h38m23.603330717s) [noise=true , address=104.36.82.46:4484 , piece_id=6XF4A3CJFEIR7YYJRKQEGKEMQRHZL2476NYKBDCRLVFUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016318107 (12h38m23.603374318s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.017348971 (12h38m23.604405192s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019251644 (12h38m23.606307865s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019271681 (12h38m23.606327902s) [seg_pos={0 0}, upload=13052]: Segment reached optimal threshold of 14 pieces. Aug 8 05:05:10.019364094 (12h38m23.606420315s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HZjKTnjpeNU5B6muVHGrmWQS8GsyuYTW6cLxzNk5CGt3b8PJS): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019419366 (12h38m23.606475587s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ArPftAghEJaoHeAEPqGK9QDhRguh3yEovFUjkEMSDBdsfAVnC): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019436980 (12h38m23.606493201s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019551794 (12h38m23.606608015s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:34900->64.49.13.139:4471: use of closed network connection; context canceled Aug 8 05:05:10.019574186 (12h38m23.606630407s) [seg_pos={0 0}, upload=13052]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:05:10.019623639 (12h38m23.60667986s) [upload=13052]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:05:10.019627686 (12h38m23.606683908s) [upload=13052]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:05:10.062625493 (12h38m23.649681704s) [upload=13052]: Done uploading segments... Aug 8 05:05:10.062638988 (12h38m23.649695199s) [upload=13052]: Upload finished. err: <nil> Aug 8 05:05:59.222059876 (12h39m12.809116097s) [upload=13062]: Starting upload Aug 8 05:05:59.222115750 (12h39m12.809171971s) [upload=13062]: Done starting upload Aug 8 05:05:59.222204426 (12h39m12.809260667s) [upload=13062]: Uploading segments... Aug 8 05:05:59.222357882 (12h39m12.809414094s) [upload=13062]: Got next segment. Inline: false Aug 8 05:05:59.222388720 (12h39m12.809444941s) [upload=13062]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:05:59.222392987 (12h39m12.809449198s) [upload=13062]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:05:59.224964628 (12h39m12.81202087s) [upload=13062]: Next segment err: metaclient: Too Many Requests Aug 8 05:05:59.224998492 (12h39m12.812054733s) [upload=13062]: Done uploading segments... Aug 8 05:05:59.225016314 (12h39m12.812072566s) [upload=13062]: Upload finished. err: metaclient: Too Many Requests Duration: 350.600364ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 461.128026ms FAIL (2025-08-08 05:40:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== FUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902886958 (12h38m23.489943169s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902968320 (12h38m23.490024531s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903203899 (12h38m23.49026011s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903277728 (12h38m23.490333949s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903887185 (12h38m23.490943396s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904280910 (12h38m23.491337121s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904741781 (12h38m23.491798002s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.905445835 (12h38m23.492502056s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908065075 (12h38m23.495121286s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908337784 (12h38m23.495394005s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908596446 (12h38m23.495652667s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908863415 (12h38m23.495919626s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909095087 (12h38m23.496151298s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909564894 (12h38m23.496621105s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909798521 (12h38m23.496854732s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913123327 (12h38m23.500179539s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913897903 (12h38m23.500954124s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.994958464 (12h38m23.582014675s) [upload=13052]: Next returned nil segment Aug 8 05:05:09.994970847 (12h38m23.582027059s) [upload=13052]: Waiting for error group managing segments... Aug 8 05:05:10.004228059 (12h38m23.591284269s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.006942486 (12h38m23.593998707s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.007054394 (12h38m23.594110606s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008056936 (12h38m23.595113157s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008229177 (12h38m23.595285388s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008399085 (12h38m23.595455295s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.009486263 (12h38m23.596542475s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.010095211 (12h38m23.597151421s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012507043 (12h38m23.599563255s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012930493 (12h38m23.599986714s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016274496 (12h38m23.603330717s) [noise=true , address=104.36.82.46:4484 , piece_id=6XF4A3CJFEIR7YYJRKQEGKEMQRHZL2476NYKBDCRLVFUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016318107 (12h38m23.603374318s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.017348971 (12h38m23.604405192s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019251644 (12h38m23.606307865s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019271681 (12h38m23.606327902s) [seg_pos={0 0}, upload=13052]: Segment reached optimal threshold of 14 pieces. Aug 8 05:05:10.019364094 (12h38m23.606420315s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HZjKTnjpeNU5B6muVHGrmWQS8GsyuYTW6cLxzNk5CGt3b8PJS): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019419366 (12h38m23.606475587s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ArPftAghEJaoHeAEPqGK9QDhRguh3yEovFUjkEMSDBdsfAVnC): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019436980 (12h38m23.606493201s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019551794 (12h38m23.606608015s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:34900->64.49.13.139:4471: use of closed network connection; context canceled Aug 8 05:05:10.019574186 (12h38m23.606630407s) [seg_pos={0 0}, upload=13052]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:05:10.019623639 (12h38m23.60667986s) [upload=13052]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:05:10.019627686 (12h38m23.606683908s) [upload=13052]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:05:10.062625493 (12h38m23.649681704s) [upload=13052]: Done uploading segments... Aug 8 05:05:10.062638988 (12h38m23.649695199s) [upload=13052]: Upload finished. err: <nil> Aug 8 05:05:59.222059876 (12h39m12.809116097s) [upload=13062]: Starting upload Aug 8 05:05:59.222115750 (12h39m12.809171971s) [upload=13062]: Done starting upload Aug 8 05:05:59.222204426 (12h39m12.809260667s) [upload=13062]: Uploading segments... Aug 8 05:05:59.222357882 (12h39m12.809414094s) [upload=13062]: Got next segment. Inline: false Aug 8 05:05:59.222388720 (12h39m12.809444941s) [upload=13062]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:05:59.222392987 (12h39m12.809449198s) [upload=13062]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:05:59.224964628 (12h39m12.81202087s) [upload=13062]: Next segment err: metaclient: Too Many Requests Aug 8 05:05:59.224998492 (12h39m12.812054733s) [upload=13062]: Done uploading segments... Aug 8 05:05:59.225016314 (12h39m12.812072566s) [upload=13062]: Upload finished. err: metaclient: Too Many Requests Duration: 461.147472ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 364.642568ms FAIL (2025-08-08 05:39:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== FUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902886958 (12h38m23.489943169s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902968320 (12h38m23.490024531s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903203899 (12h38m23.49026011s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903277728 (12h38m23.490333949s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903887185 (12h38m23.490943396s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904280910 (12h38m23.491337121s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904741781 (12h38m23.491798002s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.905445835 (12h38m23.492502056s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908065075 (12h38m23.495121286s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908337784 (12h38m23.495394005s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908596446 (12h38m23.495652667s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908863415 (12h38m23.495919626s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909095087 (12h38m23.496151298s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909564894 (12h38m23.496621105s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909798521 (12h38m23.496854732s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913123327 (12h38m23.500179539s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913897903 (12h38m23.500954124s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.994958464 (12h38m23.582014675s) [upload=13052]: Next returned nil segment Aug 8 05:05:09.994970847 (12h38m23.582027059s) [upload=13052]: Waiting for error group managing segments... Aug 8 05:05:10.004228059 (12h38m23.591284269s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.006942486 (12h38m23.593998707s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.007054394 (12h38m23.594110606s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008056936 (12h38m23.595113157s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008229177 (12h38m23.595285388s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008399085 (12h38m23.595455295s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.009486263 (12h38m23.596542475s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.010095211 (12h38m23.597151421s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012507043 (12h38m23.599563255s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012930493 (12h38m23.599986714s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016274496 (12h38m23.603330717s) [noise=true , address=104.36.82.46:4484 , piece_id=6XF4A3CJFEIR7YYJRKQEGKEMQRHZL2476NYKBDCRLVFUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016318107 (12h38m23.603374318s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.017348971 (12h38m23.604405192s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019251644 (12h38m23.606307865s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019271681 (12h38m23.606327902s) [seg_pos={0 0}, upload=13052]: Segment reached optimal threshold of 14 pieces. Aug 8 05:05:10.019364094 (12h38m23.606420315s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HZjKTnjpeNU5B6muVHGrmWQS8GsyuYTW6cLxzNk5CGt3b8PJS): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019419366 (12h38m23.606475587s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ArPftAghEJaoHeAEPqGK9QDhRguh3yEovFUjkEMSDBdsfAVnC): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019436980 (12h38m23.606493201s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019551794 (12h38m23.606608015s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:34900->64.49.13.139:4471: use of closed network connection; context canceled Aug 8 05:05:10.019574186 (12h38m23.606630407s) [seg_pos={0 0}, upload=13052]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:05:10.019623639 (12h38m23.60667986s) [upload=13052]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:05:10.019627686 (12h38m23.606683908s) [upload=13052]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:05:10.062625493 (12h38m23.649681704s) [upload=13052]: Done uploading segments... Aug 8 05:05:10.062638988 (12h38m23.649695199s) [upload=13052]: Upload finished. err: <nil> Aug 8 05:05:59.222059876 (12h39m12.809116097s) [upload=13062]: Starting upload Aug 8 05:05:59.222115750 (12h39m12.809171971s) [upload=13062]: Done starting upload Aug 8 05:05:59.222204426 (12h39m12.809260667s) [upload=13062]: Uploading segments... Aug 8 05:05:59.222357882 (12h39m12.809414094s) [upload=13062]: Got next segment. Inline: false Aug 8 05:05:59.222388720 (12h39m12.809444941s) [upload=13062]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:05:59.222392987 (12h39m12.809449198s) [upload=13062]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:05:59.224964628 (12h39m12.81202087s) [upload=13062]: Next segment err: metaclient: Too Many Requests Aug 8 05:05:59.224998492 (12h39m12.812054733s) [upload=13062]: Done uploading segments... Aug 8 05:05:59.225016314 (12h39m12.812072566s) [upload=13062]: Upload finished. err: metaclient: Too Many Requests Duration: 364.6755ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 440.691886ms FAIL (2025-08-08 05:38:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== FUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902886958 (12h38m23.489943169s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902968320 (12h38m23.490024531s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903203899 (12h38m23.49026011s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903277728 (12h38m23.490333949s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903887185 (12h38m23.490943396s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904280910 (12h38m23.491337121s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904741781 (12h38m23.491798002s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.905445835 (12h38m23.492502056s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908065075 (12h38m23.495121286s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908337784 (12h38m23.495394005s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908596446 (12h38m23.495652667s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908863415 (12h38m23.495919626s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909095087 (12h38m23.496151298s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909564894 (12h38m23.496621105s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909798521 (12h38m23.496854732s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913123327 (12h38m23.500179539s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913897903 (12h38m23.500954124s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.994958464 (12h38m23.582014675s) [upload=13052]: Next returned nil segment Aug 8 05:05:09.994970847 (12h38m23.582027059s) [upload=13052]: Waiting for error group managing segments... Aug 8 05:05:10.004228059 (12h38m23.591284269s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.006942486 (12h38m23.593998707s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.007054394 (12h38m23.594110606s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008056936 (12h38m23.595113157s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008229177 (12h38m23.595285388s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008399085 (12h38m23.595455295s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.009486263 (12h38m23.596542475s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.010095211 (12h38m23.597151421s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012507043 (12h38m23.599563255s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012930493 (12h38m23.599986714s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016274496 (12h38m23.603330717s) [noise=true , address=104.36.82.46:4484 , piece_id=6XF4A3CJFEIR7YYJRKQEGKEMQRHZL2476NYKBDCRLVFUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016318107 (12h38m23.603374318s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.017348971 (12h38m23.604405192s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019251644 (12h38m23.606307865s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019271681 (12h38m23.606327902s) [seg_pos={0 0}, upload=13052]: Segment reached optimal threshold of 14 pieces. Aug 8 05:05:10.019364094 (12h38m23.606420315s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HZjKTnjpeNU5B6muVHGrmWQS8GsyuYTW6cLxzNk5CGt3b8PJS): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019419366 (12h38m23.606475587s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ArPftAghEJaoHeAEPqGK9QDhRguh3yEovFUjkEMSDBdsfAVnC): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019436980 (12h38m23.606493201s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019551794 (12h38m23.606608015s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:34900->64.49.13.139:4471: use of closed network connection; context canceled Aug 8 05:05:10.019574186 (12h38m23.606630407s) [seg_pos={0 0}, upload=13052]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:05:10.019623639 (12h38m23.60667986s) [upload=13052]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:05:10.019627686 (12h38m23.606683908s) [upload=13052]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:05:10.062625493 (12h38m23.649681704s) [upload=13052]: Done uploading segments... Aug 8 05:05:10.062638988 (12h38m23.649695199s) [upload=13052]: Upload finished. err: <nil> Aug 8 05:05:59.222059876 (12h39m12.809116097s) [upload=13062]: Starting upload Aug 8 05:05:59.222115750 (12h39m12.809171971s) [upload=13062]: Done starting upload Aug 8 05:05:59.222204426 (12h39m12.809260667s) [upload=13062]: Uploading segments... Aug 8 05:05:59.222357882 (12h39m12.809414094s) [upload=13062]: Got next segment. Inline: false Aug 8 05:05:59.222388720 (12h39m12.809444941s) [upload=13062]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:05:59.222392987 (12h39m12.809449198s) [upload=13062]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:05:59.224964628 (12h39m12.81202087s) [upload=13062]: Next segment err: metaclient: Too Many Requests Aug 8 05:05:59.224998492 (12h39m12.812054733s) [upload=13062]: Done uploading segments... Aug 8 05:05:59.225016314 (12h39m12.812072566s) [upload=13062]: Upload finished. err: metaclient: Too Many Requests Duration: 440.716271ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 337.472648ms FAIL (2025-08-08 05:37:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== FUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902886958 (12h38m23.489943169s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902968320 (12h38m23.490024531s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903203899 (12h38m23.49026011s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903277728 (12h38m23.490333949s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903887185 (12h38m23.490943396s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904280910 (12h38m23.491337121s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904741781 (12h38m23.491798002s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.905445835 (12h38m23.492502056s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908065075 (12h38m23.495121286s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908337784 (12h38m23.495394005s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908596446 (12h38m23.495652667s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908863415 (12h38m23.495919626s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909095087 (12h38m23.496151298s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909564894 (12h38m23.496621105s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909798521 (12h38m23.496854732s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913123327 (12h38m23.500179539s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913897903 (12h38m23.500954124s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.994958464 (12h38m23.582014675s) [upload=13052]: Next returned nil segment Aug 8 05:05:09.994970847 (12h38m23.582027059s) [upload=13052]: Waiting for error group managing segments... Aug 8 05:05:10.004228059 (12h38m23.591284269s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.006942486 (12h38m23.593998707s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.007054394 (12h38m23.594110606s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008056936 (12h38m23.595113157s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008229177 (12h38m23.595285388s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008399085 (12h38m23.595455295s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.009486263 (12h38m23.596542475s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.010095211 (12h38m23.597151421s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012507043 (12h38m23.599563255s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012930493 (12h38m23.599986714s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016274496 (12h38m23.603330717s) [noise=true , address=104.36.82.46:4484 , piece_id=6XF4A3CJFEIR7YYJRKQEGKEMQRHZL2476NYKBDCRLVFUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016318107 (12h38m23.603374318s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.017348971 (12h38m23.604405192s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019251644 (12h38m23.606307865s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019271681 (12h38m23.606327902s) [seg_pos={0 0}, upload=13052]: Segment reached optimal threshold of 14 pieces. Aug 8 05:05:10.019364094 (12h38m23.606420315s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HZjKTnjpeNU5B6muVHGrmWQS8GsyuYTW6cLxzNk5CGt3b8PJS): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019419366 (12h38m23.606475587s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ArPftAghEJaoHeAEPqGK9QDhRguh3yEovFUjkEMSDBdsfAVnC): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019436980 (12h38m23.606493201s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019551794 (12h38m23.606608015s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:34900->64.49.13.139:4471: use of closed network connection; context canceled Aug 8 05:05:10.019574186 (12h38m23.606630407s) [seg_pos={0 0}, upload=13052]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:05:10.019623639 (12h38m23.60667986s) [upload=13052]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:05:10.019627686 (12h38m23.606683908s) [upload=13052]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:05:10.062625493 (12h38m23.649681704s) [upload=13052]: Done uploading segments... Aug 8 05:05:10.062638988 (12h38m23.649695199s) [upload=13052]: Upload finished. err: <nil> Aug 8 05:05:59.222059876 (12h39m12.809116097s) [upload=13062]: Starting upload Aug 8 05:05:59.222115750 (12h39m12.809171971s) [upload=13062]: Done starting upload Aug 8 05:05:59.222204426 (12h39m12.809260667s) [upload=13062]: Uploading segments... Aug 8 05:05:59.222357882 (12h39m12.809414094s) [upload=13062]: Got next segment. Inline: false Aug 8 05:05:59.222388720 (12h39m12.809444941s) [upload=13062]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:05:59.222392987 (12h39m12.809449198s) [upload=13062]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:05:59.224964628 (12h39m12.81202087s) [upload=13062]: Next segment err: metaclient: Too Many Requests Aug 8 05:05:59.224998492 (12h39m12.812054733s) [upload=13062]: Done uploading segments... Aug 8 05:05:59.225016314 (12h39m12.812072566s) [upload=13062]: Upload finished. err: metaclient: Too Many Requests Duration: 337.490802ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 353.295415ms FAIL (2025-08-08 05:36:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== FUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902886958 (12h38m23.489943169s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902968320 (12h38m23.490024531s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903203899 (12h38m23.49026011s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903277728 (12h38m23.490333949s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903887185 (12h38m23.490943396s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904280910 (12h38m23.491337121s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904741781 (12h38m23.491798002s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.905445835 (12h38m23.492502056s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908065075 (12h38m23.495121286s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908337784 (12h38m23.495394005s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908596446 (12h38m23.495652667s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908863415 (12h38m23.495919626s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909095087 (12h38m23.496151298s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909564894 (12h38m23.496621105s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909798521 (12h38m23.496854732s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913123327 (12h38m23.500179539s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913897903 (12h38m23.500954124s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.994958464 (12h38m23.582014675s) [upload=13052]: Next returned nil segment Aug 8 05:05:09.994970847 (12h38m23.582027059s) [upload=13052]: Waiting for error group managing segments... Aug 8 05:05:10.004228059 (12h38m23.591284269s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.006942486 (12h38m23.593998707s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.007054394 (12h38m23.594110606s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008056936 (12h38m23.595113157s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008229177 (12h38m23.595285388s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008399085 (12h38m23.595455295s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.009486263 (12h38m23.596542475s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.010095211 (12h38m23.597151421s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012507043 (12h38m23.599563255s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012930493 (12h38m23.599986714s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016274496 (12h38m23.603330717s) [noise=true , address=104.36.82.46:4484 , piece_id=6XF4A3CJFEIR7YYJRKQEGKEMQRHZL2476NYKBDCRLVFUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016318107 (12h38m23.603374318s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.017348971 (12h38m23.604405192s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019251644 (12h38m23.606307865s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019271681 (12h38m23.606327902s) [seg_pos={0 0}, upload=13052]: Segment reached optimal threshold of 14 pieces. Aug 8 05:05:10.019364094 (12h38m23.606420315s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HZjKTnjpeNU5B6muVHGrmWQS8GsyuYTW6cLxzNk5CGt3b8PJS): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019419366 (12h38m23.606475587s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ArPftAghEJaoHeAEPqGK9QDhRguh3yEovFUjkEMSDBdsfAVnC): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019436980 (12h38m23.606493201s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019551794 (12h38m23.606608015s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:34900->64.49.13.139:4471: use of closed network connection; context canceled Aug 8 05:05:10.019574186 (12h38m23.606630407s) [seg_pos={0 0}, upload=13052]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:05:10.019623639 (12h38m23.60667986s) [upload=13052]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:05:10.019627686 (12h38m23.606683908s) [upload=13052]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:05:10.062625493 (12h38m23.649681704s) [upload=13052]: Done uploading segments... Aug 8 05:05:10.062638988 (12h38m23.649695199s) [upload=13052]: Upload finished. err: <nil> Aug 8 05:05:59.222059876 (12h39m12.809116097s) [upload=13062]: Starting upload Aug 8 05:05:59.222115750 (12h39m12.809171971s) [upload=13062]: Done starting upload Aug 8 05:05:59.222204426 (12h39m12.809260667s) [upload=13062]: Uploading segments... Aug 8 05:05:59.222357882 (12h39m12.809414094s) [upload=13062]: Got next segment. Inline: false Aug 8 05:05:59.222388720 (12h39m12.809444941s) [upload=13062]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:05:59.222392987 (12h39m12.809449198s) [upload=13062]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:05:59.224964628 (12h39m12.81202087s) [upload=13062]: Next segment err: metaclient: Too Many Requests Aug 8 05:05:59.224998492 (12h39m12.812054733s) [upload=13062]: Done uploading segments... Aug 8 05:05:59.225016314 (12h39m12.812072566s) [upload=13062]: Upload finished. err: metaclient: Too Many Requests Duration: 353.317977ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 570.583934ms FAIL (2025-08-08 05:36:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== FUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902886958 (12h38m23.489943169s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902968320 (12h38m23.490024531s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903203899 (12h38m23.49026011s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903277728 (12h38m23.490333949s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903887185 (12h38m23.490943396s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904280910 (12h38m23.491337121s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904741781 (12h38m23.491798002s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.905445835 (12h38m23.492502056s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908065075 (12h38m23.495121286s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908337784 (12h38m23.495394005s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908596446 (12h38m23.495652667s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908863415 (12h38m23.495919626s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909095087 (12h38m23.496151298s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909564894 (12h38m23.496621105s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909798521 (12h38m23.496854732s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913123327 (12h38m23.500179539s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913897903 (12h38m23.500954124s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.994958464 (12h38m23.582014675s) [upload=13052]: Next returned nil segment Aug 8 05:05:09.994970847 (12h38m23.582027059s) [upload=13052]: Waiting for error group managing segments... Aug 8 05:05:10.004228059 (12h38m23.591284269s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.006942486 (12h38m23.593998707s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.007054394 (12h38m23.594110606s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008056936 (12h38m23.595113157s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008229177 (12h38m23.595285388s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008399085 (12h38m23.595455295s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.009486263 (12h38m23.596542475s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.010095211 (12h38m23.597151421s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012507043 (12h38m23.599563255s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012930493 (12h38m23.599986714s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016274496 (12h38m23.603330717s) [noise=true , address=104.36.82.46:4484 , piece_id=6XF4A3CJFEIR7YYJRKQEGKEMQRHZL2476NYKBDCRLVFUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016318107 (12h38m23.603374318s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.017348971 (12h38m23.604405192s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019251644 (12h38m23.606307865s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019271681 (12h38m23.606327902s) [seg_pos={0 0}, upload=13052]: Segment reached optimal threshold of 14 pieces. Aug 8 05:05:10.019364094 (12h38m23.606420315s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HZjKTnjpeNU5B6muVHGrmWQS8GsyuYTW6cLxzNk5CGt3b8PJS): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019419366 (12h38m23.606475587s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ArPftAghEJaoHeAEPqGK9QDhRguh3yEovFUjkEMSDBdsfAVnC): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019436980 (12h38m23.606493201s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019551794 (12h38m23.606608015s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:34900->64.49.13.139:4471: use of closed network connection; context canceled Aug 8 05:05:10.019574186 (12h38m23.606630407s) [seg_pos={0 0}, upload=13052]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:05:10.019623639 (12h38m23.60667986s) [upload=13052]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:05:10.019627686 (12h38m23.606683908s) [upload=13052]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:05:10.062625493 (12h38m23.649681704s) [upload=13052]: Done uploading segments... Aug 8 05:05:10.062638988 (12h38m23.649695199s) [upload=13052]: Upload finished. err: <nil> Aug 8 05:05:59.222059876 (12h39m12.809116097s) [upload=13062]: Starting upload Aug 8 05:05:59.222115750 (12h39m12.809171971s) [upload=13062]: Done starting upload Aug 8 05:05:59.222204426 (12h39m12.809260667s) [upload=13062]: Uploading segments... Aug 8 05:05:59.222357882 (12h39m12.809414094s) [upload=13062]: Got next segment. Inline: false Aug 8 05:05:59.222388720 (12h39m12.809444941s) [upload=13062]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:05:59.222392987 (12h39m12.809449198s) [upload=13062]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:05:59.224964628 (12h39m12.81202087s) [upload=13062]: Next segment err: metaclient: Too Many Requests Aug 8 05:05:59.224998492 (12h39m12.812054733s) [upload=13062]: Done uploading segments... Aug 8 05:05:59.225016314 (12h39m12.812072566s) [upload=13062]: Upload finished. err: metaclient: Too Many Requests Duration: 570.612749ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 479.540785ms FAIL (2025-08-08 05:36:21 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== FUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902886958 (12h38m23.489943169s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902968320 (12h38m23.490024531s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903203899 (12h38m23.49026011s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903277728 (12h38m23.490333949s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903887185 (12h38m23.490943396s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904280910 (12h38m23.491337121s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904741781 (12h38m23.491798002s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.905445835 (12h38m23.492502056s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908065075 (12h38m23.495121286s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908337784 (12h38m23.495394005s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908596446 (12h38m23.495652667s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908863415 (12h38m23.495919626s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909095087 (12h38m23.496151298s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909564894 (12h38m23.496621105s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909798521 (12h38m23.496854732s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913123327 (12h38m23.500179539s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913897903 (12h38m23.500954124s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.994958464 (12h38m23.582014675s) [upload=13052]: Next returned nil segment Aug 8 05:05:09.994970847 (12h38m23.582027059s) [upload=13052]: Waiting for error group managing segments... Aug 8 05:05:10.004228059 (12h38m23.591284269s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.006942486 (12h38m23.593998707s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.007054394 (12h38m23.594110606s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008056936 (12h38m23.595113157s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008229177 (12h38m23.595285388s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008399085 (12h38m23.595455295s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.009486263 (12h38m23.596542475s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.010095211 (12h38m23.597151421s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012507043 (12h38m23.599563255s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012930493 (12h38m23.599986714s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016274496 (12h38m23.603330717s) [noise=true , address=104.36.82.46:4484 , piece_id=6XF4A3CJFEIR7YYJRKQEGKEMQRHZL2476NYKBDCRLVFUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016318107 (12h38m23.603374318s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.017348971 (12h38m23.604405192s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019251644 (12h38m23.606307865s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019271681 (12h38m23.606327902s) [seg_pos={0 0}, upload=13052]: Segment reached optimal threshold of 14 pieces. Aug 8 05:05:10.019364094 (12h38m23.606420315s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HZjKTnjpeNU5B6muVHGrmWQS8GsyuYTW6cLxzNk5CGt3b8PJS): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019419366 (12h38m23.606475587s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ArPftAghEJaoHeAEPqGK9QDhRguh3yEovFUjkEMSDBdsfAVnC): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019436980 (12h38m23.606493201s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019551794 (12h38m23.606608015s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:34900->64.49.13.139:4471: use of closed network connection; context canceled Aug 8 05:05:10.019574186 (12h38m23.606630407s) [seg_pos={0 0}, upload=13052]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:05:10.019623639 (12h38m23.60667986s) [upload=13052]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:05:10.019627686 (12h38m23.606683908s) [upload=13052]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:05:10.062625493 (12h38m23.649681704s) [upload=13052]: Done uploading segments... Aug 8 05:05:10.062638988 (12h38m23.649695199s) [upload=13052]: Upload finished. err: <nil> Aug 8 05:05:59.222059876 (12h39m12.809116097s) [upload=13062]: Starting upload Aug 8 05:05:59.222115750 (12h39m12.809171971s) [upload=13062]: Done starting upload Aug 8 05:05:59.222204426 (12h39m12.809260667s) [upload=13062]: Uploading segments... Aug 8 05:05:59.222357882 (12h39m12.809414094s) [upload=13062]: Got next segment. Inline: false Aug 8 05:05:59.222388720 (12h39m12.809444941s) [upload=13062]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:05:59.222392987 (12h39m12.809449198s) [upload=13062]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:05:59.224964628 (12h39m12.81202087s) [upload=13062]: Next segment err: metaclient: Too Many Requests Aug 8 05:05:59.224998492 (12h39m12.812054733s) [upload=13062]: Done uploading segments... Aug 8 05:05:59.225016314 (12h39m12.812072566s) [upload=13062]: Upload finished. err: metaclient: Too Many Requests Duration: 479.564221ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 431.551712ms FAIL (2025-08-08 05:35:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== FUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902886958 (12h38m23.489943169s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902968320 (12h38m23.490024531s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903203899 (12h38m23.49026011s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903277728 (12h38m23.490333949s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903887185 (12h38m23.490943396s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904280910 (12h38m23.491337121s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904741781 (12h38m23.491798002s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.905445835 (12h38m23.492502056s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908065075 (12h38m23.495121286s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908337784 (12h38m23.495394005s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908596446 (12h38m23.495652667s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908863415 (12h38m23.495919626s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909095087 (12h38m23.496151298s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909564894 (12h38m23.496621105s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909798521 (12h38m23.496854732s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913123327 (12h38m23.500179539s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913897903 (12h38m23.500954124s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.994958464 (12h38m23.582014675s) [upload=13052]: Next returned nil segment Aug 8 05:05:09.994970847 (12h38m23.582027059s) [upload=13052]: Waiting for error group managing segments... Aug 8 05:05:10.004228059 (12h38m23.591284269s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.006942486 (12h38m23.593998707s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.007054394 (12h38m23.594110606s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008056936 (12h38m23.595113157s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008229177 (12h38m23.595285388s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008399085 (12h38m23.595455295s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.009486263 (12h38m23.596542475s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.010095211 (12h38m23.597151421s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012507043 (12h38m23.599563255s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012930493 (12h38m23.599986714s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016274496 (12h38m23.603330717s) [noise=true , address=104.36.82.46:4484 , piece_id=6XF4A3CJFEIR7YYJRKQEGKEMQRHZL2476NYKBDCRLVFUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016318107 (12h38m23.603374318s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.017348971 (12h38m23.604405192s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019251644 (12h38m23.606307865s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019271681 (12h38m23.606327902s) [seg_pos={0 0}, upload=13052]: Segment reached optimal threshold of 14 pieces. Aug 8 05:05:10.019364094 (12h38m23.606420315s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HZjKTnjpeNU5B6muVHGrmWQS8GsyuYTW6cLxzNk5CGt3b8PJS): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019419366 (12h38m23.606475587s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ArPftAghEJaoHeAEPqGK9QDhRguh3yEovFUjkEMSDBdsfAVnC): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019436980 (12h38m23.606493201s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019551794 (12h38m23.606608015s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:34900->64.49.13.139:4471: use of closed network connection; context canceled Aug 8 05:05:10.019574186 (12h38m23.606630407s) [seg_pos={0 0}, upload=13052]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:05:10.019623639 (12h38m23.60667986s) [upload=13052]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:05:10.019627686 (12h38m23.606683908s) [upload=13052]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:05:10.062625493 (12h38m23.649681704s) [upload=13052]: Done uploading segments... Aug 8 05:05:10.062638988 (12h38m23.649695199s) [upload=13052]: Upload finished. err: <nil> Aug 8 05:05:59.222059876 (12h39m12.809116097s) [upload=13062]: Starting upload Aug 8 05:05:59.222115750 (12h39m12.809171971s) [upload=13062]: Done starting upload Aug 8 05:05:59.222204426 (12h39m12.809260667s) [upload=13062]: Uploading segments... Aug 8 05:05:59.222357882 (12h39m12.809414094s) [upload=13062]: Got next segment. Inline: false Aug 8 05:05:59.222388720 (12h39m12.809444941s) [upload=13062]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:05:59.222392987 (12h39m12.809449198s) [upload=13062]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:05:59.224964628 (12h39m12.81202087s) [upload=13062]: Next segment err: metaclient: Too Many Requests Aug 8 05:05:59.224998492 (12h39m12.812054733s) [upload=13062]: Done uploading segments... Aug 8 05:05:59.225016314 (12h39m12.812072566s) [upload=13062]: Upload finished. err: metaclient: Too Many Requests Duration: 431.575927ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 374.523653ms FAIL (2025-08-08 05:34:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== FUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902886958 (12h38m23.489943169s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902968320 (12h38m23.490024531s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903203899 (12h38m23.49026011s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903277728 (12h38m23.490333949s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903887185 (12h38m23.490943396s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904280910 (12h38m23.491337121s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904741781 (12h38m23.491798002s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.905445835 (12h38m23.492502056s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908065075 (12h38m23.495121286s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908337784 (12h38m23.495394005s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908596446 (12h38m23.495652667s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908863415 (12h38m23.495919626s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909095087 (12h38m23.496151298s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909564894 (12h38m23.496621105s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909798521 (12h38m23.496854732s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913123327 (12h38m23.500179539s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913897903 (12h38m23.500954124s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.994958464 (12h38m23.582014675s) [upload=13052]: Next returned nil segment Aug 8 05:05:09.994970847 (12h38m23.582027059s) [upload=13052]: Waiting for error group managing segments... Aug 8 05:05:10.004228059 (12h38m23.591284269s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.006942486 (12h38m23.593998707s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.007054394 (12h38m23.594110606s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008056936 (12h38m23.595113157s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008229177 (12h38m23.595285388s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008399085 (12h38m23.595455295s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.009486263 (12h38m23.596542475s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.010095211 (12h38m23.597151421s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012507043 (12h38m23.599563255s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012930493 (12h38m23.599986714s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016274496 (12h38m23.603330717s) [noise=true , address=104.36.82.46:4484 , piece_id=6XF4A3CJFEIR7YYJRKQEGKEMQRHZL2476NYKBDCRLVFUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016318107 (12h38m23.603374318s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.017348971 (12h38m23.604405192s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019251644 (12h38m23.606307865s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019271681 (12h38m23.606327902s) [seg_pos={0 0}, upload=13052]: Segment reached optimal threshold of 14 pieces. Aug 8 05:05:10.019364094 (12h38m23.606420315s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HZjKTnjpeNU5B6muVHGrmWQS8GsyuYTW6cLxzNk5CGt3b8PJS): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019419366 (12h38m23.606475587s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ArPftAghEJaoHeAEPqGK9QDhRguh3yEovFUjkEMSDBdsfAVnC): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019436980 (12h38m23.606493201s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019551794 (12h38m23.606608015s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:34900->64.49.13.139:4471: use of closed network connection; context canceled Aug 8 05:05:10.019574186 (12h38m23.606630407s) [seg_pos={0 0}, upload=13052]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:05:10.019623639 (12h38m23.60667986s) [upload=13052]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:05:10.019627686 (12h38m23.606683908s) [upload=13052]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:05:10.062625493 (12h38m23.649681704s) [upload=13052]: Done uploading segments... Aug 8 05:05:10.062638988 (12h38m23.649695199s) [upload=13052]: Upload finished. err: <nil> Aug 8 05:05:59.222059876 (12h39m12.809116097s) [upload=13062]: Starting upload Aug 8 05:05:59.222115750 (12h39m12.809171971s) [upload=13062]: Done starting upload Aug 8 05:05:59.222204426 (12h39m12.809260667s) [upload=13062]: Uploading segments... Aug 8 05:05:59.222357882 (12h39m12.809414094s) [upload=13062]: Got next segment. Inline: false Aug 8 05:05:59.222388720 (12h39m12.809444941s) [upload=13062]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:05:59.222392987 (12h39m12.809449198s) [upload=13062]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:05:59.224964628 (12h39m12.81202087s) [upload=13062]: Next segment err: metaclient: Too Many Requests Aug 8 05:05:59.224998492 (12h39m12.812054733s) [upload=13062]: Done uploading segments... Aug 8 05:05:59.225016314 (12h39m12.812072566s) [upload=13062]: Upload finished. err: metaclient: Too Many Requests Duration: 374.546787ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 327.733387ms FAIL (2025-08-08 05:33:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== FUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902886958 (12h38m23.489943169s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902968320 (12h38m23.490024531s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903203899 (12h38m23.49026011s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903277728 (12h38m23.490333949s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903887185 (12h38m23.490943396s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904280910 (12h38m23.491337121s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904741781 (12h38m23.491798002s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.905445835 (12h38m23.492502056s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908065075 (12h38m23.495121286s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908337784 (12h38m23.495394005s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908596446 (12h38m23.495652667s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908863415 (12h38m23.495919626s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909095087 (12h38m23.496151298s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909564894 (12h38m23.496621105s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909798521 (12h38m23.496854732s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913123327 (12h38m23.500179539s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913897903 (12h38m23.500954124s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.994958464 (12h38m23.582014675s) [upload=13052]: Next returned nil segment Aug 8 05:05:09.994970847 (12h38m23.582027059s) [upload=13052]: Waiting for error group managing segments... Aug 8 05:05:10.004228059 (12h38m23.591284269s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.006942486 (12h38m23.593998707s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.007054394 (12h38m23.594110606s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008056936 (12h38m23.595113157s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008229177 (12h38m23.595285388s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008399085 (12h38m23.595455295s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.009486263 (12h38m23.596542475s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.010095211 (12h38m23.597151421s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012507043 (12h38m23.599563255s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012930493 (12h38m23.599986714s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016274496 (12h38m23.603330717s) [noise=true , address=104.36.82.46:4484 , piece_id=6XF4A3CJFEIR7YYJRKQEGKEMQRHZL2476NYKBDCRLVFUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016318107 (12h38m23.603374318s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.017348971 (12h38m23.604405192s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019251644 (12h38m23.606307865s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019271681 (12h38m23.606327902s) [seg_pos={0 0}, upload=13052]: Segment reached optimal threshold of 14 pieces. Aug 8 05:05:10.019364094 (12h38m23.606420315s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HZjKTnjpeNU5B6muVHGrmWQS8GsyuYTW6cLxzNk5CGt3b8PJS): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019419366 (12h38m23.606475587s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ArPftAghEJaoHeAEPqGK9QDhRguh3yEovFUjkEMSDBdsfAVnC): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019436980 (12h38m23.606493201s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019551794 (12h38m23.606608015s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:34900->64.49.13.139:4471: use of closed network connection; context canceled Aug 8 05:05:10.019574186 (12h38m23.606630407s) [seg_pos={0 0}, upload=13052]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:05:10.019623639 (12h38m23.60667986s) [upload=13052]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:05:10.019627686 (12h38m23.606683908s) [upload=13052]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:05:10.062625493 (12h38m23.649681704s) [upload=13052]: Done uploading segments... Aug 8 05:05:10.062638988 (12h38m23.649695199s) [upload=13052]: Upload finished. err: <nil> Aug 8 05:05:59.222059876 (12h39m12.809116097s) [upload=13062]: Starting upload Aug 8 05:05:59.222115750 (12h39m12.809171971s) [upload=13062]: Done starting upload Aug 8 05:05:59.222204426 (12h39m12.809260667s) [upload=13062]: Uploading segments... Aug 8 05:05:59.222357882 (12h39m12.809414094s) [upload=13062]: Got next segment. Inline: false Aug 8 05:05:59.222388720 (12h39m12.809444941s) [upload=13062]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:05:59.222392987 (12h39m12.809449198s) [upload=13062]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:05:59.224964628 (12h39m12.81202087s) [upload=13062]: Next segment err: metaclient: Too Many Requests Aug 8 05:05:59.224998492 (12h39m12.812054733s) [upload=13062]: Done uploading segments... Aug 8 05:05:59.225016314 (12h39m12.812072566s) [upload=13062]: Upload finished. err: metaclient: Too Many Requests Duration: 327.759345ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 337.486534ms FAIL (2025-08-08 05:32:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== FUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902886958 (12h38m23.489943169s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902968320 (12h38m23.490024531s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903203899 (12h38m23.49026011s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903277728 (12h38m23.490333949s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903887185 (12h38m23.490943396s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904280910 (12h38m23.491337121s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904741781 (12h38m23.491798002s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.905445835 (12h38m23.492502056s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908065075 (12h38m23.495121286s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908337784 (12h38m23.495394005s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908596446 (12h38m23.495652667s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908863415 (12h38m23.495919626s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909095087 (12h38m23.496151298s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909564894 (12h38m23.496621105s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909798521 (12h38m23.496854732s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913123327 (12h38m23.500179539s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913897903 (12h38m23.500954124s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.994958464 (12h38m23.582014675s) [upload=13052]: Next returned nil segment Aug 8 05:05:09.994970847 (12h38m23.582027059s) [upload=13052]: Waiting for error group managing segments... Aug 8 05:05:10.004228059 (12h38m23.591284269s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.006942486 (12h38m23.593998707s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.007054394 (12h38m23.594110606s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008056936 (12h38m23.595113157s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008229177 (12h38m23.595285388s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008399085 (12h38m23.595455295s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.009486263 (12h38m23.596542475s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.010095211 (12h38m23.597151421s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012507043 (12h38m23.599563255s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012930493 (12h38m23.599986714s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016274496 (12h38m23.603330717s) [noise=true , address=104.36.82.46:4484 , piece_id=6XF4A3CJFEIR7YYJRKQEGKEMQRHZL2476NYKBDCRLVFUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016318107 (12h38m23.603374318s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.017348971 (12h38m23.604405192s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019251644 (12h38m23.606307865s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019271681 (12h38m23.606327902s) [seg_pos={0 0}, upload=13052]: Segment reached optimal threshold of 14 pieces. Aug 8 05:05:10.019364094 (12h38m23.606420315s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HZjKTnjpeNU5B6muVHGrmWQS8GsyuYTW6cLxzNk5CGt3b8PJS): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019419366 (12h38m23.606475587s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ArPftAghEJaoHeAEPqGK9QDhRguh3yEovFUjkEMSDBdsfAVnC): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019436980 (12h38m23.606493201s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019551794 (12h38m23.606608015s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:34900->64.49.13.139:4471: use of closed network connection; context canceled Aug 8 05:05:10.019574186 (12h38m23.606630407s) [seg_pos={0 0}, upload=13052]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:05:10.019623639 (12h38m23.60667986s) [upload=13052]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:05:10.019627686 (12h38m23.606683908s) [upload=13052]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:05:10.062625493 (12h38m23.649681704s) [upload=13052]: Done uploading segments... Aug 8 05:05:10.062638988 (12h38m23.649695199s) [upload=13052]: Upload finished. err: <nil> Aug 8 05:05:59.222059876 (12h39m12.809116097s) [upload=13062]: Starting upload Aug 8 05:05:59.222115750 (12h39m12.809171971s) [upload=13062]: Done starting upload Aug 8 05:05:59.222204426 (12h39m12.809260667s) [upload=13062]: Uploading segments... Aug 8 05:05:59.222357882 (12h39m12.809414094s) [upload=13062]: Got next segment. Inline: false Aug 8 05:05:59.222388720 (12h39m12.809444941s) [upload=13062]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:05:59.222392987 (12h39m12.809449198s) [upload=13062]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:05:59.224964628 (12h39m12.81202087s) [upload=13062]: Next segment err: metaclient: Too Many Requests Aug 8 05:05:59.224998492 (12h39m12.812054733s) [upload=13062]: Done uploading segments... Aug 8 05:05:59.225016314 (12h39m12.812072566s) [upload=13062]: Upload finished. err: metaclient: Too Many Requests Duration: 337.50051ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 359.430338ms FAIL (2025-08-08 05:31:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== FUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902886958 (12h38m23.489943169s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902968320 (12h38m23.490024531s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903203899 (12h38m23.49026011s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903277728 (12h38m23.490333949s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903887185 (12h38m23.490943396s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904280910 (12h38m23.491337121s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904741781 (12h38m23.491798002s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.905445835 (12h38m23.492502056s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908065075 (12h38m23.495121286s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908337784 (12h38m23.495394005s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908596446 (12h38m23.495652667s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908863415 (12h38m23.495919626s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909095087 (12h38m23.496151298s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909564894 (12h38m23.496621105s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909798521 (12h38m23.496854732s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913123327 (12h38m23.500179539s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913897903 (12h38m23.500954124s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.994958464 (12h38m23.582014675s) [upload=13052]: Next returned nil segment Aug 8 05:05:09.994970847 (12h38m23.582027059s) [upload=13052]: Waiting for error group managing segments... Aug 8 05:05:10.004228059 (12h38m23.591284269s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.006942486 (12h38m23.593998707s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.007054394 (12h38m23.594110606s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008056936 (12h38m23.595113157s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008229177 (12h38m23.595285388s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008399085 (12h38m23.595455295s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.009486263 (12h38m23.596542475s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.010095211 (12h38m23.597151421s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012507043 (12h38m23.599563255s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012930493 (12h38m23.599986714s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016274496 (12h38m23.603330717s) [noise=true , address=104.36.82.46:4484 , piece_id=6XF4A3CJFEIR7YYJRKQEGKEMQRHZL2476NYKBDCRLVFUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016318107 (12h38m23.603374318s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.017348971 (12h38m23.604405192s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019251644 (12h38m23.606307865s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019271681 (12h38m23.606327902s) [seg_pos={0 0}, upload=13052]: Segment reached optimal threshold of 14 pieces. Aug 8 05:05:10.019364094 (12h38m23.606420315s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HZjKTnjpeNU5B6muVHGrmWQS8GsyuYTW6cLxzNk5CGt3b8PJS): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019419366 (12h38m23.606475587s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ArPftAghEJaoHeAEPqGK9QDhRguh3yEovFUjkEMSDBdsfAVnC): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019436980 (12h38m23.606493201s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019551794 (12h38m23.606608015s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:34900->64.49.13.139:4471: use of closed network connection; context canceled Aug 8 05:05:10.019574186 (12h38m23.606630407s) [seg_pos={0 0}, upload=13052]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:05:10.019623639 (12h38m23.60667986s) [upload=13052]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:05:10.019627686 (12h38m23.606683908s) [upload=13052]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:05:10.062625493 (12h38m23.649681704s) [upload=13052]: Done uploading segments... Aug 8 05:05:10.062638988 (12h38m23.649695199s) [upload=13052]: Upload finished. err: <nil> Aug 8 05:05:59.222059876 (12h39m12.809116097s) [upload=13062]: Starting upload Aug 8 05:05:59.222115750 (12h39m12.809171971s) [upload=13062]: Done starting upload Aug 8 05:05:59.222204426 (12h39m12.809260667s) [upload=13062]: Uploading segments... Aug 8 05:05:59.222357882 (12h39m12.809414094s) [upload=13062]: Got next segment. Inline: false Aug 8 05:05:59.222388720 (12h39m12.809444941s) [upload=13062]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:05:59.222392987 (12h39m12.809449198s) [upload=13062]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:05:59.224964628 (12h39m12.81202087s) [upload=13062]: Next segment err: metaclient: Too Many Requests Aug 8 05:05:59.224998492 (12h39m12.812054733s) [upload=13062]: Done uploading segments... Aug 8 05:05:59.225016314 (12h39m12.812072566s) [upload=13062]: Upload finished. err: metaclient: Too Many Requests Duration: 359.451428ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 371.1215ms FAIL (2025-08-08 05:30:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== FUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902886958 (12h38m23.489943169s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902968320 (12h38m23.490024531s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903203899 (12h38m23.49026011s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903277728 (12h38m23.490333949s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903887185 (12h38m23.490943396s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904280910 (12h38m23.491337121s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904741781 (12h38m23.491798002s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.905445835 (12h38m23.492502056s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908065075 (12h38m23.495121286s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908337784 (12h38m23.495394005s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908596446 (12h38m23.495652667s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908863415 (12h38m23.495919626s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909095087 (12h38m23.496151298s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909564894 (12h38m23.496621105s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909798521 (12h38m23.496854732s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913123327 (12h38m23.500179539s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913897903 (12h38m23.500954124s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.994958464 (12h38m23.582014675s) [upload=13052]: Next returned nil segment Aug 8 05:05:09.994970847 (12h38m23.582027059s) [upload=13052]: Waiting for error group managing segments... Aug 8 05:05:10.004228059 (12h38m23.591284269s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.006942486 (12h38m23.593998707s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.007054394 (12h38m23.594110606s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008056936 (12h38m23.595113157s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008229177 (12h38m23.595285388s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008399085 (12h38m23.595455295s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.009486263 (12h38m23.596542475s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.010095211 (12h38m23.597151421s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012507043 (12h38m23.599563255s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012930493 (12h38m23.599986714s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016274496 (12h38m23.603330717s) [noise=true , address=104.36.82.46:4484 , piece_id=6XF4A3CJFEIR7YYJRKQEGKEMQRHZL2476NYKBDCRLVFUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016318107 (12h38m23.603374318s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.017348971 (12h38m23.604405192s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019251644 (12h38m23.606307865s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019271681 (12h38m23.606327902s) [seg_pos={0 0}, upload=13052]: Segment reached optimal threshold of 14 pieces. Aug 8 05:05:10.019364094 (12h38m23.606420315s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HZjKTnjpeNU5B6muVHGrmWQS8GsyuYTW6cLxzNk5CGt3b8PJS): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019419366 (12h38m23.606475587s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ArPftAghEJaoHeAEPqGK9QDhRguh3yEovFUjkEMSDBdsfAVnC): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019436980 (12h38m23.606493201s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019551794 (12h38m23.606608015s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:34900->64.49.13.139:4471: use of closed network connection; context canceled Aug 8 05:05:10.019574186 (12h38m23.606630407s) [seg_pos={0 0}, upload=13052]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:05:10.019623639 (12h38m23.60667986s) [upload=13052]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:05:10.019627686 (12h38m23.606683908s) [upload=13052]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:05:10.062625493 (12h38m23.649681704s) [upload=13052]: Done uploading segments... Aug 8 05:05:10.062638988 (12h38m23.649695199s) [upload=13052]: Upload finished. err: <nil> Aug 8 05:05:59.222059876 (12h39m12.809116097s) [upload=13062]: Starting upload Aug 8 05:05:59.222115750 (12h39m12.809171971s) [upload=13062]: Done starting upload Aug 8 05:05:59.222204426 (12h39m12.809260667s) [upload=13062]: Uploading segments... Aug 8 05:05:59.222357882 (12h39m12.809414094s) [upload=13062]: Got next segment. Inline: false Aug 8 05:05:59.222388720 (12h39m12.809444941s) [upload=13062]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:05:59.222392987 (12h39m12.809449198s) [upload=13062]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:05:59.224964628 (12h39m12.81202087s) [upload=13062]: Next segment err: metaclient: Too Many Requests Aug 8 05:05:59.224998492 (12h39m12.812054733s) [upload=13062]: Done uploading segments... Aug 8 05:05:59.225016314 (12h39m12.812072566s) [upload=13062]: Upload finished. err: metaclient: Too Many Requests Duration: 371.143312ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 439.165997ms FAIL (2025-08-08 05:30:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== FUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902886958 (12h38m23.489943169s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902968320 (12h38m23.490024531s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903203899 (12h38m23.49026011s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903277728 (12h38m23.490333949s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903887185 (12h38m23.490943396s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904280910 (12h38m23.491337121s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904741781 (12h38m23.491798002s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.905445835 (12h38m23.492502056s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908065075 (12h38m23.495121286s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908337784 (12h38m23.495394005s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908596446 (12h38m23.495652667s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908863415 (12h38m23.495919626s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909095087 (12h38m23.496151298s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909564894 (12h38m23.496621105s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909798521 (12h38m23.496854732s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913123327 (12h38m23.500179539s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913897903 (12h38m23.500954124s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.994958464 (12h38m23.582014675s) [upload=13052]: Next returned nil segment Aug 8 05:05:09.994970847 (12h38m23.582027059s) [upload=13052]: Waiting for error group managing segments... Aug 8 05:05:10.004228059 (12h38m23.591284269s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.006942486 (12h38m23.593998707s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.007054394 (12h38m23.594110606s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008056936 (12h38m23.595113157s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008229177 (12h38m23.595285388s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008399085 (12h38m23.595455295s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.009486263 (12h38m23.596542475s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.010095211 (12h38m23.597151421s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012507043 (12h38m23.599563255s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012930493 (12h38m23.599986714s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016274496 (12h38m23.603330717s) [noise=true , address=104.36.82.46:4484 , piece_id=6XF4A3CJFEIR7YYJRKQEGKEMQRHZL2476NYKBDCRLVFUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016318107 (12h38m23.603374318s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.017348971 (12h38m23.604405192s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019251644 (12h38m23.606307865s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019271681 (12h38m23.606327902s) [seg_pos={0 0}, upload=13052]: Segment reached optimal threshold of 14 pieces. Aug 8 05:05:10.019364094 (12h38m23.606420315s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HZjKTnjpeNU5B6muVHGrmWQS8GsyuYTW6cLxzNk5CGt3b8PJS): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019419366 (12h38m23.606475587s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ArPftAghEJaoHeAEPqGK9QDhRguh3yEovFUjkEMSDBdsfAVnC): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019436980 (12h38m23.606493201s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019551794 (12h38m23.606608015s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:34900->64.49.13.139:4471: use of closed network connection; context canceled Aug 8 05:05:10.019574186 (12h38m23.606630407s) [seg_pos={0 0}, upload=13052]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:05:10.019623639 (12h38m23.60667986s) [upload=13052]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:05:10.019627686 (12h38m23.606683908s) [upload=13052]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:05:10.062625493 (12h38m23.649681704s) [upload=13052]: Done uploading segments... Aug 8 05:05:10.062638988 (12h38m23.649695199s) [upload=13052]: Upload finished. err: <nil> Aug 8 05:05:59.222059876 (12h39m12.809116097s) [upload=13062]: Starting upload Aug 8 05:05:59.222115750 (12h39m12.809171971s) [upload=13062]: Done starting upload Aug 8 05:05:59.222204426 (12h39m12.809260667s) [upload=13062]: Uploading segments... Aug 8 05:05:59.222357882 (12h39m12.809414094s) [upload=13062]: Got next segment. Inline: false Aug 8 05:05:59.222388720 (12h39m12.809444941s) [upload=13062]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:05:59.222392987 (12h39m12.809449198s) [upload=13062]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:05:59.224964628 (12h39m12.81202087s) [upload=13062]: Next segment err: metaclient: Too Many Requests Aug 8 05:05:59.224998492 (12h39m12.812054733s) [upload=13062]: Done uploading segments... Aug 8 05:05:59.225016314 (12h39m12.812072566s) [upload=13062]: Upload finished. err: metaclient: Too Many Requests Duration: 439.18814ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 315.995646ms FAIL (2025-08-08 05:29:46 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== FUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902886958 (12h38m23.489943169s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902968320 (12h38m23.490024531s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903203899 (12h38m23.49026011s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903277728 (12h38m23.490333949s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903887185 (12h38m23.490943396s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904280910 (12h38m23.491337121s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904741781 (12h38m23.491798002s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.905445835 (12h38m23.492502056s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908065075 (12h38m23.495121286s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908337784 (12h38m23.495394005s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908596446 (12h38m23.495652667s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908863415 (12h38m23.495919626s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909095087 (12h38m23.496151298s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909564894 (12h38m23.496621105s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909798521 (12h38m23.496854732s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913123327 (12h38m23.500179539s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913897903 (12h38m23.500954124s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.994958464 (12h38m23.582014675s) [upload=13052]: Next returned nil segment Aug 8 05:05:09.994970847 (12h38m23.582027059s) [upload=13052]: Waiting for error group managing segments... Aug 8 05:05:10.004228059 (12h38m23.591284269s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.006942486 (12h38m23.593998707s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.007054394 (12h38m23.594110606s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008056936 (12h38m23.595113157s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008229177 (12h38m23.595285388s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008399085 (12h38m23.595455295s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.009486263 (12h38m23.596542475s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.010095211 (12h38m23.597151421s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012507043 (12h38m23.599563255s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012930493 (12h38m23.599986714s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016274496 (12h38m23.603330717s) [noise=true , address=104.36.82.46:4484 , piece_id=6XF4A3CJFEIR7YYJRKQEGKEMQRHZL2476NYKBDCRLVFUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016318107 (12h38m23.603374318s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.017348971 (12h38m23.604405192s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019251644 (12h38m23.606307865s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019271681 (12h38m23.606327902s) [seg_pos={0 0}, upload=13052]: Segment reached optimal threshold of 14 pieces. Aug 8 05:05:10.019364094 (12h38m23.606420315s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HZjKTnjpeNU5B6muVHGrmWQS8GsyuYTW6cLxzNk5CGt3b8PJS): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019419366 (12h38m23.606475587s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ArPftAghEJaoHeAEPqGK9QDhRguh3yEovFUjkEMSDBdsfAVnC): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019436980 (12h38m23.606493201s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019551794 (12h38m23.606608015s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:34900->64.49.13.139:4471: use of closed network connection; context canceled Aug 8 05:05:10.019574186 (12h38m23.606630407s) [seg_pos={0 0}, upload=13052]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:05:10.019623639 (12h38m23.60667986s) [upload=13052]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:05:10.019627686 (12h38m23.606683908s) [upload=13052]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:05:10.062625493 (12h38m23.649681704s) [upload=13052]: Done uploading segments... Aug 8 05:05:10.062638988 (12h38m23.649695199s) [upload=13052]: Upload finished. err: <nil> Aug 8 05:05:59.222059876 (12h39m12.809116097s) [upload=13062]: Starting upload Aug 8 05:05:59.222115750 (12h39m12.809171971s) [upload=13062]: Done starting upload Aug 8 05:05:59.222204426 (12h39m12.809260667s) [upload=13062]: Uploading segments... Aug 8 05:05:59.222357882 (12h39m12.809414094s) [upload=13062]: Got next segment. Inline: false Aug 8 05:05:59.222388720 (12h39m12.809444941s) [upload=13062]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:05:59.222392987 (12h39m12.809449198s) [upload=13062]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:05:59.224964628 (12h39m12.81202087s) [upload=13062]: Next segment err: metaclient: Too Many Requests Aug 8 05:05:59.224998492 (12h39m12.812054733s) [upload=13062]: Done uploading segments... Aug 8 05:05:59.225016314 (12h39m12.812072566s) [upload=13062]: Upload finished. err: metaclient: Too Many Requests Duration: 316.021785ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 462.023537ms FAIL (2025-08-08 05:29:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== FUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902886958 (12h38m23.489943169s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902968320 (12h38m23.490024531s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903203899 (12h38m23.49026011s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903277728 (12h38m23.490333949s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903887185 (12h38m23.490943396s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904280910 (12h38m23.491337121s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904741781 (12h38m23.491798002s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.905445835 (12h38m23.492502056s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908065075 (12h38m23.495121286s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908337784 (12h38m23.495394005s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908596446 (12h38m23.495652667s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908863415 (12h38m23.495919626s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909095087 (12h38m23.496151298s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909564894 (12h38m23.496621105s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909798521 (12h38m23.496854732s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913123327 (12h38m23.500179539s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913897903 (12h38m23.500954124s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.994958464 (12h38m23.582014675s) [upload=13052]: Next returned nil segment Aug 8 05:05:09.994970847 (12h38m23.582027059s) [upload=13052]: Waiting for error group managing segments... Aug 8 05:05:10.004228059 (12h38m23.591284269s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.006942486 (12h38m23.593998707s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.007054394 (12h38m23.594110606s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008056936 (12h38m23.595113157s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008229177 (12h38m23.595285388s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008399085 (12h38m23.595455295s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.009486263 (12h38m23.596542475s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.010095211 (12h38m23.597151421s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012507043 (12h38m23.599563255s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012930493 (12h38m23.599986714s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016274496 (12h38m23.603330717s) [noise=true , address=104.36.82.46:4484 , piece_id=6XF4A3CJFEIR7YYJRKQEGKEMQRHZL2476NYKBDCRLVFUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016318107 (12h38m23.603374318s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.017348971 (12h38m23.604405192s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019251644 (12h38m23.606307865s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019271681 (12h38m23.606327902s) [seg_pos={0 0}, upload=13052]: Segment reached optimal threshold of 14 pieces. Aug 8 05:05:10.019364094 (12h38m23.606420315s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HZjKTnjpeNU5B6muVHGrmWQS8GsyuYTW6cLxzNk5CGt3b8PJS): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019419366 (12h38m23.606475587s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ArPftAghEJaoHeAEPqGK9QDhRguh3yEovFUjkEMSDBdsfAVnC): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019436980 (12h38m23.606493201s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019551794 (12h38m23.606608015s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:34900->64.49.13.139:4471: use of closed network connection; context canceled Aug 8 05:05:10.019574186 (12h38m23.606630407s) [seg_pos={0 0}, upload=13052]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:05:10.019623639 (12h38m23.60667986s) [upload=13052]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:05:10.019627686 (12h38m23.606683908s) [upload=13052]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:05:10.062625493 (12h38m23.649681704s) [upload=13052]: Done uploading segments... Aug 8 05:05:10.062638988 (12h38m23.649695199s) [upload=13052]: Upload finished. err: <nil> Aug 8 05:05:59.222059876 (12h39m12.809116097s) [upload=13062]: Starting upload Aug 8 05:05:59.222115750 (12h39m12.809171971s) [upload=13062]: Done starting upload Aug 8 05:05:59.222204426 (12h39m12.809260667s) [upload=13062]: Uploading segments... Aug 8 05:05:59.222357882 (12h39m12.809414094s) [upload=13062]: Got next segment. Inline: false Aug 8 05:05:59.222388720 (12h39m12.809444941s) [upload=13062]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:05:59.222392987 (12h39m12.809449198s) [upload=13062]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:05:59.224964628 (12h39m12.81202087s) [upload=13062]: Next segment err: metaclient: Too Many Requests Aug 8 05:05:59.224998492 (12h39m12.812054733s) [upload=13062]: Done uploading segments... Aug 8 05:05:59.225016314 (12h39m12.812072566s) [upload=13062]: Upload finished. err: metaclient: Too Many Requests Duration: 462.050058ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 409.532478ms FAIL (2025-08-08 05:28:18 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== FUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902886958 (12h38m23.489943169s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902968320 (12h38m23.490024531s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903203899 (12h38m23.49026011s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903277728 (12h38m23.490333949s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903887185 (12h38m23.490943396s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904280910 (12h38m23.491337121s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904741781 (12h38m23.491798002s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.905445835 (12h38m23.492502056s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908065075 (12h38m23.495121286s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908337784 (12h38m23.495394005s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908596446 (12h38m23.495652667s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908863415 (12h38m23.495919626s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909095087 (12h38m23.496151298s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909564894 (12h38m23.496621105s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909798521 (12h38m23.496854732s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913123327 (12h38m23.500179539s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913897903 (12h38m23.500954124s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.994958464 (12h38m23.582014675s) [upload=13052]: Next returned nil segment Aug 8 05:05:09.994970847 (12h38m23.582027059s) [upload=13052]: Waiting for error group managing segments... Aug 8 05:05:10.004228059 (12h38m23.591284269s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.006942486 (12h38m23.593998707s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.007054394 (12h38m23.594110606s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008056936 (12h38m23.595113157s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008229177 (12h38m23.595285388s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008399085 (12h38m23.595455295s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.009486263 (12h38m23.596542475s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.010095211 (12h38m23.597151421s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012507043 (12h38m23.599563255s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012930493 (12h38m23.599986714s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016274496 (12h38m23.603330717s) [noise=true , address=104.36.82.46:4484 , piece_id=6XF4A3CJFEIR7YYJRKQEGKEMQRHZL2476NYKBDCRLVFUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016318107 (12h38m23.603374318s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.017348971 (12h38m23.604405192s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019251644 (12h38m23.606307865s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019271681 (12h38m23.606327902s) [seg_pos={0 0}, upload=13052]: Segment reached optimal threshold of 14 pieces. Aug 8 05:05:10.019364094 (12h38m23.606420315s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HZjKTnjpeNU5B6muVHGrmWQS8GsyuYTW6cLxzNk5CGt3b8PJS): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019419366 (12h38m23.606475587s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ArPftAghEJaoHeAEPqGK9QDhRguh3yEovFUjkEMSDBdsfAVnC): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019436980 (12h38m23.606493201s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019551794 (12h38m23.606608015s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:34900->64.49.13.139:4471: use of closed network connection; context canceled Aug 8 05:05:10.019574186 (12h38m23.606630407s) [seg_pos={0 0}, upload=13052]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:05:10.019623639 (12h38m23.60667986s) [upload=13052]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:05:10.019627686 (12h38m23.606683908s) [upload=13052]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:05:10.062625493 (12h38m23.649681704s) [upload=13052]: Done uploading segments... Aug 8 05:05:10.062638988 (12h38m23.649695199s) [upload=13052]: Upload finished. err: <nil> Aug 8 05:05:59.222059876 (12h39m12.809116097s) [upload=13062]: Starting upload Aug 8 05:05:59.222115750 (12h39m12.809171971s) [upload=13062]: Done starting upload Aug 8 05:05:59.222204426 (12h39m12.809260667s) [upload=13062]: Uploading segments... Aug 8 05:05:59.222357882 (12h39m12.809414094s) [upload=13062]: Got next segment. Inline: false Aug 8 05:05:59.222388720 (12h39m12.809444941s) [upload=13062]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:05:59.222392987 (12h39m12.809449198s) [upload=13062]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:05:59.224964628 (12h39m12.81202087s) [upload=13062]: Next segment err: metaclient: Too Many Requests Aug 8 05:05:59.224998492 (12h39m12.812054733s) [upload=13062]: Done uploading segments... Aug 8 05:05:59.225016314 (12h39m12.812072566s) [upload=13062]: Upload finished. err: metaclient: Too Many Requests Duration: 409.554539ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 437.332003ms FAIL (2025-08-08 05:27:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== FUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902886958 (12h38m23.489943169s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902968320 (12h38m23.490024531s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903203899 (12h38m23.49026011s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903277728 (12h38m23.490333949s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903887185 (12h38m23.490943396s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904280910 (12h38m23.491337121s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904741781 (12h38m23.491798002s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.905445835 (12h38m23.492502056s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908065075 (12h38m23.495121286s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908337784 (12h38m23.495394005s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908596446 (12h38m23.495652667s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908863415 (12h38m23.495919626s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909095087 (12h38m23.496151298s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909564894 (12h38m23.496621105s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909798521 (12h38m23.496854732s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913123327 (12h38m23.500179539s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913897903 (12h38m23.500954124s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.994958464 (12h38m23.582014675s) [upload=13052]: Next returned nil segment Aug 8 05:05:09.994970847 (12h38m23.582027059s) [upload=13052]: Waiting for error group managing segments... Aug 8 05:05:10.004228059 (12h38m23.591284269s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.006942486 (12h38m23.593998707s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.007054394 (12h38m23.594110606s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008056936 (12h38m23.595113157s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008229177 (12h38m23.595285388s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008399085 (12h38m23.595455295s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.009486263 (12h38m23.596542475s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.010095211 (12h38m23.597151421s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012507043 (12h38m23.599563255s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012930493 (12h38m23.599986714s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016274496 (12h38m23.603330717s) [noise=true , address=104.36.82.46:4484 , piece_id=6XF4A3CJFEIR7YYJRKQEGKEMQRHZL2476NYKBDCRLVFUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016318107 (12h38m23.603374318s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.017348971 (12h38m23.604405192s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019251644 (12h38m23.606307865s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019271681 (12h38m23.606327902s) [seg_pos={0 0}, upload=13052]: Segment reached optimal threshold of 14 pieces. Aug 8 05:05:10.019364094 (12h38m23.606420315s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HZjKTnjpeNU5B6muVHGrmWQS8GsyuYTW6cLxzNk5CGt3b8PJS): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019419366 (12h38m23.606475587s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ArPftAghEJaoHeAEPqGK9QDhRguh3yEovFUjkEMSDBdsfAVnC): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019436980 (12h38m23.606493201s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019551794 (12h38m23.606608015s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:34900->64.49.13.139:4471: use of closed network connection; context canceled Aug 8 05:05:10.019574186 (12h38m23.606630407s) [seg_pos={0 0}, upload=13052]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:05:10.019623639 (12h38m23.60667986s) [upload=13052]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:05:10.019627686 (12h38m23.606683908s) [upload=13052]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:05:10.062625493 (12h38m23.649681704s) [upload=13052]: Done uploading segments... Aug 8 05:05:10.062638988 (12h38m23.649695199s) [upload=13052]: Upload finished. err: <nil> Aug 8 05:05:59.222059876 (12h39m12.809116097s) [upload=13062]: Starting upload Aug 8 05:05:59.222115750 (12h39m12.809171971s) [upload=13062]: Done starting upload Aug 8 05:05:59.222204426 (12h39m12.809260667s) [upload=13062]: Uploading segments... Aug 8 05:05:59.222357882 (12h39m12.809414094s) [upload=13062]: Got next segment. Inline: false Aug 8 05:05:59.222388720 (12h39m12.809444941s) [upload=13062]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:05:59.222392987 (12h39m12.809449198s) [upload=13062]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:05:59.224964628 (12h39m12.81202087s) [upload=13062]: Next segment err: metaclient: Too Many Requests Aug 8 05:05:59.224998492 (12h39m12.812054733s) [upload=13062]: Done uploading segments... Aug 8 05:05:59.225016314 (12h39m12.812072566s) [upload=13062]: Upload finished. err: metaclient: Too Many Requests Duration: 437.357891ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 361.936746ms FAIL (2025-08-08 05:26:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== FUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902886958 (12h38m23.489943169s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902968320 (12h38m23.490024531s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903203899 (12h38m23.49026011s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903277728 (12h38m23.490333949s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903887185 (12h38m23.490943396s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904280910 (12h38m23.491337121s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904741781 (12h38m23.491798002s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.905445835 (12h38m23.492502056s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908065075 (12h38m23.495121286s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908337784 (12h38m23.495394005s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908596446 (12h38m23.495652667s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908863415 (12h38m23.495919626s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909095087 (12h38m23.496151298s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909564894 (12h38m23.496621105s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909798521 (12h38m23.496854732s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913123327 (12h38m23.500179539s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913897903 (12h38m23.500954124s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.994958464 (12h38m23.582014675s) [upload=13052]: Next returned nil segment Aug 8 05:05:09.994970847 (12h38m23.582027059s) [upload=13052]: Waiting for error group managing segments... Aug 8 05:05:10.004228059 (12h38m23.591284269s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.006942486 (12h38m23.593998707s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.007054394 (12h38m23.594110606s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008056936 (12h38m23.595113157s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008229177 (12h38m23.595285388s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008399085 (12h38m23.595455295s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.009486263 (12h38m23.596542475s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.010095211 (12h38m23.597151421s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012507043 (12h38m23.599563255s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012930493 (12h38m23.599986714s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016274496 (12h38m23.603330717s) [noise=true , address=104.36.82.46:4484 , piece_id=6XF4A3CJFEIR7YYJRKQEGKEMQRHZL2476NYKBDCRLVFUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016318107 (12h38m23.603374318s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.017348971 (12h38m23.604405192s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019251644 (12h38m23.606307865s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019271681 (12h38m23.606327902s) [seg_pos={0 0}, upload=13052]: Segment reached optimal threshold of 14 pieces. Aug 8 05:05:10.019364094 (12h38m23.606420315s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HZjKTnjpeNU5B6muVHGrmWQS8GsyuYTW6cLxzNk5CGt3b8PJS): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019419366 (12h38m23.606475587s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ArPftAghEJaoHeAEPqGK9QDhRguh3yEovFUjkEMSDBdsfAVnC): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019436980 (12h38m23.606493201s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019551794 (12h38m23.606608015s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:34900->64.49.13.139:4471: use of closed network connection; context canceled Aug 8 05:05:10.019574186 (12h38m23.606630407s) [seg_pos={0 0}, upload=13052]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:05:10.019623639 (12h38m23.60667986s) [upload=13052]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:05:10.019627686 (12h38m23.606683908s) [upload=13052]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:05:10.062625493 (12h38m23.649681704s) [upload=13052]: Done uploading segments... Aug 8 05:05:10.062638988 (12h38m23.649695199s) [upload=13052]: Upload finished. err: <nil> Aug 8 05:05:59.222059876 (12h39m12.809116097s) [upload=13062]: Starting upload Aug 8 05:05:59.222115750 (12h39m12.809171971s) [upload=13062]: Done starting upload Aug 8 05:05:59.222204426 (12h39m12.809260667s) [upload=13062]: Uploading segments... Aug 8 05:05:59.222357882 (12h39m12.809414094s) [upload=13062]: Got next segment. Inline: false Aug 8 05:05:59.222388720 (12h39m12.809444941s) [upload=13062]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:05:59.222392987 (12h39m12.809449198s) [upload=13062]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:05:59.224964628 (12h39m12.81202087s) [upload=13062]: Next segment err: metaclient: Too Many Requests Aug 8 05:05:59.224998492 (12h39m12.812054733s) [upload=13062]: Done uploading segments... Aug 8 05:05:59.225016314 (12h39m12.812072566s) [upload=13062]: Upload finished. err: metaclient: Too Many Requests Duration: 361.966521ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 391.245801ms FAIL (2025-08-08 05:25:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== FUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902886958 (12h38m23.489943169s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902968320 (12h38m23.490024531s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903203899 (12h38m23.49026011s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903277728 (12h38m23.490333949s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903887185 (12h38m23.490943396s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904280910 (12h38m23.491337121s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904741781 (12h38m23.491798002s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.905445835 (12h38m23.492502056s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908065075 (12h38m23.495121286s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908337784 (12h38m23.495394005s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908596446 (12h38m23.495652667s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908863415 (12h38m23.495919626s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909095087 (12h38m23.496151298s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909564894 (12h38m23.496621105s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909798521 (12h38m23.496854732s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913123327 (12h38m23.500179539s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913897903 (12h38m23.500954124s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.994958464 (12h38m23.582014675s) [upload=13052]: Next returned nil segment Aug 8 05:05:09.994970847 (12h38m23.582027059s) [upload=13052]: Waiting for error group managing segments... Aug 8 05:05:10.004228059 (12h38m23.591284269s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.006942486 (12h38m23.593998707s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.007054394 (12h38m23.594110606s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008056936 (12h38m23.595113157s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008229177 (12h38m23.595285388s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008399085 (12h38m23.595455295s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.009486263 (12h38m23.596542475s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.010095211 (12h38m23.597151421s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012507043 (12h38m23.599563255s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012930493 (12h38m23.599986714s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016274496 (12h38m23.603330717s) [noise=true , address=104.36.82.46:4484 , piece_id=6XF4A3CJFEIR7YYJRKQEGKEMQRHZL2476NYKBDCRLVFUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016318107 (12h38m23.603374318s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.017348971 (12h38m23.604405192s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019251644 (12h38m23.606307865s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019271681 (12h38m23.606327902s) [seg_pos={0 0}, upload=13052]: Segment reached optimal threshold of 14 pieces. Aug 8 05:05:10.019364094 (12h38m23.606420315s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HZjKTnjpeNU5B6muVHGrmWQS8GsyuYTW6cLxzNk5CGt3b8PJS): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019419366 (12h38m23.606475587s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ArPftAghEJaoHeAEPqGK9QDhRguh3yEovFUjkEMSDBdsfAVnC): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019436980 (12h38m23.606493201s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019551794 (12h38m23.606608015s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:34900->64.49.13.139:4471: use of closed network connection; context canceled Aug 8 05:05:10.019574186 (12h38m23.606630407s) [seg_pos={0 0}, upload=13052]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:05:10.019623639 (12h38m23.60667986s) [upload=13052]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:05:10.019627686 (12h38m23.606683908s) [upload=13052]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:05:10.062625493 (12h38m23.649681704s) [upload=13052]: Done uploading segments... Aug 8 05:05:10.062638988 (12h38m23.649695199s) [upload=13052]: Upload finished. err: <nil> Aug 8 05:05:59.222059876 (12h39m12.809116097s) [upload=13062]: Starting upload Aug 8 05:05:59.222115750 (12h39m12.809171971s) [upload=13062]: Done starting upload Aug 8 05:05:59.222204426 (12h39m12.809260667s) [upload=13062]: Uploading segments... Aug 8 05:05:59.222357882 (12h39m12.809414094s) [upload=13062]: Got next segment. Inline: false Aug 8 05:05:59.222388720 (12h39m12.809444941s) [upload=13062]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:05:59.222392987 (12h39m12.809449198s) [upload=13062]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:05:59.224964628 (12h39m12.81202087s) [upload=13062]: Next segment err: metaclient: Too Many Requests Aug 8 05:05:59.224998492 (12h39m12.812054733s) [upload=13062]: Done uploading segments... Aug 8 05:05:59.225016314 (12h39m12.812072566s) [upload=13062]: Upload finished. err: metaclient: Too Many Requests Duration: 391.275145ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 382.290845ms FAIL (2025-08-08 05:24:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== FUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902886958 (12h38m23.489943169s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902968320 (12h38m23.490024531s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903203899 (12h38m23.49026011s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903277728 (12h38m23.490333949s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903887185 (12h38m23.490943396s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904280910 (12h38m23.491337121s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904741781 (12h38m23.491798002s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.905445835 (12h38m23.492502056s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908065075 (12h38m23.495121286s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908337784 (12h38m23.495394005s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908596446 (12h38m23.495652667s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908863415 (12h38m23.495919626s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909095087 (12h38m23.496151298s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909564894 (12h38m23.496621105s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909798521 (12h38m23.496854732s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913123327 (12h38m23.500179539s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913897903 (12h38m23.500954124s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.994958464 (12h38m23.582014675s) [upload=13052]: Next returned nil segment Aug 8 05:05:09.994970847 (12h38m23.582027059s) [upload=13052]: Waiting for error group managing segments... Aug 8 05:05:10.004228059 (12h38m23.591284269s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.006942486 (12h38m23.593998707s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.007054394 (12h38m23.594110606s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008056936 (12h38m23.595113157s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008229177 (12h38m23.595285388s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008399085 (12h38m23.595455295s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.009486263 (12h38m23.596542475s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.010095211 (12h38m23.597151421s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012507043 (12h38m23.599563255s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012930493 (12h38m23.599986714s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016274496 (12h38m23.603330717s) [noise=true , address=104.36.82.46:4484 , piece_id=6XF4A3CJFEIR7YYJRKQEGKEMQRHZL2476NYKBDCRLVFUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016318107 (12h38m23.603374318s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.017348971 (12h38m23.604405192s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019251644 (12h38m23.606307865s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019271681 (12h38m23.606327902s) [seg_pos={0 0}, upload=13052]: Segment reached optimal threshold of 14 pieces. Aug 8 05:05:10.019364094 (12h38m23.606420315s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HZjKTnjpeNU5B6muVHGrmWQS8GsyuYTW6cLxzNk5CGt3b8PJS): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019419366 (12h38m23.606475587s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ArPftAghEJaoHeAEPqGK9QDhRguh3yEovFUjkEMSDBdsfAVnC): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019436980 (12h38m23.606493201s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019551794 (12h38m23.606608015s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:34900->64.49.13.139:4471: use of closed network connection; context canceled Aug 8 05:05:10.019574186 (12h38m23.606630407s) [seg_pos={0 0}, upload=13052]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:05:10.019623639 (12h38m23.60667986s) [upload=13052]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:05:10.019627686 (12h38m23.606683908s) [upload=13052]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:05:10.062625493 (12h38m23.649681704s) [upload=13052]: Done uploading segments... Aug 8 05:05:10.062638988 (12h38m23.649695199s) [upload=13052]: Upload finished. err: <nil> Aug 8 05:05:59.222059876 (12h39m12.809116097s) [upload=13062]: Starting upload Aug 8 05:05:59.222115750 (12h39m12.809171971s) [upload=13062]: Done starting upload Aug 8 05:05:59.222204426 (12h39m12.809260667s) [upload=13062]: Uploading segments... Aug 8 05:05:59.222357882 (12h39m12.809414094s) [upload=13062]: Got next segment. Inline: false Aug 8 05:05:59.222388720 (12h39m12.809444941s) [upload=13062]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:05:59.222392987 (12h39m12.809449198s) [upload=13062]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:05:59.224964628 (12h39m12.81202087s) [upload=13062]: Next segment err: metaclient: Too Many Requests Aug 8 05:05:59.224998492 (12h39m12.812054733s) [upload=13062]: Done uploading segments... Aug 8 05:05:59.225016314 (12h39m12.812072566s) [upload=13062]: Upload finished. err: metaclient: Too Many Requests Duration: 382.317925ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 376.928273ms FAIL (2025-08-08 05:24:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== FUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902886958 (12h38m23.489943169s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902968320 (12h38m23.490024531s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903203899 (12h38m23.49026011s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903277728 (12h38m23.490333949s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903887185 (12h38m23.490943396s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904280910 (12h38m23.491337121s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904741781 (12h38m23.491798002s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.905445835 (12h38m23.492502056s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908065075 (12h38m23.495121286s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908337784 (12h38m23.495394005s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908596446 (12h38m23.495652667s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908863415 (12h38m23.495919626s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909095087 (12h38m23.496151298s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909564894 (12h38m23.496621105s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909798521 (12h38m23.496854732s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913123327 (12h38m23.500179539s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913897903 (12h38m23.500954124s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.994958464 (12h38m23.582014675s) [upload=13052]: Next returned nil segment Aug 8 05:05:09.994970847 (12h38m23.582027059s) [upload=13052]: Waiting for error group managing segments... Aug 8 05:05:10.004228059 (12h38m23.591284269s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.006942486 (12h38m23.593998707s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.007054394 (12h38m23.594110606s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008056936 (12h38m23.595113157s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008229177 (12h38m23.595285388s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008399085 (12h38m23.595455295s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.009486263 (12h38m23.596542475s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.010095211 (12h38m23.597151421s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012507043 (12h38m23.599563255s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012930493 (12h38m23.599986714s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016274496 (12h38m23.603330717s) [noise=true , address=104.36.82.46:4484 , piece_id=6XF4A3CJFEIR7YYJRKQEGKEMQRHZL2476NYKBDCRLVFUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016318107 (12h38m23.603374318s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.017348971 (12h38m23.604405192s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019251644 (12h38m23.606307865s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019271681 (12h38m23.606327902s) [seg_pos={0 0}, upload=13052]: Segment reached optimal threshold of 14 pieces. Aug 8 05:05:10.019364094 (12h38m23.606420315s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HZjKTnjpeNU5B6muVHGrmWQS8GsyuYTW6cLxzNk5CGt3b8PJS): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019419366 (12h38m23.606475587s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ArPftAghEJaoHeAEPqGK9QDhRguh3yEovFUjkEMSDBdsfAVnC): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019436980 (12h38m23.606493201s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019551794 (12h38m23.606608015s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:34900->64.49.13.139:4471: use of closed network connection; context canceled Aug 8 05:05:10.019574186 (12h38m23.606630407s) [seg_pos={0 0}, upload=13052]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:05:10.019623639 (12h38m23.60667986s) [upload=13052]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:05:10.019627686 (12h38m23.606683908s) [upload=13052]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:05:10.062625493 (12h38m23.649681704s) [upload=13052]: Done uploading segments... Aug 8 05:05:10.062638988 (12h38m23.649695199s) [upload=13052]: Upload finished. err: <nil> Aug 8 05:05:59.222059876 (12h39m12.809116097s) [upload=13062]: Starting upload Aug 8 05:05:59.222115750 (12h39m12.809171971s) [upload=13062]: Done starting upload Aug 8 05:05:59.222204426 (12h39m12.809260667s) [upload=13062]: Uploading segments... Aug 8 05:05:59.222357882 (12h39m12.809414094s) [upload=13062]: Got next segment. Inline: false Aug 8 05:05:59.222388720 (12h39m12.809444941s) [upload=13062]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:05:59.222392987 (12h39m12.809449198s) [upload=13062]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:05:59.224964628 (12h39m12.81202087s) [upload=13062]: Next segment err: metaclient: Too Many Requests Aug 8 05:05:59.224998492 (12h39m12.812054733s) [upload=13062]: Done uploading segments... Aug 8 05:05:59.225016314 (12h39m12.812072566s) [upload=13062]: Upload finished. err: metaclient: Too Many Requests Duration: 376.94815ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 598.614436ms FAIL (2025-08-08 05:24:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== FUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902886958 (12h38m23.489943169s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902968320 (12h38m23.490024531s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903203899 (12h38m23.49026011s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903277728 (12h38m23.490333949s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903887185 (12h38m23.490943396s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904280910 (12h38m23.491337121s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904741781 (12h38m23.491798002s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.905445835 (12h38m23.492502056s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908065075 (12h38m23.495121286s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908337784 (12h38m23.495394005s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908596446 (12h38m23.495652667s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908863415 (12h38m23.495919626s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909095087 (12h38m23.496151298s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909564894 (12h38m23.496621105s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909798521 (12h38m23.496854732s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913123327 (12h38m23.500179539s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913897903 (12h38m23.500954124s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.994958464 (12h38m23.582014675s) [upload=13052]: Next returned nil segment Aug 8 05:05:09.994970847 (12h38m23.582027059s) [upload=13052]: Waiting for error group managing segments... Aug 8 05:05:10.004228059 (12h38m23.591284269s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.006942486 (12h38m23.593998707s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.007054394 (12h38m23.594110606s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008056936 (12h38m23.595113157s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008229177 (12h38m23.595285388s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008399085 (12h38m23.595455295s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.009486263 (12h38m23.596542475s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.010095211 (12h38m23.597151421s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012507043 (12h38m23.599563255s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012930493 (12h38m23.599986714s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016274496 (12h38m23.603330717s) [noise=true , address=104.36.82.46:4484 , piece_id=6XF4A3CJFEIR7YYJRKQEGKEMQRHZL2476NYKBDCRLVFUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016318107 (12h38m23.603374318s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.017348971 (12h38m23.604405192s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019251644 (12h38m23.606307865s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019271681 (12h38m23.606327902s) [seg_pos={0 0}, upload=13052]: Segment reached optimal threshold of 14 pieces. Aug 8 05:05:10.019364094 (12h38m23.606420315s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HZjKTnjpeNU5B6muVHGrmWQS8GsyuYTW6cLxzNk5CGt3b8PJS): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019419366 (12h38m23.606475587s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ArPftAghEJaoHeAEPqGK9QDhRguh3yEovFUjkEMSDBdsfAVnC): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019436980 (12h38m23.606493201s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019551794 (12h38m23.606608015s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:34900->64.49.13.139:4471: use of closed network connection; context canceled Aug 8 05:05:10.019574186 (12h38m23.606630407s) [seg_pos={0 0}, upload=13052]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:05:10.019623639 (12h38m23.60667986s) [upload=13052]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:05:10.019627686 (12h38m23.606683908s) [upload=13052]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:05:10.062625493 (12h38m23.649681704s) [upload=13052]: Done uploading segments... Aug 8 05:05:10.062638988 (12h38m23.649695199s) [upload=13052]: Upload finished. err: <nil> Aug 8 05:05:59.222059876 (12h39m12.809116097s) [upload=13062]: Starting upload Aug 8 05:05:59.222115750 (12h39m12.809171971s) [upload=13062]: Done starting upload Aug 8 05:05:59.222204426 (12h39m12.809260667s) [upload=13062]: Uploading segments... Aug 8 05:05:59.222357882 (12h39m12.809414094s) [upload=13062]: Got next segment. Inline: false Aug 8 05:05:59.222388720 (12h39m12.809444941s) [upload=13062]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:05:59.222392987 (12h39m12.809449198s) [upload=13062]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:05:59.224964628 (12h39m12.81202087s) [upload=13062]: Next segment err: metaclient: Too Many Requests Aug 8 05:05:59.224998492 (12h39m12.812054733s) [upload=13062]: Done uploading segments... Aug 8 05:05:59.225016314 (12h39m12.812072566s) [upload=13062]: Upload finished. err: metaclient: Too Many Requests Duration: 598.637758ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 403.903076ms FAIL (2025-08-08 05:23:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== FUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902886958 (12h38m23.489943169s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.902968320 (12h38m23.490024531s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903203899 (12h38m23.49026011s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903277728 (12h38m23.490333949s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.903887185 (12h38m23.490943396s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904280910 (12h38m23.491337121s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.904741781 (12h38m23.491798002s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.905445835 (12h38m23.492502056s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908065075 (12h38m23.495121286s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908337784 (12h38m23.495394005s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908596446 (12h38m23.495652667s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.908863415 (12h38m23.495919626s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909095087 (12h38m23.496151298s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909564894 (12h38m23.496621105s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.909798521 (12h38m23.496854732s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913123327 (12h38m23.500179539s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.913897903 (12h38m23.500954124s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Uploading piece... Aug 8 05:05:09.994958464 (12h38m23.582014675s) [upload=13052]: Next returned nil segment Aug 8 05:05:09.994970847 (12h38m23.582027059s) [upload=13052]: Waiting for error group managing segments... Aug 8 05:05:10.004228059 (12h38m23.591284269s) [noise=true , address=45.91.116.14:4221 , piece_id=YI7ORTVRE27G6IUGZMGLDXACGJARPGG53U4D5KYRL753WFQAXKWQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.006942486 (12h38m23.593998707s) [noise=true , address=104.36.82.12:4159 , piece_id=26EIGFILFTIED7LI2AJOTCOENVIU7L5GECTGOW63DSRZE53XJBBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.007054394 (12h38m23.594110606s) [noise=true , address=104.36.82.44:4878 , piece_id=DTWZMWRLAJGFQ3XKQON5F5K7JITWJYRE35KKGTMZHH437FTXH4HA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008056936 (12h38m23.595113157s) [noise=true , address=104.36.82.2:4750 , piece_id=XSJZDTHED3BCOMDSB5H655EG2ONE4CKQIYHOS76NY6SK5YTHJLBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008229177 (12h38m23.595285388s) [noise=true , address=104.36.82.15:4282 , piece_id=MOA6ZGHZGLE4USOBDMOCJ5HXN46DQOEBNC4JSZQ6PHBXMUHIR6HQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.008399085 (12h38m23.595455295s) [noise=true , address=104.36.82.9:4032 , piece_id=E4CZGIFZV22EXI37L2GWLLRLVQT3NRGLCJTRU7WCCHTTV7DLGOBQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.009486263 (12h38m23.596542475s) [noise=true , address=104.36.82.61:4408 , piece_id=FJYCCORIY34JJJNQV2JEIHGMZR7YV4IGCY5OLUFGRBJ4TJ3YWSBA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.010095211 (12h38m23.597151421s) [noise=true , address=104.36.82.60:4351 , piece_id=SQY5CYAVNOGOQ52JZMPL7R4VV5YVC6SWUCYCROJ2BR76EQDUUSHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012507043 (12h38m23.599563255s) [noise=true , address=104.36.82.36:4638 , piece_id=XVX5226ED3PZYMJRKNOAUK6BO2ES6PU465KVYST5HVTVIH3M6FOQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.012930493 (12h38m23.599986714s) [noise=true , address=104.36.82.62:4422 , piece_id=KHRHJ64DEUR6EANH7NX7QUARO2MY54XB3SQJKZOLU4FFPOX32NJQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016274496 (12h38m23.603330717s) [noise=true , address=104.36.82.46:4484 , piece_id=6XF4A3CJFEIR7YYJRKQEGKEMQRHZL2476NYKBDCRLVFUKU7AV5CQ, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.016318107 (12h38m23.603374318s) [noise=true , address=104.36.82.59:4324 , piece_id=MMDNGU2HBR3MJ2SR5KLTIT76PDOW3CKE2KPWZS6M77DEF7OQHI7Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.017348971 (12h38m23.604405192s) [noise=true , address=104.36.82.23:4477 , piece_id=R42AESDF35X4SVBHPFDEVFYPJMVJG6QHUQHMCP4WVBPMHFCWY43Q, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019251644 (12h38m23.606307865s) [noise=true , address=104.36.82.38:4700 , piece_id=MGQQS4PRLNFQU2NPYQXHB5CAI5KFLFKZN6AS2A55PI6F6ICTDYMA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: <nil> Aug 8 05:05:10.019271681 (12h38m23.606327902s) [seg_pos={0 0}, upload=13052]: Segment reached optimal threshold of 14 pieces. Aug 8 05:05:10.019364094 (12h38m23.606420315s) [noise=true , address=104.36.82.47:4517 , piece_id=SWWVJ5FQGSHW7BET4PHBVE6ECSQLPZSQXG7SKXLHTAKMLNCE7W2A, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HZjKTnjpeNU5B6muVHGrmWQS8GsyuYTW6cLxzNk5CGt3b8PJS): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019419366 (12h38m23.606475587s) [noise=true , address=104.36.82.7:4942 , piece_id=G5NFDZL4WKW3J4OUCMPEJXGI7BRXMCDI2SJZ5PVFZCNGSSCF4GHA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ArPftAghEJaoHeAEPqGK9QDhRguh3yEovFUjkEMSDBdsfAVnC): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019436980 (12h38m23.606493201s) [noise=true , address=104.36.82.55:4198 , piece_id=2VJ3CVXOUNXTXUIVBILMGERZUZQOV6FMWFXMARP56ONZUIRIMHLA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL): protocol: expected piece hash; context canceled; EOF Aug 8 05:05:10.019551794 (12h38m23.606608015s) [noise=true , address=64.49.13.139:4471 , piece_id=YAEUZ6XR52TJODFYAGPT4Q7TWNXHJKGUKRZGPK2LIWKZSDZYHYJA, seg_pos={0 0}, upload=13052]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:34900->64.49.13.139:4471: use of closed network connection; context canceled Aug 8 05:05:10.019574186 (12h38m23.606630407s) [seg_pos={0 0}, upload=13052]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:05:10.019623639 (12h38m23.60667986s) [upload=13052]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:05:10.019627686 (12h38m23.606683908s) [upload=13052]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:05:10.062625493 (12h38m23.649681704s) [upload=13052]: Done uploading segments... Aug 8 05:05:10.062638988 (12h38m23.649695199s) [upload=13052]: Upload finished. err: <nil> Aug 8 05:05:59.222059876 (12h39m12.809116097s) [upload=13062]: Starting upload Aug 8 05:05:59.222115750 (12h39m12.809171971s) [upload=13062]: Done starting upload Aug 8 05:05:59.222204426 (12h39m12.809260667s) [upload=13062]: Uploading segments... Aug 8 05:05:59.222357882 (12h39m12.809414094s) [upload=13062]: Got next segment. Inline: false Aug 8 05:05:59.222388720 (12h39m12.809444941s) [upload=13062]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:05:59.222392987 (12h39m12.809449198s) [upload=13062]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:05:59.224964628 (12h39m12.81202087s) [upload=13062]: Next segment err: metaclient: Too Many Requests Aug 8 05:05:59.224998492 (12h39m12.812054733s) [upload=13062]: Done uploading segments... Aug 8 05:05:59.225016314 (12h39m12.812072566s) [upload=13062]: Upload finished. err: metaclient: Too Many Requests Duration: 403.933694ms core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)