Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.15851793s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:45:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.158532006s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.159490114s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:44:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.159507688s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.056152557s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:44:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.056180349s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.074030635s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:42:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.074048508s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.225715543s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:42:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.225737724s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.206025635s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:41:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.206047076s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.298138867s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:40:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.298163202s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.637245778s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:40:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.637268228s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.145077178s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:40:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.145091325s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.140859861s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:39:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.140881452s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.173772426s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:39:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.173792524s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.629713729s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:38:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.629741922s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.113602006s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:37:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.113622134s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.144789876s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:36:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.144814232s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.525272016s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:35:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.525294948s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.558255838s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:35:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.558273311s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.548199369s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:34:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.548225086s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.17820767s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:34:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.178234441s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.622313461s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:33:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.622329381s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.631908786s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:32:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.631926329s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.13009465s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:31:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.130115557s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.085623942s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:30:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.085642456s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.146288661s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:29:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.146336122s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.138323954s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:28:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.138340053s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.18476362s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:27:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.184780331s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.310921139s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:26:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.310961795s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.844342215s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:26:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.844359607s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 2.168631104s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:24:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.168660577s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 2.171734861s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:23:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.171752374s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 2.603513592s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:23:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.603527758s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 2.253845923s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:22:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.253873106s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 2.154502437s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:21:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.154516003s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 2.164431845s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:21:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.164451463s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 2.084719932s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:20:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.084762713s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 2.152847536s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:19:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.152868013s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 2.614530133s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:19:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.614543568s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 2.093627746s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:18:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.093650769s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.636726991s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:17:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.636748982s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.173744026s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:16:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.173766117s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 4.100368422s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:16:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.100389592s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 2.305628202s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:15:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.305646095s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 2.120701912s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:15:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.120719306s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.19708896s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:14:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.197119557s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.126751938s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:14:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.126773478s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.138933145s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:14:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.138964933s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 2.082187032s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:13:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.082219642s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 2.137702797s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:12:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.137725419s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 2.098958333s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:11:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.098982528s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 2.121286155s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:10:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.121306856s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.121176953s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:10:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.121192913s core uplink eu-select-1 eu1-placement-15

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)