Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 2.303590604s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:08:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.303609529s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 2.248982947s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:08:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.249002604s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 2.211844215s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:08:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.211864543s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 2.169626383s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:07:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.169646492s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m26.846415004s trace: https://jaeger.dev.storj.io/trace/30733db3a5ebb756 FAIL (2025-12-16 18:06:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Dec 16 18:05:33.598413446 (266h36m21.295981752s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.598715631 (266h36m21.296283936s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599028225 (266h36m21.296596531s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599338223 (266h36m21.29690654s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.599679140 (266h36m21.297247456s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600116688 (266h36m21.297684993s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600499864 (266h36m21.29806817s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.600841622 (266h36m21.298409928s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601170096 (266h36m21.298738412s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:33.601506575 (266h36m21.299074891s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Uploading piece... Dec 16 18:05:34.058098226 (266h36m21.755666532s) [upload=234402]: Next returned nil segment Dec 16 18:05:34.058108786 (266h36m21.755677102s) [upload=234402]: Waiting for error group managing segments... Dec 16 18:05:34.230790225 (266h36m21.928358561s) [noise=true , address=81.171.14.70:4038 , piece_id=6QZEQ7PCWMDR33YM62UFOZAKYSPIY2M7BT5DCPMFZBU7DDCDEX7Q, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.231987602 (266h36m21.929555938s) [noise=true , address=89.149.201.147:4005 , piece_id=77VFLTXNYFW54MWFXX53DXUNHF7PTE2MBPN675OQIAJWA6NURKFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.232960900 (266h36m21.930529246s) [noise=true , address=89.149.201.147:4008 , piece_id=CDNSVS7LMUV3RWCVPH7ARAWABHEIS4GQ5LACDUIZTZUI4ADAKNNQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.240349743 (266h36m21.937918079s) [noise=true , address=185.167.204.205:4018 , piece_id=YYHN2K76BGZSHVXHSFGRKSUTKZ7GCUXRU3TPLVONXBS3EXCNNAVA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.241900070 (266h36m21.939468406s) [noise=true , address=185.167.204.205:4028 , piece_id=NQX2A6NQ4O576LQQ3PLWVCEBKZLYWP62EMMT3DY37OPBKDCIWMFQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242043999 (266h36m21.939612345s) [noise=true , address=185.167.204.205:4011 , piece_id=PMO7MMVBTYG4KG6BEMLG437XJNTYA7SSKMZLJK6MZPQBZEB2WDDQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.242959198 (266h36m21.940527534s) [noise=true , address=81.171.14.70:4044 , piece_id=YLGPKPPPEL4HOZCQDOEVFVOBR5LD2PLXXSV4KPELDSN4CLUK433A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243597301 (266h36m21.941165637s) [noise=true , address=81.171.14.70:4033 , piece_id=FXB2RURYXDGKJIQR4DWS4YJSROX3EBETPHUUH3P6QUEIW3QOX7PQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.243784060 (266h36m21.941352396s) [noise=true , address=185.167.204.206:4041 , piece_id=IX3HLEW3ZRWUT3YDIVGVPBPCX2SYMF457PHTANVY4FOJGAK2OLSA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244185369 (266h36m21.941753705s) [noise=true , address=185.167.204.205:4012 , piece_id=WZJTOZNZA54PQVESUBBMGE6J6HTJFV7QUEEDZLJDYITYZFSGCMXA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.244625802 (266h36m21.942194148s) [noise=true , address=81.171.14.70:4035 , piece_id=XNUDAEELGYJ3NSVNEY2DCQLXFSVO6KMT7DVSDEUQZY5TQWOPESYA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.245441095 (266h36m21.943009421s) [noise=true , address=185.167.204.206:4056 , piece_id=PYNORH7ZHYZPC56ZJ3WKG3V3DZXTRA76U4LPI3GKVYNIFYAMZS3A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.249148782 (266h36m21.946717118s) [noise=true , address=185.167.204.206:4047 , piece_id=IGHCIM4DZ42BIWKGLGRSE5A2JMJ4TL7KPIC2VVPGO3YI7M2DIGVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.250464039 (266h36m21.948032376s) [noise=true , address=89.149.201.147:4001 , piece_id=EXWXKMFS42ES2PRLRSBB2ESNDFJA5T34UZTVH2RV55XRWV7NCQTA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.254298583 (266h36m21.951866929s) [noise=true , address=81.171.14.70:4031 , piece_id=XUH256UDHQR4P6YTCCLF5NRS3BR3PULJL4MEPADGBCLG4LPNST2A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257378426 (266h36m21.954946762s) [noise=true , address=185.167.204.205:4019 , piece_id=KVZCMOYEOLLA4DHF5BDUPPD5Q4JGO4DQ25Z76IMZSXVGSZKFTA6A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.257802458 (266h36m21.955370794s) [noise=true , address=185.167.204.206:4069 , piece_id=EJ5RKSNCV765JC6SPEDTF5BUQLJIW342SRZH67K3HFDIAWWNL2KQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.258952717 (266h36m21.956521053s) [noise=true , address=81.171.14.70:4042 , piece_id=Z3PFRIYYINI4DXQYFCIDF6ETF3Y3EC5CFBFRWOSBRJFJGQJDE5FA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260312107 (266h36m21.957880443s) [noise=true , address=81.171.14.70:4037 , piece_id=4TSH4CYIH73S4Y2ULL633KZKTJKGJKUJB7X7HG7JAEUJHHJDT7AA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.260655789 (266h36m21.958224126s) [noise=true , address=81.171.14.70:4046 , piece_id=C3DEHTHCYX2ROM3H7E7TJE5WDSBVSIWFO4XSV5MU3LCH4HQ57RVQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.262811877 (266h36m21.960380213s) [noise=true , address=185.167.204.206:4049 , piece_id=557IYUNNFFZBGFX6SH2OBJHQKY5NI5GCTEIZBKH4MDRWIPRUKWYQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.272675945 (266h36m21.97024428s) [noise=true , address=185.167.204.206:4071 , piece_id=XFRXYWOJEXSFJOQK5DH4X7QCKAMX36KYIBOJMTCILVGV46ZXUBQA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.273114744 (266h36m21.97068309s) [noise=true , address=185.167.204.206:4055 , piece_id=SOI2BEEBB7GCJYEDYQRZZIEQPABHUT2KI7B3H3Z5WKNGBVN4SYIQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.274231270 (266h36m21.971799606s) [noise=true , address=185.167.204.205:4006 , piece_id=QWOIEMTT4NX5LM4MWN6EAGGRUJYAKGCUT43CDCBDWKNLRHSMGA7A, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.276867736 (266h36m21.974436071s) [noise=true , address=185.167.204.206:4063 , piece_id=ELQQFHZJ43KP6LWUOJVAVDBOOI42B2R2TNXAXVQGDIHAONERVSPA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290527414 (266h36m21.98809575s) [noise=true , address=89.149.201.147:4017 , piece_id=ZMGNTBL2VABQBAXNGWIRDOVC6REQFUOBKWUW5GM46EA2ZJNYIEDA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: <nil> Dec 16 18:05:34.290542662 (266h36m21.988110999s) [seg_pos={0 0}, upload=234402]: Segment reached optimal threshold of 26 pieces. Dec 16 18:05:34.290783372 (266h36m21.988351708s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290793832 (266h36m21.988362167s) [noise=true , address=89.149.201.147:4009 , piece_id=J5E3LH4FVDO3J5AAZWJDACQ2Q3XMGYPYEQVJSXDLY5L75AHL2NRA, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290900742 (266h36m21.988469078s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b): protocol: expected piece hash; context canceled; EOF Dec 16 18:05:34.290929314 (266h36m21.988497661s) [noise=true , address=81.171.14.70:4026 , piece_id=WXO6DTEON65QXRANMTHG35AXLQXGKVXAW3BBOBOAZJPV46BVC7YQ, seg_pos={0 0}, upload=234402]: Long tail cancellation due to optimal threshold Dec 16 18:05:34.290958750 (266h36m21.988527085s) [seg_pos={0 0}, upload=234402]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 18:05:34.291068805 (266h36m21.988637141s) [upload=234402]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 18:05:34.291075427 (266h36m21.988643764s) [upload=234402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 18:06:59.971827223 (266h37m47.669395569s) [upload=234402]: Done uploading segments... Dec 16 18:06:59.971972925 (266h37m47.669541272s) [upload=234402]: Upload finished. err: metaclient: context deadline exceeded Duration: 1m26.846431915s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.752851993s trace: https://jaeger.dev.storj.io/trace/7608b45d5a11c8a3 FAIL (2025-12-16 17:39:35 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.752890335s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.900627593s trace: https://jaeger.dev.storj.io/trace/7608b45d5a11c8a3 FAIL (2025-12-16 17:38:22 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.900735876s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.521502547s trace: https://jaeger.dev.storj.io/trace/7608b45d5a11c8a3 FAIL (2025-12-16 17:37:36 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.521528825s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.761128575s trace: https://jaeger.dev.storj.io/trace/7608b45d5a11c8a3 FAIL (2025-12-16 17:37:17 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.761149916s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.736003558s trace: https://jaeger.dev.storj.io/trace/7608b45d5a11c8a3 FAIL (2025-12-16 17:36:42 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.736036351s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.134449991s trace: https://jaeger.dev.storj.io/trace/5683d14cc62eee41 FAIL (2025-12-16 17:35:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== . Dec 16 16:53:09.845598423 (265h23m57.543166758s) [noise=true , address=185.167.204.205:4015 , piece_id=L7P6B35RE5NTIOA3JTG535RSBF42IHHC3SJSJY7JIQGP4KJUHIYQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.846066447 (265h23m57.543634783s) [noise=true , address=185.167.204.206:4072 , piece_id=6BIZRUDCOCOYAF33R5OBNC7JFO24KVYSWPUBWAGQ5KDFMTBE25TA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.846618208 (265h23m57.544186544s) [noise=true , address=81.171.14.70:4037 , piece_id=I574CDK3DF4VD6DNSU2EZVEZSXV7TXQLTDQ6PXOGNZ5NBS3WLG7A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.847117681 (265h23m57.544686018s) [noise=true , address=185.167.204.206:4054 , piece_id=D4AZ6L635EREAOFXQB5WOZODYHI3JDX622TDCIQFYAQVQNLY5PQA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.847646829 (265h23m57.545215176s) [noise=true , address=81.171.14.70:4036 , piece_id=2DRO2WQNKIQOLQONGLT6UPIWA3MQPWOESLFKTWLP2ALHZPGBMKDA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.849322711 (265h23m57.546891047s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.849923874 (265h23m57.54749221s) [noise=true , address=89.149.201.147:4021 , piece_id=Z3CQ3EQAXFLENOPKJP3DKAYGXNO2376ST6Z55HGJSMZYEMBU73NQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.850581442 (265h23m57.548149788s) [noise=true , address=89.149.201.147:4008 , piece_id=JKTXCHUFHQQA5HLZU4MYASODZVSGXBTXKAFIHMEB4DZVZDSWGVKA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.851295546 (265h23m57.548863882s) [noise=true , address=185.167.204.206:4066 , piece_id=YAMEYYASLEP75NXGHJ65OK7HOS67BVR5ZG2WTMKNUBXCOUOBPPOQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.851846756 (265h23m57.549415132s) [noise=true , address=185.167.204.205:4033 , piece_id=F2X3ZTK52MNL5Q6W5FEDNRLBFBWJSMQ5XUX7HVNMRTYFRUP4NF5A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:10.300410080 (265h23m57.997978386s) [upload=233340]: Next returned nil segment Dec 16 16:53:10.300419738 (265h23m57.997988054s) [upload=233340]: Waiting for error group managing segments... Dec 16 16:53:10.487707706 (265h23m58.185276032s) [noise=true , address=185.167.204.206:4066 , piece_id=YAMEYYASLEP75NXGHJ65OK7HOS67BVR5ZG2WTMKNUBXCOUOBPPOQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.488519382 (265h23m58.186087698s) [noise=true , address=185.167.204.206:4072 , piece_id=6BIZRUDCOCOYAF33R5OBNC7JFO24KVYSWPUBWAGQ5KDFMTBE25TA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.488981015 (265h23m58.18654932s) [noise=true , address=185.167.204.205:4020 , piece_id=FAU7CY7IYUPFV47CRJ55FLCBTLL4QUIFJ5NGKBNYR53PUCRIKDNQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.489259936 (265h23m58.186828272s) [noise=true , address=185.167.204.205:4027 , piece_id=7DJF2FS4NNSAM7O3JLCHSXDYXW2B2TK5HBRCVHHCEPXRQ3JFFOJA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.493026132 (265h23m58.190594468s) [noise=true , address=185.167.204.205:4033 , piece_id=F2X3ZTK52MNL5Q6W5FEDNRLBFBWJSMQ5XUX7HVNMRTYFRUP4NF5A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.497763182 (265h23m58.195331487s) [noise=true , address=185.167.204.206:4063 , piece_id=CXJZQGWPLX2GR6FT4PVMJLFRIFQQCLS4FOCPAJSS4ZV34IX4DN2A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.500875446 (265h23m58.198443762s) [noise=true , address=185.167.204.205:4015 , piece_id=L7P6B35RE5NTIOA3JTG535RSBF42IHHC3SJSJY7JIQGP4KJUHIYQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.503696186 (265h23m58.201264491s) [noise=true , address=89.149.201.147:4021 , piece_id=Z3CQ3EQAXFLENOPKJP3DKAYGXNO2376ST6Z55HGJSMZYEMBU73NQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.506666203 (265h23m58.20423454s) [noise=true , address=185.167.204.205:4016 , piece_id=I7ROD6VOVVTE5OOR462FPNK6FB5E6HCFVOAOATCYEGM7GEHI36MQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.514568155 (265h23m58.212136492s) [noise=true , address=185.167.204.205:4030 , piece_id=YKGL25SO3PZ2LBJMNJEPB4FO7PLWTD62GM4IIUKBLDYZTMBLQDCA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.516326801 (265h23m58.213895117s) [noise=true , address=185.167.204.206:4064 , piece_id=2PTLHY2JHHYERJM7FFAZVP6EBDX5D7RW7RNQPABQLSFT55HJA2QQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.524488249 (265h23m58.222056635s) [noise=true , address=185.167.204.206:4062 , piece_id=4YYT67CBPVP5QQHT7O2IK6GVLJAFNFALH76IMWILSRTA7NVNU2YQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.528223667 (265h23m58.225792004s) [noise=true , address=185.167.204.206:4054 , piece_id=D4AZ6L635EREAOFXQB5WOZODYHI3JDX622TDCIQFYAQVQNLY5PQA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.528675321 (265h23m58.226243637s) [noise=true , address=89.149.201.147:4010 , piece_id=QPL4PZCA57NVK32MVFHIPRUZ7NAMFJWGZPQK7PP6QMTRP4QCNGUA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.532773757 (265h23m58.230342073s) [noise=true , address=185.167.204.205:4002 , piece_id=PUYVE7TVOLH4ZH5SVTDEADQLFEYCB62PH3LPNBYJDJYNN7246VPA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.539818999 (265h23m58.237387315s) [noise=true , address=81.171.14.70:4048 , piece_id=R2KPQ7VPMPZHTH6PXZCDYN6HZVWJFA7RC55LMKZTQNCUQNQV2VAA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.550626359 (265h23m58.248194665s) [noise=true , address=81.171.14.70:4041 , piece_id=7N3BCTKBLRNEHWFDA4JG5EL2724JODUSMITRCNT5GNHHQ3XMXOGA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.562449477 (265h23m58.260017793s) [noise=true , address=81.171.14.70:4036 , piece_id=2DRO2WQNKIQOLQONGLT6UPIWA3MQPWOESLFKTWLP2ALHZPGBMKDA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.581197291 (265h23m58.278765627s) [noise=true , address=89.149.201.147:4012 , piece_id=C4N4DMRVA7VHN3MVUXQ7YCGC67Q7WAW6AMM7E35XJUXQUB3F26MQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.585618260 (265h23m58.283186567s) [noise=true , address=89.149.201.147:4009 , piece_id=SJOCJGUYVOXZWMHZQEGNMZXJDCZUMB2WP5FSYJ3EAUNQGODCOFQA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.592780691 (265h23m58.290349027s) [noise=true , address=185.167.204.206:4071 , piece_id=D3SV3RVHYGAU77TLBJNHBETNKILWBLOHOKCX5POSX36USLR7YT6A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.618165813 (265h23m58.315734129s) [noise=true , address=89.149.201.147:4008 , piece_id=JKTXCHUFHQQA5HLZU4MYASODZVSGXBTXKAFIHMEB4DZVZDSWGVKA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.964120185 (265h23m58.661688521s) [noise=true , address=81.171.14.70:4037 , piece_id=I574CDK3DF4VD6DNSU2EZVEZSXV7TXQLTDQ6PXOGNZ5NBS3WLG7A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.026637691 (265h23m58.724206017s) [noise=true , address=89.149.201.147:4017 , piece_id=WV2W3UABBSPQTLLCYXM2WAKP2I5BUFE4M4XD3WECWR7EBUEOYLHQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.033231919 (265h23m58.730800256s) [noise=true , address=89.149.201.147:4006 , piece_id=TYU2VBU2E4CBT4WA7LWBTSK6WMJNOY753UFSCLPRFNQUXUMGBXUA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.040392117 (265h23m58.737960453s) [noise=true , address=81.171.14.70:4043 , piece_id=WGFJVAFZ7U52TS35UNWIMB2NY66KOXYV5DEI5PCURD2D4VFWJXIA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.040410391 (265h23m58.737978737s) [seg_pos={0 0}, upload=233340]: Segment reached optimal threshold of 26 pieces. Dec 16 16:53:11.040665407 (265h23m58.738233743s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J): protocol: expected piece hash; context canceled; EOF Dec 16 16:53:11.040681107 (265h23m58.738249453s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Long tail cancellation due to optimal threshold Dec 16 16:53:11.040938978 (265h23m58.738507314s) [noise=true , address=89.149.201.147:4019 , piece_id=QNHI7H4QBIYTA64JBQJKFPJEHK54WGHWEXOPTNME7ZFZ2FJNT7GA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2): protocol: expected piece hash; context canceled; EOF Dec 16 16:53:11.040951392 (265h23m58.738519727s) [noise=true , address=89.149.201.147:4019 , piece_id=QNHI7H4QBIYTA64JBQJKFPJEHK54WGHWEXOPTNME7ZFZ2FJNT7GA, seg_pos={0 0}, upload=233340]: Long tail cancellation due to optimal threshold Dec 16 16:53:11.041003759 (265h23m58.738572096s) [seg_pos={0 0}, upload=233340]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 16:53:11.041087015 (265h23m58.738655351s) [upload=233340]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 16:53:11.041093397 (265h23m58.738661733s) [upload=233340]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 16:54:06.282124914 (265h24m53.97969323s) [upload=233340]: Done uploading segments... Dec 16 16:54:06.282202999 (265h24m53.979771305s) [upload=233340]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.134477071s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.712963914s trace: https://jaeger.dev.storj.io/trace/7608b45d5a11c8a3 FAIL (2025-12-16 17:35:30 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.71298325s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.195473974s trace: https://jaeger.dev.storj.io/trace/5683d14cc62eee41 FAIL (2025-12-16 17:34:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== . Dec 16 16:53:09.845598423 (265h23m57.543166758s) [noise=true , address=185.167.204.205:4015 , piece_id=L7P6B35RE5NTIOA3JTG535RSBF42IHHC3SJSJY7JIQGP4KJUHIYQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.846066447 (265h23m57.543634783s) [noise=true , address=185.167.204.206:4072 , piece_id=6BIZRUDCOCOYAF33R5OBNC7JFO24KVYSWPUBWAGQ5KDFMTBE25TA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.846618208 (265h23m57.544186544s) [noise=true , address=81.171.14.70:4037 , piece_id=I574CDK3DF4VD6DNSU2EZVEZSXV7TXQLTDQ6PXOGNZ5NBS3WLG7A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.847117681 (265h23m57.544686018s) [noise=true , address=185.167.204.206:4054 , piece_id=D4AZ6L635EREAOFXQB5WOZODYHI3JDX622TDCIQFYAQVQNLY5PQA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.847646829 (265h23m57.545215176s) [noise=true , address=81.171.14.70:4036 , piece_id=2DRO2WQNKIQOLQONGLT6UPIWA3MQPWOESLFKTWLP2ALHZPGBMKDA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.849322711 (265h23m57.546891047s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.849923874 (265h23m57.54749221s) [noise=true , address=89.149.201.147:4021 , piece_id=Z3CQ3EQAXFLENOPKJP3DKAYGXNO2376ST6Z55HGJSMZYEMBU73NQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.850581442 (265h23m57.548149788s) [noise=true , address=89.149.201.147:4008 , piece_id=JKTXCHUFHQQA5HLZU4MYASODZVSGXBTXKAFIHMEB4DZVZDSWGVKA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.851295546 (265h23m57.548863882s) [noise=true , address=185.167.204.206:4066 , piece_id=YAMEYYASLEP75NXGHJ65OK7HOS67BVR5ZG2WTMKNUBXCOUOBPPOQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.851846756 (265h23m57.549415132s) [noise=true , address=185.167.204.205:4033 , piece_id=F2X3ZTK52MNL5Q6W5FEDNRLBFBWJSMQ5XUX7HVNMRTYFRUP4NF5A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:10.300410080 (265h23m57.997978386s) [upload=233340]: Next returned nil segment Dec 16 16:53:10.300419738 (265h23m57.997988054s) [upload=233340]: Waiting for error group managing segments... Dec 16 16:53:10.487707706 (265h23m58.185276032s) [noise=true , address=185.167.204.206:4066 , piece_id=YAMEYYASLEP75NXGHJ65OK7HOS67BVR5ZG2WTMKNUBXCOUOBPPOQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.488519382 (265h23m58.186087698s) [noise=true , address=185.167.204.206:4072 , piece_id=6BIZRUDCOCOYAF33R5OBNC7JFO24KVYSWPUBWAGQ5KDFMTBE25TA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.488981015 (265h23m58.18654932s) [noise=true , address=185.167.204.205:4020 , piece_id=FAU7CY7IYUPFV47CRJ55FLCBTLL4QUIFJ5NGKBNYR53PUCRIKDNQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.489259936 (265h23m58.186828272s) [noise=true , address=185.167.204.205:4027 , piece_id=7DJF2FS4NNSAM7O3JLCHSXDYXW2B2TK5HBRCVHHCEPXRQ3JFFOJA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.493026132 (265h23m58.190594468s) [noise=true , address=185.167.204.205:4033 , piece_id=F2X3ZTK52MNL5Q6W5FEDNRLBFBWJSMQ5XUX7HVNMRTYFRUP4NF5A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.497763182 (265h23m58.195331487s) [noise=true , address=185.167.204.206:4063 , piece_id=CXJZQGWPLX2GR6FT4PVMJLFRIFQQCLS4FOCPAJSS4ZV34IX4DN2A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.500875446 (265h23m58.198443762s) [noise=true , address=185.167.204.205:4015 , piece_id=L7P6B35RE5NTIOA3JTG535RSBF42IHHC3SJSJY7JIQGP4KJUHIYQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.503696186 (265h23m58.201264491s) [noise=true , address=89.149.201.147:4021 , piece_id=Z3CQ3EQAXFLENOPKJP3DKAYGXNO2376ST6Z55HGJSMZYEMBU73NQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.506666203 (265h23m58.20423454s) [noise=true , address=185.167.204.205:4016 , piece_id=I7ROD6VOVVTE5OOR462FPNK6FB5E6HCFVOAOATCYEGM7GEHI36MQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.514568155 (265h23m58.212136492s) [noise=true , address=185.167.204.205:4030 , piece_id=YKGL25SO3PZ2LBJMNJEPB4FO7PLWTD62GM4IIUKBLDYZTMBLQDCA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.516326801 (265h23m58.213895117s) [noise=true , address=185.167.204.206:4064 , piece_id=2PTLHY2JHHYERJM7FFAZVP6EBDX5D7RW7RNQPABQLSFT55HJA2QQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.524488249 (265h23m58.222056635s) [noise=true , address=185.167.204.206:4062 , piece_id=4YYT67CBPVP5QQHT7O2IK6GVLJAFNFALH76IMWILSRTA7NVNU2YQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.528223667 (265h23m58.225792004s) [noise=true , address=185.167.204.206:4054 , piece_id=D4AZ6L635EREAOFXQB5WOZODYHI3JDX622TDCIQFYAQVQNLY5PQA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.528675321 (265h23m58.226243637s) [noise=true , address=89.149.201.147:4010 , piece_id=QPL4PZCA57NVK32MVFHIPRUZ7NAMFJWGZPQK7PP6QMTRP4QCNGUA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.532773757 (265h23m58.230342073s) [noise=true , address=185.167.204.205:4002 , piece_id=PUYVE7TVOLH4ZH5SVTDEADQLFEYCB62PH3LPNBYJDJYNN7246VPA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.539818999 (265h23m58.237387315s) [noise=true , address=81.171.14.70:4048 , piece_id=R2KPQ7VPMPZHTH6PXZCDYN6HZVWJFA7RC55LMKZTQNCUQNQV2VAA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.550626359 (265h23m58.248194665s) [noise=true , address=81.171.14.70:4041 , piece_id=7N3BCTKBLRNEHWFDA4JG5EL2724JODUSMITRCNT5GNHHQ3XMXOGA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.562449477 (265h23m58.260017793s) [noise=true , address=81.171.14.70:4036 , piece_id=2DRO2WQNKIQOLQONGLT6UPIWA3MQPWOESLFKTWLP2ALHZPGBMKDA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.581197291 (265h23m58.278765627s) [noise=true , address=89.149.201.147:4012 , piece_id=C4N4DMRVA7VHN3MVUXQ7YCGC67Q7WAW6AMM7E35XJUXQUB3F26MQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.585618260 (265h23m58.283186567s) [noise=true , address=89.149.201.147:4009 , piece_id=SJOCJGUYVOXZWMHZQEGNMZXJDCZUMB2WP5FSYJ3EAUNQGODCOFQA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.592780691 (265h23m58.290349027s) [noise=true , address=185.167.204.206:4071 , piece_id=D3SV3RVHYGAU77TLBJNHBETNKILWBLOHOKCX5POSX36USLR7YT6A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.618165813 (265h23m58.315734129s) [noise=true , address=89.149.201.147:4008 , piece_id=JKTXCHUFHQQA5HLZU4MYASODZVSGXBTXKAFIHMEB4DZVZDSWGVKA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.964120185 (265h23m58.661688521s) [noise=true , address=81.171.14.70:4037 , piece_id=I574CDK3DF4VD6DNSU2EZVEZSXV7TXQLTDQ6PXOGNZ5NBS3WLG7A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.026637691 (265h23m58.724206017s) [noise=true , address=89.149.201.147:4017 , piece_id=WV2W3UABBSPQTLLCYXM2WAKP2I5BUFE4M4XD3WECWR7EBUEOYLHQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.033231919 (265h23m58.730800256s) [noise=true , address=89.149.201.147:4006 , piece_id=TYU2VBU2E4CBT4WA7LWBTSK6WMJNOY753UFSCLPRFNQUXUMGBXUA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.040392117 (265h23m58.737960453s) [noise=true , address=81.171.14.70:4043 , piece_id=WGFJVAFZ7U52TS35UNWIMB2NY66KOXYV5DEI5PCURD2D4VFWJXIA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.040410391 (265h23m58.737978737s) [seg_pos={0 0}, upload=233340]: Segment reached optimal threshold of 26 pieces. Dec 16 16:53:11.040665407 (265h23m58.738233743s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J): protocol: expected piece hash; context canceled; EOF Dec 16 16:53:11.040681107 (265h23m58.738249453s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Long tail cancellation due to optimal threshold Dec 16 16:53:11.040938978 (265h23m58.738507314s) [noise=true , address=89.149.201.147:4019 , piece_id=QNHI7H4QBIYTA64JBQJKFPJEHK54WGHWEXOPTNME7ZFZ2FJNT7GA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2): protocol: expected piece hash; context canceled; EOF Dec 16 16:53:11.040951392 (265h23m58.738519727s) [noise=true , address=89.149.201.147:4019 , piece_id=QNHI7H4QBIYTA64JBQJKFPJEHK54WGHWEXOPTNME7ZFZ2FJNT7GA, seg_pos={0 0}, upload=233340]: Long tail cancellation due to optimal threshold Dec 16 16:53:11.041003759 (265h23m58.738572096s) [seg_pos={0 0}, upload=233340]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 16:53:11.041087015 (265h23m58.738655351s) [upload=233340]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 16:53:11.041093397 (265h23m58.738661733s) [upload=233340]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 16:54:06.282124914 (265h24m53.97969323s) [upload=233340]: Done uploading segments... Dec 16 16:54:06.282202999 (265h24m53.979771305s) [upload=233340]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.195495185s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.773849643s trace: https://jaeger.dev.storj.io/trace/7608b45d5a11c8a3 FAIL (2025-12-16 17:34:41 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.773875712s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.602671206s trace: https://jaeger.dev.storj.io/trace/5683d14cc62eee41 FAIL (2025-12-16 17:34:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== . Dec 16 16:53:09.845598423 (265h23m57.543166758s) [noise=true , address=185.167.204.205:4015 , piece_id=L7P6B35RE5NTIOA3JTG535RSBF42IHHC3SJSJY7JIQGP4KJUHIYQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.846066447 (265h23m57.543634783s) [noise=true , address=185.167.204.206:4072 , piece_id=6BIZRUDCOCOYAF33R5OBNC7JFO24KVYSWPUBWAGQ5KDFMTBE25TA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.846618208 (265h23m57.544186544s) [noise=true , address=81.171.14.70:4037 , piece_id=I574CDK3DF4VD6DNSU2EZVEZSXV7TXQLTDQ6PXOGNZ5NBS3WLG7A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.847117681 (265h23m57.544686018s) [noise=true , address=185.167.204.206:4054 , piece_id=D4AZ6L635EREAOFXQB5WOZODYHI3JDX622TDCIQFYAQVQNLY5PQA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.847646829 (265h23m57.545215176s) [noise=true , address=81.171.14.70:4036 , piece_id=2DRO2WQNKIQOLQONGLT6UPIWA3MQPWOESLFKTWLP2ALHZPGBMKDA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.849322711 (265h23m57.546891047s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.849923874 (265h23m57.54749221s) [noise=true , address=89.149.201.147:4021 , piece_id=Z3CQ3EQAXFLENOPKJP3DKAYGXNO2376ST6Z55HGJSMZYEMBU73NQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.850581442 (265h23m57.548149788s) [noise=true , address=89.149.201.147:4008 , piece_id=JKTXCHUFHQQA5HLZU4MYASODZVSGXBTXKAFIHMEB4DZVZDSWGVKA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.851295546 (265h23m57.548863882s) [noise=true , address=185.167.204.206:4066 , piece_id=YAMEYYASLEP75NXGHJ65OK7HOS67BVR5ZG2WTMKNUBXCOUOBPPOQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.851846756 (265h23m57.549415132s) [noise=true , address=185.167.204.205:4033 , piece_id=F2X3ZTK52MNL5Q6W5FEDNRLBFBWJSMQ5XUX7HVNMRTYFRUP4NF5A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:10.300410080 (265h23m57.997978386s) [upload=233340]: Next returned nil segment Dec 16 16:53:10.300419738 (265h23m57.997988054s) [upload=233340]: Waiting for error group managing segments... Dec 16 16:53:10.487707706 (265h23m58.185276032s) [noise=true , address=185.167.204.206:4066 , piece_id=YAMEYYASLEP75NXGHJ65OK7HOS67BVR5ZG2WTMKNUBXCOUOBPPOQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.488519382 (265h23m58.186087698s) [noise=true , address=185.167.204.206:4072 , piece_id=6BIZRUDCOCOYAF33R5OBNC7JFO24KVYSWPUBWAGQ5KDFMTBE25TA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.488981015 (265h23m58.18654932s) [noise=true , address=185.167.204.205:4020 , piece_id=FAU7CY7IYUPFV47CRJ55FLCBTLL4QUIFJ5NGKBNYR53PUCRIKDNQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.489259936 (265h23m58.186828272s) [noise=true , address=185.167.204.205:4027 , piece_id=7DJF2FS4NNSAM7O3JLCHSXDYXW2B2TK5HBRCVHHCEPXRQ3JFFOJA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.493026132 (265h23m58.190594468s) [noise=true , address=185.167.204.205:4033 , piece_id=F2X3ZTK52MNL5Q6W5FEDNRLBFBWJSMQ5XUX7HVNMRTYFRUP4NF5A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.497763182 (265h23m58.195331487s) [noise=true , address=185.167.204.206:4063 , piece_id=CXJZQGWPLX2GR6FT4PVMJLFRIFQQCLS4FOCPAJSS4ZV34IX4DN2A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.500875446 (265h23m58.198443762s) [noise=true , address=185.167.204.205:4015 , piece_id=L7P6B35RE5NTIOA3JTG535RSBF42IHHC3SJSJY7JIQGP4KJUHIYQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.503696186 (265h23m58.201264491s) [noise=true , address=89.149.201.147:4021 , piece_id=Z3CQ3EQAXFLENOPKJP3DKAYGXNO2376ST6Z55HGJSMZYEMBU73NQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.506666203 (265h23m58.20423454s) [noise=true , address=185.167.204.205:4016 , piece_id=I7ROD6VOVVTE5OOR462FPNK6FB5E6HCFVOAOATCYEGM7GEHI36MQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.514568155 (265h23m58.212136492s) [noise=true , address=185.167.204.205:4030 , piece_id=YKGL25SO3PZ2LBJMNJEPB4FO7PLWTD62GM4IIUKBLDYZTMBLQDCA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.516326801 (265h23m58.213895117s) [noise=true , address=185.167.204.206:4064 , piece_id=2PTLHY2JHHYERJM7FFAZVP6EBDX5D7RW7RNQPABQLSFT55HJA2QQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.524488249 (265h23m58.222056635s) [noise=true , address=185.167.204.206:4062 , piece_id=4YYT67CBPVP5QQHT7O2IK6GVLJAFNFALH76IMWILSRTA7NVNU2YQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.528223667 (265h23m58.225792004s) [noise=true , address=185.167.204.206:4054 , piece_id=D4AZ6L635EREAOFXQB5WOZODYHI3JDX622TDCIQFYAQVQNLY5PQA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.528675321 (265h23m58.226243637s) [noise=true , address=89.149.201.147:4010 , piece_id=QPL4PZCA57NVK32MVFHIPRUZ7NAMFJWGZPQK7PP6QMTRP4QCNGUA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.532773757 (265h23m58.230342073s) [noise=true , address=185.167.204.205:4002 , piece_id=PUYVE7TVOLH4ZH5SVTDEADQLFEYCB62PH3LPNBYJDJYNN7246VPA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.539818999 (265h23m58.237387315s) [noise=true , address=81.171.14.70:4048 , piece_id=R2KPQ7VPMPZHTH6PXZCDYN6HZVWJFA7RC55LMKZTQNCUQNQV2VAA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.550626359 (265h23m58.248194665s) [noise=true , address=81.171.14.70:4041 , piece_id=7N3BCTKBLRNEHWFDA4JG5EL2724JODUSMITRCNT5GNHHQ3XMXOGA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.562449477 (265h23m58.260017793s) [noise=true , address=81.171.14.70:4036 , piece_id=2DRO2WQNKIQOLQONGLT6UPIWA3MQPWOESLFKTWLP2ALHZPGBMKDA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.581197291 (265h23m58.278765627s) [noise=true , address=89.149.201.147:4012 , piece_id=C4N4DMRVA7VHN3MVUXQ7YCGC67Q7WAW6AMM7E35XJUXQUB3F26MQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.585618260 (265h23m58.283186567s) [noise=true , address=89.149.201.147:4009 , piece_id=SJOCJGUYVOXZWMHZQEGNMZXJDCZUMB2WP5FSYJ3EAUNQGODCOFQA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.592780691 (265h23m58.290349027s) [noise=true , address=185.167.204.206:4071 , piece_id=D3SV3RVHYGAU77TLBJNHBETNKILWBLOHOKCX5POSX36USLR7YT6A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.618165813 (265h23m58.315734129s) [noise=true , address=89.149.201.147:4008 , piece_id=JKTXCHUFHQQA5HLZU4MYASODZVSGXBTXKAFIHMEB4DZVZDSWGVKA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.964120185 (265h23m58.661688521s) [noise=true , address=81.171.14.70:4037 , piece_id=I574CDK3DF4VD6DNSU2EZVEZSXV7TXQLTDQ6PXOGNZ5NBS3WLG7A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.026637691 (265h23m58.724206017s) [noise=true , address=89.149.201.147:4017 , piece_id=WV2W3UABBSPQTLLCYXM2WAKP2I5BUFE4M4XD3WECWR7EBUEOYLHQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.033231919 (265h23m58.730800256s) [noise=true , address=89.149.201.147:4006 , piece_id=TYU2VBU2E4CBT4WA7LWBTSK6WMJNOY753UFSCLPRFNQUXUMGBXUA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.040392117 (265h23m58.737960453s) [noise=true , address=81.171.14.70:4043 , piece_id=WGFJVAFZ7U52TS35UNWIMB2NY66KOXYV5DEI5PCURD2D4VFWJXIA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.040410391 (265h23m58.737978737s) [seg_pos={0 0}, upload=233340]: Segment reached optimal threshold of 26 pieces. Dec 16 16:53:11.040665407 (265h23m58.738233743s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J): protocol: expected piece hash; context canceled; EOF Dec 16 16:53:11.040681107 (265h23m58.738249453s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Long tail cancellation due to optimal threshold Dec 16 16:53:11.040938978 (265h23m58.738507314s) [noise=true , address=89.149.201.147:4019 , piece_id=QNHI7H4QBIYTA64JBQJKFPJEHK54WGHWEXOPTNME7ZFZ2FJNT7GA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2): protocol: expected piece hash; context canceled; EOF Dec 16 16:53:11.040951392 (265h23m58.738519727s) [noise=true , address=89.149.201.147:4019 , piece_id=QNHI7H4QBIYTA64JBQJKFPJEHK54WGHWEXOPTNME7ZFZ2FJNT7GA, seg_pos={0 0}, upload=233340]: Long tail cancellation due to optimal threshold Dec 16 16:53:11.041003759 (265h23m58.738572096s) [seg_pos={0 0}, upload=233340]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 16:53:11.041087015 (265h23m58.738655351s) [upload=233340]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 16:53:11.041093397 (265h23m58.738661733s) [upload=233340]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 16:54:06.282124914 (265h24m53.97969323s) [upload=233340]: Done uploading segments... Dec 16 16:54:06.282202999 (265h24m53.979771305s) [upload=233340]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.602688288s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.635871642s trace: https://jaeger.dev.storj.io/trace/5683d14cc62eee41 FAIL (2025-12-16 17:34:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== . Dec 16 16:53:09.845598423 (265h23m57.543166758s) [noise=true , address=185.167.204.205:4015 , piece_id=L7P6B35RE5NTIOA3JTG535RSBF42IHHC3SJSJY7JIQGP4KJUHIYQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.846066447 (265h23m57.543634783s) [noise=true , address=185.167.204.206:4072 , piece_id=6BIZRUDCOCOYAF33R5OBNC7JFO24KVYSWPUBWAGQ5KDFMTBE25TA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.846618208 (265h23m57.544186544s) [noise=true , address=81.171.14.70:4037 , piece_id=I574CDK3DF4VD6DNSU2EZVEZSXV7TXQLTDQ6PXOGNZ5NBS3WLG7A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.847117681 (265h23m57.544686018s) [noise=true , address=185.167.204.206:4054 , piece_id=D4AZ6L635EREAOFXQB5WOZODYHI3JDX622TDCIQFYAQVQNLY5PQA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.847646829 (265h23m57.545215176s) [noise=true , address=81.171.14.70:4036 , piece_id=2DRO2WQNKIQOLQONGLT6UPIWA3MQPWOESLFKTWLP2ALHZPGBMKDA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.849322711 (265h23m57.546891047s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.849923874 (265h23m57.54749221s) [noise=true , address=89.149.201.147:4021 , piece_id=Z3CQ3EQAXFLENOPKJP3DKAYGXNO2376ST6Z55HGJSMZYEMBU73NQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.850581442 (265h23m57.548149788s) [noise=true , address=89.149.201.147:4008 , piece_id=JKTXCHUFHQQA5HLZU4MYASODZVSGXBTXKAFIHMEB4DZVZDSWGVKA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.851295546 (265h23m57.548863882s) [noise=true , address=185.167.204.206:4066 , piece_id=YAMEYYASLEP75NXGHJ65OK7HOS67BVR5ZG2WTMKNUBXCOUOBPPOQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.851846756 (265h23m57.549415132s) [noise=true , address=185.167.204.205:4033 , piece_id=F2X3ZTK52MNL5Q6W5FEDNRLBFBWJSMQ5XUX7HVNMRTYFRUP4NF5A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:10.300410080 (265h23m57.997978386s) [upload=233340]: Next returned nil segment Dec 16 16:53:10.300419738 (265h23m57.997988054s) [upload=233340]: Waiting for error group managing segments... Dec 16 16:53:10.487707706 (265h23m58.185276032s) [noise=true , address=185.167.204.206:4066 , piece_id=YAMEYYASLEP75NXGHJ65OK7HOS67BVR5ZG2WTMKNUBXCOUOBPPOQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.488519382 (265h23m58.186087698s) [noise=true , address=185.167.204.206:4072 , piece_id=6BIZRUDCOCOYAF33R5OBNC7JFO24KVYSWPUBWAGQ5KDFMTBE25TA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.488981015 (265h23m58.18654932s) [noise=true , address=185.167.204.205:4020 , piece_id=FAU7CY7IYUPFV47CRJ55FLCBTLL4QUIFJ5NGKBNYR53PUCRIKDNQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.489259936 (265h23m58.186828272s) [noise=true , address=185.167.204.205:4027 , piece_id=7DJF2FS4NNSAM7O3JLCHSXDYXW2B2TK5HBRCVHHCEPXRQ3JFFOJA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.493026132 (265h23m58.190594468s) [noise=true , address=185.167.204.205:4033 , piece_id=F2X3ZTK52MNL5Q6W5FEDNRLBFBWJSMQ5XUX7HVNMRTYFRUP4NF5A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.497763182 (265h23m58.195331487s) [noise=true , address=185.167.204.206:4063 , piece_id=CXJZQGWPLX2GR6FT4PVMJLFRIFQQCLS4FOCPAJSS4ZV34IX4DN2A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.500875446 (265h23m58.198443762s) [noise=true , address=185.167.204.205:4015 , piece_id=L7P6B35RE5NTIOA3JTG535RSBF42IHHC3SJSJY7JIQGP4KJUHIYQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.503696186 (265h23m58.201264491s) [noise=true , address=89.149.201.147:4021 , piece_id=Z3CQ3EQAXFLENOPKJP3DKAYGXNO2376ST6Z55HGJSMZYEMBU73NQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.506666203 (265h23m58.20423454s) [noise=true , address=185.167.204.205:4016 , piece_id=I7ROD6VOVVTE5OOR462FPNK6FB5E6HCFVOAOATCYEGM7GEHI36MQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.514568155 (265h23m58.212136492s) [noise=true , address=185.167.204.205:4030 , piece_id=YKGL25SO3PZ2LBJMNJEPB4FO7PLWTD62GM4IIUKBLDYZTMBLQDCA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.516326801 (265h23m58.213895117s) [noise=true , address=185.167.204.206:4064 , piece_id=2PTLHY2JHHYERJM7FFAZVP6EBDX5D7RW7RNQPABQLSFT55HJA2QQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.524488249 (265h23m58.222056635s) [noise=true , address=185.167.204.206:4062 , piece_id=4YYT67CBPVP5QQHT7O2IK6GVLJAFNFALH76IMWILSRTA7NVNU2YQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.528223667 (265h23m58.225792004s) [noise=true , address=185.167.204.206:4054 , piece_id=D4AZ6L635EREAOFXQB5WOZODYHI3JDX622TDCIQFYAQVQNLY5PQA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.528675321 (265h23m58.226243637s) [noise=true , address=89.149.201.147:4010 , piece_id=QPL4PZCA57NVK32MVFHIPRUZ7NAMFJWGZPQK7PP6QMTRP4QCNGUA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.532773757 (265h23m58.230342073s) [noise=true , address=185.167.204.205:4002 , piece_id=PUYVE7TVOLH4ZH5SVTDEADQLFEYCB62PH3LPNBYJDJYNN7246VPA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.539818999 (265h23m58.237387315s) [noise=true , address=81.171.14.70:4048 , piece_id=R2KPQ7VPMPZHTH6PXZCDYN6HZVWJFA7RC55LMKZTQNCUQNQV2VAA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.550626359 (265h23m58.248194665s) [noise=true , address=81.171.14.70:4041 , piece_id=7N3BCTKBLRNEHWFDA4JG5EL2724JODUSMITRCNT5GNHHQ3XMXOGA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.562449477 (265h23m58.260017793s) [noise=true , address=81.171.14.70:4036 , piece_id=2DRO2WQNKIQOLQONGLT6UPIWA3MQPWOESLFKTWLP2ALHZPGBMKDA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.581197291 (265h23m58.278765627s) [noise=true , address=89.149.201.147:4012 , piece_id=C4N4DMRVA7VHN3MVUXQ7YCGC67Q7WAW6AMM7E35XJUXQUB3F26MQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.585618260 (265h23m58.283186567s) [noise=true , address=89.149.201.147:4009 , piece_id=SJOCJGUYVOXZWMHZQEGNMZXJDCZUMB2WP5FSYJ3EAUNQGODCOFQA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.592780691 (265h23m58.290349027s) [noise=true , address=185.167.204.206:4071 , piece_id=D3SV3RVHYGAU77TLBJNHBETNKILWBLOHOKCX5POSX36USLR7YT6A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.618165813 (265h23m58.315734129s) [noise=true , address=89.149.201.147:4008 , piece_id=JKTXCHUFHQQA5HLZU4MYASODZVSGXBTXKAFIHMEB4DZVZDSWGVKA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.964120185 (265h23m58.661688521s) [noise=true , address=81.171.14.70:4037 , piece_id=I574CDK3DF4VD6DNSU2EZVEZSXV7TXQLTDQ6PXOGNZ5NBS3WLG7A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.026637691 (265h23m58.724206017s) [noise=true , address=89.149.201.147:4017 , piece_id=WV2W3UABBSPQTLLCYXM2WAKP2I5BUFE4M4XD3WECWR7EBUEOYLHQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.033231919 (265h23m58.730800256s) [noise=true , address=89.149.201.147:4006 , piece_id=TYU2VBU2E4CBT4WA7LWBTSK6WMJNOY753UFSCLPRFNQUXUMGBXUA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.040392117 (265h23m58.737960453s) [noise=true , address=81.171.14.70:4043 , piece_id=WGFJVAFZ7U52TS35UNWIMB2NY66KOXYV5DEI5PCURD2D4VFWJXIA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.040410391 (265h23m58.737978737s) [seg_pos={0 0}, upload=233340]: Segment reached optimal threshold of 26 pieces. Dec 16 16:53:11.040665407 (265h23m58.738233743s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J): protocol: expected piece hash; context canceled; EOF Dec 16 16:53:11.040681107 (265h23m58.738249453s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Long tail cancellation due to optimal threshold Dec 16 16:53:11.040938978 (265h23m58.738507314s) [noise=true , address=89.149.201.147:4019 , piece_id=QNHI7H4QBIYTA64JBQJKFPJEHK54WGHWEXOPTNME7ZFZ2FJNT7GA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2): protocol: expected piece hash; context canceled; EOF Dec 16 16:53:11.040951392 (265h23m58.738519727s) [noise=true , address=89.149.201.147:4019 , piece_id=QNHI7H4QBIYTA64JBQJKFPJEHK54WGHWEXOPTNME7ZFZ2FJNT7GA, seg_pos={0 0}, upload=233340]: Long tail cancellation due to optimal threshold Dec 16 16:53:11.041003759 (265h23m58.738572096s) [seg_pos={0 0}, upload=233340]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 16:53:11.041087015 (265h23m58.738655351s) [upload=233340]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 16:53:11.041093397 (265h23m58.738661733s) [upload=233340]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 16:54:06.282124914 (265h24m53.97969323s) [upload=233340]: Done uploading segments... Dec 16 16:54:06.282202999 (265h24m53.979771305s) [upload=233340]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.635892151s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.714519016s trace: https://jaeger.dev.storj.io/trace/7608b45d5a11c8a3 FAIL (2025-12-16 17:33:55 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.714542971s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.647812633s trace: https://jaeger.dev.storj.io/trace/7608b45d5a11c8a3 FAIL (2025-12-16 17:33:39 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.647835234s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.535915533s trace: https://jaeger.dev.storj.io/trace/5683d14cc62eee41 FAIL (2025-12-16 17:32:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== . Dec 16 16:53:09.845598423 (265h23m57.543166758s) [noise=true , address=185.167.204.205:4015 , piece_id=L7P6B35RE5NTIOA3JTG535RSBF42IHHC3SJSJY7JIQGP4KJUHIYQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.846066447 (265h23m57.543634783s) [noise=true , address=185.167.204.206:4072 , piece_id=6BIZRUDCOCOYAF33R5OBNC7JFO24KVYSWPUBWAGQ5KDFMTBE25TA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.846618208 (265h23m57.544186544s) [noise=true , address=81.171.14.70:4037 , piece_id=I574CDK3DF4VD6DNSU2EZVEZSXV7TXQLTDQ6PXOGNZ5NBS3WLG7A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.847117681 (265h23m57.544686018s) [noise=true , address=185.167.204.206:4054 , piece_id=D4AZ6L635EREAOFXQB5WOZODYHI3JDX622TDCIQFYAQVQNLY5PQA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.847646829 (265h23m57.545215176s) [noise=true , address=81.171.14.70:4036 , piece_id=2DRO2WQNKIQOLQONGLT6UPIWA3MQPWOESLFKTWLP2ALHZPGBMKDA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.849322711 (265h23m57.546891047s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.849923874 (265h23m57.54749221s) [noise=true , address=89.149.201.147:4021 , piece_id=Z3CQ3EQAXFLENOPKJP3DKAYGXNO2376ST6Z55HGJSMZYEMBU73NQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.850581442 (265h23m57.548149788s) [noise=true , address=89.149.201.147:4008 , piece_id=JKTXCHUFHQQA5HLZU4MYASODZVSGXBTXKAFIHMEB4DZVZDSWGVKA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.851295546 (265h23m57.548863882s) [noise=true , address=185.167.204.206:4066 , piece_id=YAMEYYASLEP75NXGHJ65OK7HOS67BVR5ZG2WTMKNUBXCOUOBPPOQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.851846756 (265h23m57.549415132s) [noise=true , address=185.167.204.205:4033 , piece_id=F2X3ZTK52MNL5Q6W5FEDNRLBFBWJSMQ5XUX7HVNMRTYFRUP4NF5A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:10.300410080 (265h23m57.997978386s) [upload=233340]: Next returned nil segment Dec 16 16:53:10.300419738 (265h23m57.997988054s) [upload=233340]: Waiting for error group managing segments... Dec 16 16:53:10.487707706 (265h23m58.185276032s) [noise=true , address=185.167.204.206:4066 , piece_id=YAMEYYASLEP75NXGHJ65OK7HOS67BVR5ZG2WTMKNUBXCOUOBPPOQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.488519382 (265h23m58.186087698s) [noise=true , address=185.167.204.206:4072 , piece_id=6BIZRUDCOCOYAF33R5OBNC7JFO24KVYSWPUBWAGQ5KDFMTBE25TA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.488981015 (265h23m58.18654932s) [noise=true , address=185.167.204.205:4020 , piece_id=FAU7CY7IYUPFV47CRJ55FLCBTLL4QUIFJ5NGKBNYR53PUCRIKDNQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.489259936 (265h23m58.186828272s) [noise=true , address=185.167.204.205:4027 , piece_id=7DJF2FS4NNSAM7O3JLCHSXDYXW2B2TK5HBRCVHHCEPXRQ3JFFOJA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.493026132 (265h23m58.190594468s) [noise=true , address=185.167.204.205:4033 , piece_id=F2X3ZTK52MNL5Q6W5FEDNRLBFBWJSMQ5XUX7HVNMRTYFRUP4NF5A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.497763182 (265h23m58.195331487s) [noise=true , address=185.167.204.206:4063 , piece_id=CXJZQGWPLX2GR6FT4PVMJLFRIFQQCLS4FOCPAJSS4ZV34IX4DN2A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.500875446 (265h23m58.198443762s) [noise=true , address=185.167.204.205:4015 , piece_id=L7P6B35RE5NTIOA3JTG535RSBF42IHHC3SJSJY7JIQGP4KJUHIYQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.503696186 (265h23m58.201264491s) [noise=true , address=89.149.201.147:4021 , piece_id=Z3CQ3EQAXFLENOPKJP3DKAYGXNO2376ST6Z55HGJSMZYEMBU73NQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.506666203 (265h23m58.20423454s) [noise=true , address=185.167.204.205:4016 , piece_id=I7ROD6VOVVTE5OOR462FPNK6FB5E6HCFVOAOATCYEGM7GEHI36MQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.514568155 (265h23m58.212136492s) [noise=true , address=185.167.204.205:4030 , piece_id=YKGL25SO3PZ2LBJMNJEPB4FO7PLWTD62GM4IIUKBLDYZTMBLQDCA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.516326801 (265h23m58.213895117s) [noise=true , address=185.167.204.206:4064 , piece_id=2PTLHY2JHHYERJM7FFAZVP6EBDX5D7RW7RNQPABQLSFT55HJA2QQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.524488249 (265h23m58.222056635s) [noise=true , address=185.167.204.206:4062 , piece_id=4YYT67CBPVP5QQHT7O2IK6GVLJAFNFALH76IMWILSRTA7NVNU2YQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.528223667 (265h23m58.225792004s) [noise=true , address=185.167.204.206:4054 , piece_id=D4AZ6L635EREAOFXQB5WOZODYHI3JDX622TDCIQFYAQVQNLY5PQA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.528675321 (265h23m58.226243637s) [noise=true , address=89.149.201.147:4010 , piece_id=QPL4PZCA57NVK32MVFHIPRUZ7NAMFJWGZPQK7PP6QMTRP4QCNGUA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.532773757 (265h23m58.230342073s) [noise=true , address=185.167.204.205:4002 , piece_id=PUYVE7TVOLH4ZH5SVTDEADQLFEYCB62PH3LPNBYJDJYNN7246VPA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.539818999 (265h23m58.237387315s) [noise=true , address=81.171.14.70:4048 , piece_id=R2KPQ7VPMPZHTH6PXZCDYN6HZVWJFA7RC55LMKZTQNCUQNQV2VAA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.550626359 (265h23m58.248194665s) [noise=true , address=81.171.14.70:4041 , piece_id=7N3BCTKBLRNEHWFDA4JG5EL2724JODUSMITRCNT5GNHHQ3XMXOGA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.562449477 (265h23m58.260017793s) [noise=true , address=81.171.14.70:4036 , piece_id=2DRO2WQNKIQOLQONGLT6UPIWA3MQPWOESLFKTWLP2ALHZPGBMKDA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.581197291 (265h23m58.278765627s) [noise=true , address=89.149.201.147:4012 , piece_id=C4N4DMRVA7VHN3MVUXQ7YCGC67Q7WAW6AMM7E35XJUXQUB3F26MQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.585618260 (265h23m58.283186567s) [noise=true , address=89.149.201.147:4009 , piece_id=SJOCJGUYVOXZWMHZQEGNMZXJDCZUMB2WP5FSYJ3EAUNQGODCOFQA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.592780691 (265h23m58.290349027s) [noise=true , address=185.167.204.206:4071 , piece_id=D3SV3RVHYGAU77TLBJNHBETNKILWBLOHOKCX5POSX36USLR7YT6A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.618165813 (265h23m58.315734129s) [noise=true , address=89.149.201.147:4008 , piece_id=JKTXCHUFHQQA5HLZU4MYASODZVSGXBTXKAFIHMEB4DZVZDSWGVKA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.964120185 (265h23m58.661688521s) [noise=true , address=81.171.14.70:4037 , piece_id=I574CDK3DF4VD6DNSU2EZVEZSXV7TXQLTDQ6PXOGNZ5NBS3WLG7A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.026637691 (265h23m58.724206017s) [noise=true , address=89.149.201.147:4017 , piece_id=WV2W3UABBSPQTLLCYXM2WAKP2I5BUFE4M4XD3WECWR7EBUEOYLHQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.033231919 (265h23m58.730800256s) [noise=true , address=89.149.201.147:4006 , piece_id=TYU2VBU2E4CBT4WA7LWBTSK6WMJNOY753UFSCLPRFNQUXUMGBXUA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.040392117 (265h23m58.737960453s) [noise=true , address=81.171.14.70:4043 , piece_id=WGFJVAFZ7U52TS35UNWIMB2NY66KOXYV5DEI5PCURD2D4VFWJXIA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.040410391 (265h23m58.737978737s) [seg_pos={0 0}, upload=233340]: Segment reached optimal threshold of 26 pieces. Dec 16 16:53:11.040665407 (265h23m58.738233743s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J): protocol: expected piece hash; context canceled; EOF Dec 16 16:53:11.040681107 (265h23m58.738249453s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Long tail cancellation due to optimal threshold Dec 16 16:53:11.040938978 (265h23m58.738507314s) [noise=true , address=89.149.201.147:4019 , piece_id=QNHI7H4QBIYTA64JBQJKFPJEHK54WGHWEXOPTNME7ZFZ2FJNT7GA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2): protocol: expected piece hash; context canceled; EOF Dec 16 16:53:11.040951392 (265h23m58.738519727s) [noise=true , address=89.149.201.147:4019 , piece_id=QNHI7H4QBIYTA64JBQJKFPJEHK54WGHWEXOPTNME7ZFZ2FJNT7GA, seg_pos={0 0}, upload=233340]: Long tail cancellation due to optimal threshold Dec 16 16:53:11.041003759 (265h23m58.738572096s) [seg_pos={0 0}, upload=233340]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 16:53:11.041087015 (265h23m58.738655351s) [upload=233340]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 16:53:11.041093397 (265h23m58.738661733s) [upload=233340]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 16:54:06.282124914 (265h24m53.97969323s) [upload=233340]: Done uploading segments... Dec 16 16:54:06.282202999 (265h24m53.979771305s) [upload=233340]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.535931994s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.753375207s trace: https://jaeger.dev.storj.io/trace/7608b45d5a11c8a3 FAIL (2025-12-16 17:32:45 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.753395516s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.968188914s trace: https://jaeger.dev.storj.io/trace/7608b45d5a11c8a3 FAIL (2025-12-16 17:32:26 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.96821464s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.595956868s trace: https://jaeger.dev.storj.io/trace/5683d14cc62eee41 FAIL (2025-12-16 17:32:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== . Dec 16 16:53:09.845598423 (265h23m57.543166758s) [noise=true , address=185.167.204.205:4015 , piece_id=L7P6B35RE5NTIOA3JTG535RSBF42IHHC3SJSJY7JIQGP4KJUHIYQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.846066447 (265h23m57.543634783s) [noise=true , address=185.167.204.206:4072 , piece_id=6BIZRUDCOCOYAF33R5OBNC7JFO24KVYSWPUBWAGQ5KDFMTBE25TA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.846618208 (265h23m57.544186544s) [noise=true , address=81.171.14.70:4037 , piece_id=I574CDK3DF4VD6DNSU2EZVEZSXV7TXQLTDQ6PXOGNZ5NBS3WLG7A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.847117681 (265h23m57.544686018s) [noise=true , address=185.167.204.206:4054 , piece_id=D4AZ6L635EREAOFXQB5WOZODYHI3JDX622TDCIQFYAQVQNLY5PQA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.847646829 (265h23m57.545215176s) [noise=true , address=81.171.14.70:4036 , piece_id=2DRO2WQNKIQOLQONGLT6UPIWA3MQPWOESLFKTWLP2ALHZPGBMKDA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.849322711 (265h23m57.546891047s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.849923874 (265h23m57.54749221s) [noise=true , address=89.149.201.147:4021 , piece_id=Z3CQ3EQAXFLENOPKJP3DKAYGXNO2376ST6Z55HGJSMZYEMBU73NQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.850581442 (265h23m57.548149788s) [noise=true , address=89.149.201.147:4008 , piece_id=JKTXCHUFHQQA5HLZU4MYASODZVSGXBTXKAFIHMEB4DZVZDSWGVKA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.851295546 (265h23m57.548863882s) [noise=true , address=185.167.204.206:4066 , piece_id=YAMEYYASLEP75NXGHJ65OK7HOS67BVR5ZG2WTMKNUBXCOUOBPPOQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.851846756 (265h23m57.549415132s) [noise=true , address=185.167.204.205:4033 , piece_id=F2X3ZTK52MNL5Q6W5FEDNRLBFBWJSMQ5XUX7HVNMRTYFRUP4NF5A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:10.300410080 (265h23m57.997978386s) [upload=233340]: Next returned nil segment Dec 16 16:53:10.300419738 (265h23m57.997988054s) [upload=233340]: Waiting for error group managing segments... Dec 16 16:53:10.487707706 (265h23m58.185276032s) [noise=true , address=185.167.204.206:4066 , piece_id=YAMEYYASLEP75NXGHJ65OK7HOS67BVR5ZG2WTMKNUBXCOUOBPPOQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.488519382 (265h23m58.186087698s) [noise=true , address=185.167.204.206:4072 , piece_id=6BIZRUDCOCOYAF33R5OBNC7JFO24KVYSWPUBWAGQ5KDFMTBE25TA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.488981015 (265h23m58.18654932s) [noise=true , address=185.167.204.205:4020 , piece_id=FAU7CY7IYUPFV47CRJ55FLCBTLL4QUIFJ5NGKBNYR53PUCRIKDNQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.489259936 (265h23m58.186828272s) [noise=true , address=185.167.204.205:4027 , piece_id=7DJF2FS4NNSAM7O3JLCHSXDYXW2B2TK5HBRCVHHCEPXRQ3JFFOJA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.493026132 (265h23m58.190594468s) [noise=true , address=185.167.204.205:4033 , piece_id=F2X3ZTK52MNL5Q6W5FEDNRLBFBWJSMQ5XUX7HVNMRTYFRUP4NF5A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.497763182 (265h23m58.195331487s) [noise=true , address=185.167.204.206:4063 , piece_id=CXJZQGWPLX2GR6FT4PVMJLFRIFQQCLS4FOCPAJSS4ZV34IX4DN2A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.500875446 (265h23m58.198443762s) [noise=true , address=185.167.204.205:4015 , piece_id=L7P6B35RE5NTIOA3JTG535RSBF42IHHC3SJSJY7JIQGP4KJUHIYQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.503696186 (265h23m58.201264491s) [noise=true , address=89.149.201.147:4021 , piece_id=Z3CQ3EQAXFLENOPKJP3DKAYGXNO2376ST6Z55HGJSMZYEMBU73NQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.506666203 (265h23m58.20423454s) [noise=true , address=185.167.204.205:4016 , piece_id=I7ROD6VOVVTE5OOR462FPNK6FB5E6HCFVOAOATCYEGM7GEHI36MQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.514568155 (265h23m58.212136492s) [noise=true , address=185.167.204.205:4030 , piece_id=YKGL25SO3PZ2LBJMNJEPB4FO7PLWTD62GM4IIUKBLDYZTMBLQDCA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.516326801 (265h23m58.213895117s) [noise=true , address=185.167.204.206:4064 , piece_id=2PTLHY2JHHYERJM7FFAZVP6EBDX5D7RW7RNQPABQLSFT55HJA2QQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.524488249 (265h23m58.222056635s) [noise=true , address=185.167.204.206:4062 , piece_id=4YYT67CBPVP5QQHT7O2IK6GVLJAFNFALH76IMWILSRTA7NVNU2YQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.528223667 (265h23m58.225792004s) [noise=true , address=185.167.204.206:4054 , piece_id=D4AZ6L635EREAOFXQB5WOZODYHI3JDX622TDCIQFYAQVQNLY5PQA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.528675321 (265h23m58.226243637s) [noise=true , address=89.149.201.147:4010 , piece_id=QPL4PZCA57NVK32MVFHIPRUZ7NAMFJWGZPQK7PP6QMTRP4QCNGUA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.532773757 (265h23m58.230342073s) [noise=true , address=185.167.204.205:4002 , piece_id=PUYVE7TVOLH4ZH5SVTDEADQLFEYCB62PH3LPNBYJDJYNN7246VPA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.539818999 (265h23m58.237387315s) [noise=true , address=81.171.14.70:4048 , piece_id=R2KPQ7VPMPZHTH6PXZCDYN6HZVWJFA7RC55LMKZTQNCUQNQV2VAA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.550626359 (265h23m58.248194665s) [noise=true , address=81.171.14.70:4041 , piece_id=7N3BCTKBLRNEHWFDA4JG5EL2724JODUSMITRCNT5GNHHQ3XMXOGA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.562449477 (265h23m58.260017793s) [noise=true , address=81.171.14.70:4036 , piece_id=2DRO2WQNKIQOLQONGLT6UPIWA3MQPWOESLFKTWLP2ALHZPGBMKDA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.581197291 (265h23m58.278765627s) [noise=true , address=89.149.201.147:4012 , piece_id=C4N4DMRVA7VHN3MVUXQ7YCGC67Q7WAW6AMM7E35XJUXQUB3F26MQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.585618260 (265h23m58.283186567s) [noise=true , address=89.149.201.147:4009 , piece_id=SJOCJGUYVOXZWMHZQEGNMZXJDCZUMB2WP5FSYJ3EAUNQGODCOFQA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.592780691 (265h23m58.290349027s) [noise=true , address=185.167.204.206:4071 , piece_id=D3SV3RVHYGAU77TLBJNHBETNKILWBLOHOKCX5POSX36USLR7YT6A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.618165813 (265h23m58.315734129s) [noise=true , address=89.149.201.147:4008 , piece_id=JKTXCHUFHQQA5HLZU4MYASODZVSGXBTXKAFIHMEB4DZVZDSWGVKA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.964120185 (265h23m58.661688521s) [noise=true , address=81.171.14.70:4037 , piece_id=I574CDK3DF4VD6DNSU2EZVEZSXV7TXQLTDQ6PXOGNZ5NBS3WLG7A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.026637691 (265h23m58.724206017s) [noise=true , address=89.149.201.147:4017 , piece_id=WV2W3UABBSPQTLLCYXM2WAKP2I5BUFE4M4XD3WECWR7EBUEOYLHQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.033231919 (265h23m58.730800256s) [noise=true , address=89.149.201.147:4006 , piece_id=TYU2VBU2E4CBT4WA7LWBTSK6WMJNOY753UFSCLPRFNQUXUMGBXUA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.040392117 (265h23m58.737960453s) [noise=true , address=81.171.14.70:4043 , piece_id=WGFJVAFZ7U52TS35UNWIMB2NY66KOXYV5DEI5PCURD2D4VFWJXIA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.040410391 (265h23m58.737978737s) [seg_pos={0 0}, upload=233340]: Segment reached optimal threshold of 26 pieces. Dec 16 16:53:11.040665407 (265h23m58.738233743s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J): protocol: expected piece hash; context canceled; EOF Dec 16 16:53:11.040681107 (265h23m58.738249453s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Long tail cancellation due to optimal threshold Dec 16 16:53:11.040938978 (265h23m58.738507314s) [noise=true , address=89.149.201.147:4019 , piece_id=QNHI7H4QBIYTA64JBQJKFPJEHK54WGHWEXOPTNME7ZFZ2FJNT7GA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2): protocol: expected piece hash; context canceled; EOF Dec 16 16:53:11.040951392 (265h23m58.738519727s) [noise=true , address=89.149.201.147:4019 , piece_id=QNHI7H4QBIYTA64JBQJKFPJEHK54WGHWEXOPTNME7ZFZ2FJNT7GA, seg_pos={0 0}, upload=233340]: Long tail cancellation due to optimal threshold Dec 16 16:53:11.041003759 (265h23m58.738572096s) [seg_pos={0 0}, upload=233340]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 16:53:11.041087015 (265h23m58.738655351s) [upload=233340]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 16:53:11.041093397 (265h23m58.738661733s) [upload=233340]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 16:54:06.282124914 (265h24m53.97969323s) [upload=233340]: Done uploading segments... Dec 16 16:54:06.282202999 (265h24m53.979771305s) [upload=233340]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.595977867s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.75776471s trace: https://jaeger.dev.storj.io/trace/7608b45d5a11c8a3 FAIL (2025-12-16 17:32:02 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.757793574s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.577462813s trace: https://jaeger.dev.storj.io/trace/5683d14cc62eee41 FAIL (2025-12-16 17:31:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== . Dec 16 16:53:09.845598423 (265h23m57.543166758s) [noise=true , address=185.167.204.205:4015 , piece_id=L7P6B35RE5NTIOA3JTG535RSBF42IHHC3SJSJY7JIQGP4KJUHIYQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.846066447 (265h23m57.543634783s) [noise=true , address=185.167.204.206:4072 , piece_id=6BIZRUDCOCOYAF33R5OBNC7JFO24KVYSWPUBWAGQ5KDFMTBE25TA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.846618208 (265h23m57.544186544s) [noise=true , address=81.171.14.70:4037 , piece_id=I574CDK3DF4VD6DNSU2EZVEZSXV7TXQLTDQ6PXOGNZ5NBS3WLG7A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.847117681 (265h23m57.544686018s) [noise=true , address=185.167.204.206:4054 , piece_id=D4AZ6L635EREAOFXQB5WOZODYHI3JDX622TDCIQFYAQVQNLY5PQA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.847646829 (265h23m57.545215176s) [noise=true , address=81.171.14.70:4036 , piece_id=2DRO2WQNKIQOLQONGLT6UPIWA3MQPWOESLFKTWLP2ALHZPGBMKDA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.849322711 (265h23m57.546891047s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.849923874 (265h23m57.54749221s) [noise=true , address=89.149.201.147:4021 , piece_id=Z3CQ3EQAXFLENOPKJP3DKAYGXNO2376ST6Z55HGJSMZYEMBU73NQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.850581442 (265h23m57.548149788s) [noise=true , address=89.149.201.147:4008 , piece_id=JKTXCHUFHQQA5HLZU4MYASODZVSGXBTXKAFIHMEB4DZVZDSWGVKA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.851295546 (265h23m57.548863882s) [noise=true , address=185.167.204.206:4066 , piece_id=YAMEYYASLEP75NXGHJ65OK7HOS67BVR5ZG2WTMKNUBXCOUOBPPOQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.851846756 (265h23m57.549415132s) [noise=true , address=185.167.204.205:4033 , piece_id=F2X3ZTK52MNL5Q6W5FEDNRLBFBWJSMQ5XUX7HVNMRTYFRUP4NF5A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:10.300410080 (265h23m57.997978386s) [upload=233340]: Next returned nil segment Dec 16 16:53:10.300419738 (265h23m57.997988054s) [upload=233340]: Waiting for error group managing segments... Dec 16 16:53:10.487707706 (265h23m58.185276032s) [noise=true , address=185.167.204.206:4066 , piece_id=YAMEYYASLEP75NXGHJ65OK7HOS67BVR5ZG2WTMKNUBXCOUOBPPOQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.488519382 (265h23m58.186087698s) [noise=true , address=185.167.204.206:4072 , piece_id=6BIZRUDCOCOYAF33R5OBNC7JFO24KVYSWPUBWAGQ5KDFMTBE25TA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.488981015 (265h23m58.18654932s) [noise=true , address=185.167.204.205:4020 , piece_id=FAU7CY7IYUPFV47CRJ55FLCBTLL4QUIFJ5NGKBNYR53PUCRIKDNQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.489259936 (265h23m58.186828272s) [noise=true , address=185.167.204.205:4027 , piece_id=7DJF2FS4NNSAM7O3JLCHSXDYXW2B2TK5HBRCVHHCEPXRQ3JFFOJA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.493026132 (265h23m58.190594468s) [noise=true , address=185.167.204.205:4033 , piece_id=F2X3ZTK52MNL5Q6W5FEDNRLBFBWJSMQ5XUX7HVNMRTYFRUP4NF5A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.497763182 (265h23m58.195331487s) [noise=true , address=185.167.204.206:4063 , piece_id=CXJZQGWPLX2GR6FT4PVMJLFRIFQQCLS4FOCPAJSS4ZV34IX4DN2A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.500875446 (265h23m58.198443762s) [noise=true , address=185.167.204.205:4015 , piece_id=L7P6B35RE5NTIOA3JTG535RSBF42IHHC3SJSJY7JIQGP4KJUHIYQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.503696186 (265h23m58.201264491s) [noise=true , address=89.149.201.147:4021 , piece_id=Z3CQ3EQAXFLENOPKJP3DKAYGXNO2376ST6Z55HGJSMZYEMBU73NQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.506666203 (265h23m58.20423454s) [noise=true , address=185.167.204.205:4016 , piece_id=I7ROD6VOVVTE5OOR462FPNK6FB5E6HCFVOAOATCYEGM7GEHI36MQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.514568155 (265h23m58.212136492s) [noise=true , address=185.167.204.205:4030 , piece_id=YKGL25SO3PZ2LBJMNJEPB4FO7PLWTD62GM4IIUKBLDYZTMBLQDCA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.516326801 (265h23m58.213895117s) [noise=true , address=185.167.204.206:4064 , piece_id=2PTLHY2JHHYERJM7FFAZVP6EBDX5D7RW7RNQPABQLSFT55HJA2QQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.524488249 (265h23m58.222056635s) [noise=true , address=185.167.204.206:4062 , piece_id=4YYT67CBPVP5QQHT7O2IK6GVLJAFNFALH76IMWILSRTA7NVNU2YQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.528223667 (265h23m58.225792004s) [noise=true , address=185.167.204.206:4054 , piece_id=D4AZ6L635EREAOFXQB5WOZODYHI3JDX622TDCIQFYAQVQNLY5PQA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.528675321 (265h23m58.226243637s) [noise=true , address=89.149.201.147:4010 , piece_id=QPL4PZCA57NVK32MVFHIPRUZ7NAMFJWGZPQK7PP6QMTRP4QCNGUA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.532773757 (265h23m58.230342073s) [noise=true , address=185.167.204.205:4002 , piece_id=PUYVE7TVOLH4ZH5SVTDEADQLFEYCB62PH3LPNBYJDJYNN7246VPA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.539818999 (265h23m58.237387315s) [noise=true , address=81.171.14.70:4048 , piece_id=R2KPQ7VPMPZHTH6PXZCDYN6HZVWJFA7RC55LMKZTQNCUQNQV2VAA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.550626359 (265h23m58.248194665s) [noise=true , address=81.171.14.70:4041 , piece_id=7N3BCTKBLRNEHWFDA4JG5EL2724JODUSMITRCNT5GNHHQ3XMXOGA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.562449477 (265h23m58.260017793s) [noise=true , address=81.171.14.70:4036 , piece_id=2DRO2WQNKIQOLQONGLT6UPIWA3MQPWOESLFKTWLP2ALHZPGBMKDA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.581197291 (265h23m58.278765627s) [noise=true , address=89.149.201.147:4012 , piece_id=C4N4DMRVA7VHN3MVUXQ7YCGC67Q7WAW6AMM7E35XJUXQUB3F26MQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.585618260 (265h23m58.283186567s) [noise=true , address=89.149.201.147:4009 , piece_id=SJOCJGUYVOXZWMHZQEGNMZXJDCZUMB2WP5FSYJ3EAUNQGODCOFQA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.592780691 (265h23m58.290349027s) [noise=true , address=185.167.204.206:4071 , piece_id=D3SV3RVHYGAU77TLBJNHBETNKILWBLOHOKCX5POSX36USLR7YT6A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.618165813 (265h23m58.315734129s) [noise=true , address=89.149.201.147:4008 , piece_id=JKTXCHUFHQQA5HLZU4MYASODZVSGXBTXKAFIHMEB4DZVZDSWGVKA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.964120185 (265h23m58.661688521s) [noise=true , address=81.171.14.70:4037 , piece_id=I574CDK3DF4VD6DNSU2EZVEZSXV7TXQLTDQ6PXOGNZ5NBS3WLG7A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.026637691 (265h23m58.724206017s) [noise=true , address=89.149.201.147:4017 , piece_id=WV2W3UABBSPQTLLCYXM2WAKP2I5BUFE4M4XD3WECWR7EBUEOYLHQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.033231919 (265h23m58.730800256s) [noise=true , address=89.149.201.147:4006 , piece_id=TYU2VBU2E4CBT4WA7LWBTSK6WMJNOY753UFSCLPRFNQUXUMGBXUA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.040392117 (265h23m58.737960453s) [noise=true , address=81.171.14.70:4043 , piece_id=WGFJVAFZ7U52TS35UNWIMB2NY66KOXYV5DEI5PCURD2D4VFWJXIA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.040410391 (265h23m58.737978737s) [seg_pos={0 0}, upload=233340]: Segment reached optimal threshold of 26 pieces. Dec 16 16:53:11.040665407 (265h23m58.738233743s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J): protocol: expected piece hash; context canceled; EOF Dec 16 16:53:11.040681107 (265h23m58.738249453s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Long tail cancellation due to optimal threshold Dec 16 16:53:11.040938978 (265h23m58.738507314s) [noise=true , address=89.149.201.147:4019 , piece_id=QNHI7H4QBIYTA64JBQJKFPJEHK54WGHWEXOPTNME7ZFZ2FJNT7GA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2): protocol: expected piece hash; context canceled; EOF Dec 16 16:53:11.040951392 (265h23m58.738519727s) [noise=true , address=89.149.201.147:4019 , piece_id=QNHI7H4QBIYTA64JBQJKFPJEHK54WGHWEXOPTNME7ZFZ2FJNT7GA, seg_pos={0 0}, upload=233340]: Long tail cancellation due to optimal threshold Dec 16 16:53:11.041003759 (265h23m58.738572096s) [seg_pos={0 0}, upload=233340]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 16:53:11.041087015 (265h23m58.738655351s) [upload=233340]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 16:53:11.041093397 (265h23m58.738661733s) [upload=233340]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 16:54:06.282124914 (265h24m53.97969323s) [upload=233340]: Done uploading segments... Dec 16 16:54:06.282202999 (265h24m53.979771305s) [upload=233340]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.577489403s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.586415326s trace: https://jaeger.dev.storj.io/trace/7608b45d5a11c8a3 FAIL (2025-12-16 17:31:30 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.586434401s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.150403945s trace: https://jaeger.dev.storj.io/trace/5683d14cc62eee41 FAIL (2025-12-16 17:30:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== . Dec 16 16:53:09.845598423 (265h23m57.543166758s) [noise=true , address=185.167.204.205:4015 , piece_id=L7P6B35RE5NTIOA3JTG535RSBF42IHHC3SJSJY7JIQGP4KJUHIYQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.846066447 (265h23m57.543634783s) [noise=true , address=185.167.204.206:4072 , piece_id=6BIZRUDCOCOYAF33R5OBNC7JFO24KVYSWPUBWAGQ5KDFMTBE25TA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.846618208 (265h23m57.544186544s) [noise=true , address=81.171.14.70:4037 , piece_id=I574CDK3DF4VD6DNSU2EZVEZSXV7TXQLTDQ6PXOGNZ5NBS3WLG7A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.847117681 (265h23m57.544686018s) [noise=true , address=185.167.204.206:4054 , piece_id=D4AZ6L635EREAOFXQB5WOZODYHI3JDX622TDCIQFYAQVQNLY5PQA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.847646829 (265h23m57.545215176s) [noise=true , address=81.171.14.70:4036 , piece_id=2DRO2WQNKIQOLQONGLT6UPIWA3MQPWOESLFKTWLP2ALHZPGBMKDA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.849322711 (265h23m57.546891047s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.849923874 (265h23m57.54749221s) [noise=true , address=89.149.201.147:4021 , piece_id=Z3CQ3EQAXFLENOPKJP3DKAYGXNO2376ST6Z55HGJSMZYEMBU73NQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.850581442 (265h23m57.548149788s) [noise=true , address=89.149.201.147:4008 , piece_id=JKTXCHUFHQQA5HLZU4MYASODZVSGXBTXKAFIHMEB4DZVZDSWGVKA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.851295546 (265h23m57.548863882s) [noise=true , address=185.167.204.206:4066 , piece_id=YAMEYYASLEP75NXGHJ65OK7HOS67BVR5ZG2WTMKNUBXCOUOBPPOQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.851846756 (265h23m57.549415132s) [noise=true , address=185.167.204.205:4033 , piece_id=F2X3ZTK52MNL5Q6W5FEDNRLBFBWJSMQ5XUX7HVNMRTYFRUP4NF5A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:10.300410080 (265h23m57.997978386s) [upload=233340]: Next returned nil segment Dec 16 16:53:10.300419738 (265h23m57.997988054s) [upload=233340]: Waiting for error group managing segments... Dec 16 16:53:10.487707706 (265h23m58.185276032s) [noise=true , address=185.167.204.206:4066 , piece_id=YAMEYYASLEP75NXGHJ65OK7HOS67BVR5ZG2WTMKNUBXCOUOBPPOQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.488519382 (265h23m58.186087698s) [noise=true , address=185.167.204.206:4072 , piece_id=6BIZRUDCOCOYAF33R5OBNC7JFO24KVYSWPUBWAGQ5KDFMTBE25TA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.488981015 (265h23m58.18654932s) [noise=true , address=185.167.204.205:4020 , piece_id=FAU7CY7IYUPFV47CRJ55FLCBTLL4QUIFJ5NGKBNYR53PUCRIKDNQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.489259936 (265h23m58.186828272s) [noise=true , address=185.167.204.205:4027 , piece_id=7DJF2FS4NNSAM7O3JLCHSXDYXW2B2TK5HBRCVHHCEPXRQ3JFFOJA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.493026132 (265h23m58.190594468s) [noise=true , address=185.167.204.205:4033 , piece_id=F2X3ZTK52MNL5Q6W5FEDNRLBFBWJSMQ5XUX7HVNMRTYFRUP4NF5A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.497763182 (265h23m58.195331487s) [noise=true , address=185.167.204.206:4063 , piece_id=CXJZQGWPLX2GR6FT4PVMJLFRIFQQCLS4FOCPAJSS4ZV34IX4DN2A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.500875446 (265h23m58.198443762s) [noise=true , address=185.167.204.205:4015 , piece_id=L7P6B35RE5NTIOA3JTG535RSBF42IHHC3SJSJY7JIQGP4KJUHIYQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.503696186 (265h23m58.201264491s) [noise=true , address=89.149.201.147:4021 , piece_id=Z3CQ3EQAXFLENOPKJP3DKAYGXNO2376ST6Z55HGJSMZYEMBU73NQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.506666203 (265h23m58.20423454s) [noise=true , address=185.167.204.205:4016 , piece_id=I7ROD6VOVVTE5OOR462FPNK6FB5E6HCFVOAOATCYEGM7GEHI36MQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.514568155 (265h23m58.212136492s) [noise=true , address=185.167.204.205:4030 , piece_id=YKGL25SO3PZ2LBJMNJEPB4FO7PLWTD62GM4IIUKBLDYZTMBLQDCA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.516326801 (265h23m58.213895117s) [noise=true , address=185.167.204.206:4064 , piece_id=2PTLHY2JHHYERJM7FFAZVP6EBDX5D7RW7RNQPABQLSFT55HJA2QQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.524488249 (265h23m58.222056635s) [noise=true , address=185.167.204.206:4062 , piece_id=4YYT67CBPVP5QQHT7O2IK6GVLJAFNFALH76IMWILSRTA7NVNU2YQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.528223667 (265h23m58.225792004s) [noise=true , address=185.167.204.206:4054 , piece_id=D4AZ6L635EREAOFXQB5WOZODYHI3JDX622TDCIQFYAQVQNLY5PQA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.528675321 (265h23m58.226243637s) [noise=true , address=89.149.201.147:4010 , piece_id=QPL4PZCA57NVK32MVFHIPRUZ7NAMFJWGZPQK7PP6QMTRP4QCNGUA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.532773757 (265h23m58.230342073s) [noise=true , address=185.167.204.205:4002 , piece_id=PUYVE7TVOLH4ZH5SVTDEADQLFEYCB62PH3LPNBYJDJYNN7246VPA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.539818999 (265h23m58.237387315s) [noise=true , address=81.171.14.70:4048 , piece_id=R2KPQ7VPMPZHTH6PXZCDYN6HZVWJFA7RC55LMKZTQNCUQNQV2VAA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.550626359 (265h23m58.248194665s) [noise=true , address=81.171.14.70:4041 , piece_id=7N3BCTKBLRNEHWFDA4JG5EL2724JODUSMITRCNT5GNHHQ3XMXOGA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.562449477 (265h23m58.260017793s) [noise=true , address=81.171.14.70:4036 , piece_id=2DRO2WQNKIQOLQONGLT6UPIWA3MQPWOESLFKTWLP2ALHZPGBMKDA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.581197291 (265h23m58.278765627s) [noise=true , address=89.149.201.147:4012 , piece_id=C4N4DMRVA7VHN3MVUXQ7YCGC67Q7WAW6AMM7E35XJUXQUB3F26MQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.585618260 (265h23m58.283186567s) [noise=true , address=89.149.201.147:4009 , piece_id=SJOCJGUYVOXZWMHZQEGNMZXJDCZUMB2WP5FSYJ3EAUNQGODCOFQA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.592780691 (265h23m58.290349027s) [noise=true , address=185.167.204.206:4071 , piece_id=D3SV3RVHYGAU77TLBJNHBETNKILWBLOHOKCX5POSX36USLR7YT6A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.618165813 (265h23m58.315734129s) [noise=true , address=89.149.201.147:4008 , piece_id=JKTXCHUFHQQA5HLZU4MYASODZVSGXBTXKAFIHMEB4DZVZDSWGVKA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.964120185 (265h23m58.661688521s) [noise=true , address=81.171.14.70:4037 , piece_id=I574CDK3DF4VD6DNSU2EZVEZSXV7TXQLTDQ6PXOGNZ5NBS3WLG7A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.026637691 (265h23m58.724206017s) [noise=true , address=89.149.201.147:4017 , piece_id=WV2W3UABBSPQTLLCYXM2WAKP2I5BUFE4M4XD3WECWR7EBUEOYLHQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.033231919 (265h23m58.730800256s) [noise=true , address=89.149.201.147:4006 , piece_id=TYU2VBU2E4CBT4WA7LWBTSK6WMJNOY753UFSCLPRFNQUXUMGBXUA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.040392117 (265h23m58.737960453s) [noise=true , address=81.171.14.70:4043 , piece_id=WGFJVAFZ7U52TS35UNWIMB2NY66KOXYV5DEI5PCURD2D4VFWJXIA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.040410391 (265h23m58.737978737s) [seg_pos={0 0}, upload=233340]: Segment reached optimal threshold of 26 pieces. Dec 16 16:53:11.040665407 (265h23m58.738233743s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J): protocol: expected piece hash; context canceled; EOF Dec 16 16:53:11.040681107 (265h23m58.738249453s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Long tail cancellation due to optimal threshold Dec 16 16:53:11.040938978 (265h23m58.738507314s) [noise=true , address=89.149.201.147:4019 , piece_id=QNHI7H4QBIYTA64JBQJKFPJEHK54WGHWEXOPTNME7ZFZ2FJNT7GA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2): protocol: expected piece hash; context canceled; EOF Dec 16 16:53:11.040951392 (265h23m58.738519727s) [noise=true , address=89.149.201.147:4019 , piece_id=QNHI7H4QBIYTA64JBQJKFPJEHK54WGHWEXOPTNME7ZFZ2FJNT7GA, seg_pos={0 0}, upload=233340]: Long tail cancellation due to optimal threshold Dec 16 16:53:11.041003759 (265h23m58.738572096s) [seg_pos={0 0}, upload=233340]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 16:53:11.041087015 (265h23m58.738655351s) [upload=233340]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 16:53:11.041093397 (265h23m58.738661733s) [upload=233340]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 16:54:06.282124914 (265h24m53.97969323s) [upload=233340]: Done uploading segments... Dec 16 16:54:06.282202999 (265h24m53.979771305s) [upload=233340]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.15042781s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.878203883s trace: https://jaeger.dev.storj.io/trace/7608b45d5a11c8a3 FAIL (2025-12-16 17:30:32 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.878230251s core uplink eu1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 330.356034ms trace: https://jaeger.dev.storj.io/trace/1054383a00e42cf4 FAIL (2025-12-16 17:30:03 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 330.3755ms edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.198896318s trace: https://jaeger.dev.storj.io/trace/5683d14cc62eee41 FAIL (2025-12-16 17:29:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== . Dec 16 16:53:09.845598423 (265h23m57.543166758s) [noise=true , address=185.167.204.205:4015 , piece_id=L7P6B35RE5NTIOA3JTG535RSBF42IHHC3SJSJY7JIQGP4KJUHIYQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.846066447 (265h23m57.543634783s) [noise=true , address=185.167.204.206:4072 , piece_id=6BIZRUDCOCOYAF33R5OBNC7JFO24KVYSWPUBWAGQ5KDFMTBE25TA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.846618208 (265h23m57.544186544s) [noise=true , address=81.171.14.70:4037 , piece_id=I574CDK3DF4VD6DNSU2EZVEZSXV7TXQLTDQ6PXOGNZ5NBS3WLG7A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.847117681 (265h23m57.544686018s) [noise=true , address=185.167.204.206:4054 , piece_id=D4AZ6L635EREAOFXQB5WOZODYHI3JDX622TDCIQFYAQVQNLY5PQA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.847646829 (265h23m57.545215176s) [noise=true , address=81.171.14.70:4036 , piece_id=2DRO2WQNKIQOLQONGLT6UPIWA3MQPWOESLFKTWLP2ALHZPGBMKDA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.849322711 (265h23m57.546891047s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.849923874 (265h23m57.54749221s) [noise=true , address=89.149.201.147:4021 , piece_id=Z3CQ3EQAXFLENOPKJP3DKAYGXNO2376ST6Z55HGJSMZYEMBU73NQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.850581442 (265h23m57.548149788s) [noise=true , address=89.149.201.147:4008 , piece_id=JKTXCHUFHQQA5HLZU4MYASODZVSGXBTXKAFIHMEB4DZVZDSWGVKA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.851295546 (265h23m57.548863882s) [noise=true , address=185.167.204.206:4066 , piece_id=YAMEYYASLEP75NXGHJ65OK7HOS67BVR5ZG2WTMKNUBXCOUOBPPOQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.851846756 (265h23m57.549415132s) [noise=true , address=185.167.204.205:4033 , piece_id=F2X3ZTK52MNL5Q6W5FEDNRLBFBWJSMQ5XUX7HVNMRTYFRUP4NF5A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:10.300410080 (265h23m57.997978386s) [upload=233340]: Next returned nil segment Dec 16 16:53:10.300419738 (265h23m57.997988054s) [upload=233340]: Waiting for error group managing segments... Dec 16 16:53:10.487707706 (265h23m58.185276032s) [noise=true , address=185.167.204.206:4066 , piece_id=YAMEYYASLEP75NXGHJ65OK7HOS67BVR5ZG2WTMKNUBXCOUOBPPOQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.488519382 (265h23m58.186087698s) [noise=true , address=185.167.204.206:4072 , piece_id=6BIZRUDCOCOYAF33R5OBNC7JFO24KVYSWPUBWAGQ5KDFMTBE25TA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.488981015 (265h23m58.18654932s) [noise=true , address=185.167.204.205:4020 , piece_id=FAU7CY7IYUPFV47CRJ55FLCBTLL4QUIFJ5NGKBNYR53PUCRIKDNQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.489259936 (265h23m58.186828272s) [noise=true , address=185.167.204.205:4027 , piece_id=7DJF2FS4NNSAM7O3JLCHSXDYXW2B2TK5HBRCVHHCEPXRQ3JFFOJA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.493026132 (265h23m58.190594468s) [noise=true , address=185.167.204.205:4033 , piece_id=F2X3ZTK52MNL5Q6W5FEDNRLBFBWJSMQ5XUX7HVNMRTYFRUP4NF5A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.497763182 (265h23m58.195331487s) [noise=true , address=185.167.204.206:4063 , piece_id=CXJZQGWPLX2GR6FT4PVMJLFRIFQQCLS4FOCPAJSS4ZV34IX4DN2A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.500875446 (265h23m58.198443762s) [noise=true , address=185.167.204.205:4015 , piece_id=L7P6B35RE5NTIOA3JTG535RSBF42IHHC3SJSJY7JIQGP4KJUHIYQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.503696186 (265h23m58.201264491s) [noise=true , address=89.149.201.147:4021 , piece_id=Z3CQ3EQAXFLENOPKJP3DKAYGXNO2376ST6Z55HGJSMZYEMBU73NQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.506666203 (265h23m58.20423454s) [noise=true , address=185.167.204.205:4016 , piece_id=I7ROD6VOVVTE5OOR462FPNK6FB5E6HCFVOAOATCYEGM7GEHI36MQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.514568155 (265h23m58.212136492s) [noise=true , address=185.167.204.205:4030 , piece_id=YKGL25SO3PZ2LBJMNJEPB4FO7PLWTD62GM4IIUKBLDYZTMBLQDCA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.516326801 (265h23m58.213895117s) [noise=true , address=185.167.204.206:4064 , piece_id=2PTLHY2JHHYERJM7FFAZVP6EBDX5D7RW7RNQPABQLSFT55HJA2QQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.524488249 (265h23m58.222056635s) [noise=true , address=185.167.204.206:4062 , piece_id=4YYT67CBPVP5QQHT7O2IK6GVLJAFNFALH76IMWILSRTA7NVNU2YQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.528223667 (265h23m58.225792004s) [noise=true , address=185.167.204.206:4054 , piece_id=D4AZ6L635EREAOFXQB5WOZODYHI3JDX622TDCIQFYAQVQNLY5PQA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.528675321 (265h23m58.226243637s) [noise=true , address=89.149.201.147:4010 , piece_id=QPL4PZCA57NVK32MVFHIPRUZ7NAMFJWGZPQK7PP6QMTRP4QCNGUA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.532773757 (265h23m58.230342073s) [noise=true , address=185.167.204.205:4002 , piece_id=PUYVE7TVOLH4ZH5SVTDEADQLFEYCB62PH3LPNBYJDJYNN7246VPA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.539818999 (265h23m58.237387315s) [noise=true , address=81.171.14.70:4048 , piece_id=R2KPQ7VPMPZHTH6PXZCDYN6HZVWJFA7RC55LMKZTQNCUQNQV2VAA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.550626359 (265h23m58.248194665s) [noise=true , address=81.171.14.70:4041 , piece_id=7N3BCTKBLRNEHWFDA4JG5EL2724JODUSMITRCNT5GNHHQ3XMXOGA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.562449477 (265h23m58.260017793s) [noise=true , address=81.171.14.70:4036 , piece_id=2DRO2WQNKIQOLQONGLT6UPIWA3MQPWOESLFKTWLP2ALHZPGBMKDA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.581197291 (265h23m58.278765627s) [noise=true , address=89.149.201.147:4012 , piece_id=C4N4DMRVA7VHN3MVUXQ7YCGC67Q7WAW6AMM7E35XJUXQUB3F26MQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.585618260 (265h23m58.283186567s) [noise=true , address=89.149.201.147:4009 , piece_id=SJOCJGUYVOXZWMHZQEGNMZXJDCZUMB2WP5FSYJ3EAUNQGODCOFQA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.592780691 (265h23m58.290349027s) [noise=true , address=185.167.204.206:4071 , piece_id=D3SV3RVHYGAU77TLBJNHBETNKILWBLOHOKCX5POSX36USLR7YT6A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.618165813 (265h23m58.315734129s) [noise=true , address=89.149.201.147:4008 , piece_id=JKTXCHUFHQQA5HLZU4MYASODZVSGXBTXKAFIHMEB4DZVZDSWGVKA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.964120185 (265h23m58.661688521s) [noise=true , address=81.171.14.70:4037 , piece_id=I574CDK3DF4VD6DNSU2EZVEZSXV7TXQLTDQ6PXOGNZ5NBS3WLG7A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.026637691 (265h23m58.724206017s) [noise=true , address=89.149.201.147:4017 , piece_id=WV2W3UABBSPQTLLCYXM2WAKP2I5BUFE4M4XD3WECWR7EBUEOYLHQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.033231919 (265h23m58.730800256s) [noise=true , address=89.149.201.147:4006 , piece_id=TYU2VBU2E4CBT4WA7LWBTSK6WMJNOY753UFSCLPRFNQUXUMGBXUA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.040392117 (265h23m58.737960453s) [noise=true , address=81.171.14.70:4043 , piece_id=WGFJVAFZ7U52TS35UNWIMB2NY66KOXYV5DEI5PCURD2D4VFWJXIA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.040410391 (265h23m58.737978737s) [seg_pos={0 0}, upload=233340]: Segment reached optimal threshold of 26 pieces. Dec 16 16:53:11.040665407 (265h23m58.738233743s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J): protocol: expected piece hash; context canceled; EOF Dec 16 16:53:11.040681107 (265h23m58.738249453s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Long tail cancellation due to optimal threshold Dec 16 16:53:11.040938978 (265h23m58.738507314s) [noise=true , address=89.149.201.147:4019 , piece_id=QNHI7H4QBIYTA64JBQJKFPJEHK54WGHWEXOPTNME7ZFZ2FJNT7GA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2): protocol: expected piece hash; context canceled; EOF Dec 16 16:53:11.040951392 (265h23m58.738519727s) [noise=true , address=89.149.201.147:4019 , piece_id=QNHI7H4QBIYTA64JBQJKFPJEHK54WGHWEXOPTNME7ZFZ2FJNT7GA, seg_pos={0 0}, upload=233340]: Long tail cancellation due to optimal threshold Dec 16 16:53:11.041003759 (265h23m58.738572096s) [seg_pos={0 0}, upload=233340]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 16:53:11.041087015 (265h23m58.738655351s) [upload=233340]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 16:53:11.041093397 (265h23m58.738661733s) [upload=233340]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 16:54:06.282124914 (265h24m53.97969323s) [upload=233340]: Done uploading segments... Dec 16 16:54:06.282202999 (265h24m53.979771305s) [upload=233340]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.198909194s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.560927362s trace: https://jaeger.dev.storj.io/trace/7608b45d5a11c8a3 FAIL (2025-12-16 17:29:46 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.56094836s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.562355907s trace: https://jaeger.dev.storj.io/trace/5683d14cc62eee41 FAIL (2025-12-16 17:29:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== . Dec 16 16:53:09.845598423 (265h23m57.543166758s) [noise=true , address=185.167.204.205:4015 , piece_id=L7P6B35RE5NTIOA3JTG535RSBF42IHHC3SJSJY7JIQGP4KJUHIYQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.846066447 (265h23m57.543634783s) [noise=true , address=185.167.204.206:4072 , piece_id=6BIZRUDCOCOYAF33R5OBNC7JFO24KVYSWPUBWAGQ5KDFMTBE25TA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.846618208 (265h23m57.544186544s) [noise=true , address=81.171.14.70:4037 , piece_id=I574CDK3DF4VD6DNSU2EZVEZSXV7TXQLTDQ6PXOGNZ5NBS3WLG7A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.847117681 (265h23m57.544686018s) [noise=true , address=185.167.204.206:4054 , piece_id=D4AZ6L635EREAOFXQB5WOZODYHI3JDX622TDCIQFYAQVQNLY5PQA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.847646829 (265h23m57.545215176s) [noise=true , address=81.171.14.70:4036 , piece_id=2DRO2WQNKIQOLQONGLT6UPIWA3MQPWOESLFKTWLP2ALHZPGBMKDA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.849322711 (265h23m57.546891047s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.849923874 (265h23m57.54749221s) [noise=true , address=89.149.201.147:4021 , piece_id=Z3CQ3EQAXFLENOPKJP3DKAYGXNO2376ST6Z55HGJSMZYEMBU73NQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.850581442 (265h23m57.548149788s) [noise=true , address=89.149.201.147:4008 , piece_id=JKTXCHUFHQQA5HLZU4MYASODZVSGXBTXKAFIHMEB4DZVZDSWGVKA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.851295546 (265h23m57.548863882s) [noise=true , address=185.167.204.206:4066 , piece_id=YAMEYYASLEP75NXGHJ65OK7HOS67BVR5ZG2WTMKNUBXCOUOBPPOQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.851846756 (265h23m57.549415132s) [noise=true , address=185.167.204.205:4033 , piece_id=F2X3ZTK52MNL5Q6W5FEDNRLBFBWJSMQ5XUX7HVNMRTYFRUP4NF5A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:10.300410080 (265h23m57.997978386s) [upload=233340]: Next returned nil segment Dec 16 16:53:10.300419738 (265h23m57.997988054s) [upload=233340]: Waiting for error group managing segments... Dec 16 16:53:10.487707706 (265h23m58.185276032s) [noise=true , address=185.167.204.206:4066 , piece_id=YAMEYYASLEP75NXGHJ65OK7HOS67BVR5ZG2WTMKNUBXCOUOBPPOQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.488519382 (265h23m58.186087698s) [noise=true , address=185.167.204.206:4072 , piece_id=6BIZRUDCOCOYAF33R5OBNC7JFO24KVYSWPUBWAGQ5KDFMTBE25TA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.488981015 (265h23m58.18654932s) [noise=true , address=185.167.204.205:4020 , piece_id=FAU7CY7IYUPFV47CRJ55FLCBTLL4QUIFJ5NGKBNYR53PUCRIKDNQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.489259936 (265h23m58.186828272s) [noise=true , address=185.167.204.205:4027 , piece_id=7DJF2FS4NNSAM7O3JLCHSXDYXW2B2TK5HBRCVHHCEPXRQ3JFFOJA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.493026132 (265h23m58.190594468s) [noise=true , address=185.167.204.205:4033 , piece_id=F2X3ZTK52MNL5Q6W5FEDNRLBFBWJSMQ5XUX7HVNMRTYFRUP4NF5A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.497763182 (265h23m58.195331487s) [noise=true , address=185.167.204.206:4063 , piece_id=CXJZQGWPLX2GR6FT4PVMJLFRIFQQCLS4FOCPAJSS4ZV34IX4DN2A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.500875446 (265h23m58.198443762s) [noise=true , address=185.167.204.205:4015 , piece_id=L7P6B35RE5NTIOA3JTG535RSBF42IHHC3SJSJY7JIQGP4KJUHIYQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.503696186 (265h23m58.201264491s) [noise=true , address=89.149.201.147:4021 , piece_id=Z3CQ3EQAXFLENOPKJP3DKAYGXNO2376ST6Z55HGJSMZYEMBU73NQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.506666203 (265h23m58.20423454s) [noise=true , address=185.167.204.205:4016 , piece_id=I7ROD6VOVVTE5OOR462FPNK6FB5E6HCFVOAOATCYEGM7GEHI36MQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.514568155 (265h23m58.212136492s) [noise=true , address=185.167.204.205:4030 , piece_id=YKGL25SO3PZ2LBJMNJEPB4FO7PLWTD62GM4IIUKBLDYZTMBLQDCA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.516326801 (265h23m58.213895117s) [noise=true , address=185.167.204.206:4064 , piece_id=2PTLHY2JHHYERJM7FFAZVP6EBDX5D7RW7RNQPABQLSFT55HJA2QQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.524488249 (265h23m58.222056635s) [noise=true , address=185.167.204.206:4062 , piece_id=4YYT67CBPVP5QQHT7O2IK6GVLJAFNFALH76IMWILSRTA7NVNU2YQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.528223667 (265h23m58.225792004s) [noise=true , address=185.167.204.206:4054 , piece_id=D4AZ6L635EREAOFXQB5WOZODYHI3JDX622TDCIQFYAQVQNLY5PQA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.528675321 (265h23m58.226243637s) [noise=true , address=89.149.201.147:4010 , piece_id=QPL4PZCA57NVK32MVFHIPRUZ7NAMFJWGZPQK7PP6QMTRP4QCNGUA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.532773757 (265h23m58.230342073s) [noise=true , address=185.167.204.205:4002 , piece_id=PUYVE7TVOLH4ZH5SVTDEADQLFEYCB62PH3LPNBYJDJYNN7246VPA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.539818999 (265h23m58.237387315s) [noise=true , address=81.171.14.70:4048 , piece_id=R2KPQ7VPMPZHTH6PXZCDYN6HZVWJFA7RC55LMKZTQNCUQNQV2VAA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.550626359 (265h23m58.248194665s) [noise=true , address=81.171.14.70:4041 , piece_id=7N3BCTKBLRNEHWFDA4JG5EL2724JODUSMITRCNT5GNHHQ3XMXOGA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.562449477 (265h23m58.260017793s) [noise=true , address=81.171.14.70:4036 , piece_id=2DRO2WQNKIQOLQONGLT6UPIWA3MQPWOESLFKTWLP2ALHZPGBMKDA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.581197291 (265h23m58.278765627s) [noise=true , address=89.149.201.147:4012 , piece_id=C4N4DMRVA7VHN3MVUXQ7YCGC67Q7WAW6AMM7E35XJUXQUB3F26MQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.585618260 (265h23m58.283186567s) [noise=true , address=89.149.201.147:4009 , piece_id=SJOCJGUYVOXZWMHZQEGNMZXJDCZUMB2WP5FSYJ3EAUNQGODCOFQA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.592780691 (265h23m58.290349027s) [noise=true , address=185.167.204.206:4071 , piece_id=D3SV3RVHYGAU77TLBJNHBETNKILWBLOHOKCX5POSX36USLR7YT6A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.618165813 (265h23m58.315734129s) [noise=true , address=89.149.201.147:4008 , piece_id=JKTXCHUFHQQA5HLZU4MYASODZVSGXBTXKAFIHMEB4DZVZDSWGVKA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.964120185 (265h23m58.661688521s) [noise=true , address=81.171.14.70:4037 , piece_id=I574CDK3DF4VD6DNSU2EZVEZSXV7TXQLTDQ6PXOGNZ5NBS3WLG7A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.026637691 (265h23m58.724206017s) [noise=true , address=89.149.201.147:4017 , piece_id=WV2W3UABBSPQTLLCYXM2WAKP2I5BUFE4M4XD3WECWR7EBUEOYLHQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.033231919 (265h23m58.730800256s) [noise=true , address=89.149.201.147:4006 , piece_id=TYU2VBU2E4CBT4WA7LWBTSK6WMJNOY753UFSCLPRFNQUXUMGBXUA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.040392117 (265h23m58.737960453s) [noise=true , address=81.171.14.70:4043 , piece_id=WGFJVAFZ7U52TS35UNWIMB2NY66KOXYV5DEI5PCURD2D4VFWJXIA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.040410391 (265h23m58.737978737s) [seg_pos={0 0}, upload=233340]: Segment reached optimal threshold of 26 pieces. Dec 16 16:53:11.040665407 (265h23m58.738233743s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J): protocol: expected piece hash; context canceled; EOF Dec 16 16:53:11.040681107 (265h23m58.738249453s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Long tail cancellation due to optimal threshold Dec 16 16:53:11.040938978 (265h23m58.738507314s) [noise=true , address=89.149.201.147:4019 , piece_id=QNHI7H4QBIYTA64JBQJKFPJEHK54WGHWEXOPTNME7ZFZ2FJNT7GA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2): protocol: expected piece hash; context canceled; EOF Dec 16 16:53:11.040951392 (265h23m58.738519727s) [noise=true , address=89.149.201.147:4019 , piece_id=QNHI7H4QBIYTA64JBQJKFPJEHK54WGHWEXOPTNME7ZFZ2FJNT7GA, seg_pos={0 0}, upload=233340]: Long tail cancellation due to optimal threshold Dec 16 16:53:11.041003759 (265h23m58.738572096s) [seg_pos={0 0}, upload=233340]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 16:53:11.041087015 (265h23m58.738655351s) [upload=233340]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 16:53:11.041093397 (265h23m58.738661733s) [upload=233340]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 16:54:06.282124914 (265h24m53.97969323s) [upload=233340]: Done uploading segments... Dec 16 16:54:06.282202999 (265h24m53.979771305s) [upload=233340]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.562376946s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.835126346s trace: https://jaeger.dev.storj.io/trace/7608b45d5a11c8a3 FAIL (2025-12-16 17:29:26 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.835147856s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.211635778s trace: https://jaeger.dev.storj.io/trace/5683d14cc62eee41 FAIL (2025-12-16 17:29:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== . Dec 16 16:53:09.845598423 (265h23m57.543166758s) [noise=true , address=185.167.204.205:4015 , piece_id=L7P6B35RE5NTIOA3JTG535RSBF42IHHC3SJSJY7JIQGP4KJUHIYQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.846066447 (265h23m57.543634783s) [noise=true , address=185.167.204.206:4072 , piece_id=6BIZRUDCOCOYAF33R5OBNC7JFO24KVYSWPUBWAGQ5KDFMTBE25TA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.846618208 (265h23m57.544186544s) [noise=true , address=81.171.14.70:4037 , piece_id=I574CDK3DF4VD6DNSU2EZVEZSXV7TXQLTDQ6PXOGNZ5NBS3WLG7A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.847117681 (265h23m57.544686018s) [noise=true , address=185.167.204.206:4054 , piece_id=D4AZ6L635EREAOFXQB5WOZODYHI3JDX622TDCIQFYAQVQNLY5PQA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.847646829 (265h23m57.545215176s) [noise=true , address=81.171.14.70:4036 , piece_id=2DRO2WQNKIQOLQONGLT6UPIWA3MQPWOESLFKTWLP2ALHZPGBMKDA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.849322711 (265h23m57.546891047s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.849923874 (265h23m57.54749221s) [noise=true , address=89.149.201.147:4021 , piece_id=Z3CQ3EQAXFLENOPKJP3DKAYGXNO2376ST6Z55HGJSMZYEMBU73NQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.850581442 (265h23m57.548149788s) [noise=true , address=89.149.201.147:4008 , piece_id=JKTXCHUFHQQA5HLZU4MYASODZVSGXBTXKAFIHMEB4DZVZDSWGVKA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.851295546 (265h23m57.548863882s) [noise=true , address=185.167.204.206:4066 , piece_id=YAMEYYASLEP75NXGHJ65OK7HOS67BVR5ZG2WTMKNUBXCOUOBPPOQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.851846756 (265h23m57.549415132s) [noise=true , address=185.167.204.205:4033 , piece_id=F2X3ZTK52MNL5Q6W5FEDNRLBFBWJSMQ5XUX7HVNMRTYFRUP4NF5A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:10.300410080 (265h23m57.997978386s) [upload=233340]: Next returned nil segment Dec 16 16:53:10.300419738 (265h23m57.997988054s) [upload=233340]: Waiting for error group managing segments... Dec 16 16:53:10.487707706 (265h23m58.185276032s) [noise=true , address=185.167.204.206:4066 , piece_id=YAMEYYASLEP75NXGHJ65OK7HOS67BVR5ZG2WTMKNUBXCOUOBPPOQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.488519382 (265h23m58.186087698s) [noise=true , address=185.167.204.206:4072 , piece_id=6BIZRUDCOCOYAF33R5OBNC7JFO24KVYSWPUBWAGQ5KDFMTBE25TA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.488981015 (265h23m58.18654932s) [noise=true , address=185.167.204.205:4020 , piece_id=FAU7CY7IYUPFV47CRJ55FLCBTLL4QUIFJ5NGKBNYR53PUCRIKDNQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.489259936 (265h23m58.186828272s) [noise=true , address=185.167.204.205:4027 , piece_id=7DJF2FS4NNSAM7O3JLCHSXDYXW2B2TK5HBRCVHHCEPXRQ3JFFOJA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.493026132 (265h23m58.190594468s) [noise=true , address=185.167.204.205:4033 , piece_id=F2X3ZTK52MNL5Q6W5FEDNRLBFBWJSMQ5XUX7HVNMRTYFRUP4NF5A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.497763182 (265h23m58.195331487s) [noise=true , address=185.167.204.206:4063 , piece_id=CXJZQGWPLX2GR6FT4PVMJLFRIFQQCLS4FOCPAJSS4ZV34IX4DN2A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.500875446 (265h23m58.198443762s) [noise=true , address=185.167.204.205:4015 , piece_id=L7P6B35RE5NTIOA3JTG535RSBF42IHHC3SJSJY7JIQGP4KJUHIYQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.503696186 (265h23m58.201264491s) [noise=true , address=89.149.201.147:4021 , piece_id=Z3CQ3EQAXFLENOPKJP3DKAYGXNO2376ST6Z55HGJSMZYEMBU73NQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.506666203 (265h23m58.20423454s) [noise=true , address=185.167.204.205:4016 , piece_id=I7ROD6VOVVTE5OOR462FPNK6FB5E6HCFVOAOATCYEGM7GEHI36MQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.514568155 (265h23m58.212136492s) [noise=true , address=185.167.204.205:4030 , piece_id=YKGL25SO3PZ2LBJMNJEPB4FO7PLWTD62GM4IIUKBLDYZTMBLQDCA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.516326801 (265h23m58.213895117s) [noise=true , address=185.167.204.206:4064 , piece_id=2PTLHY2JHHYERJM7FFAZVP6EBDX5D7RW7RNQPABQLSFT55HJA2QQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.524488249 (265h23m58.222056635s) [noise=true , address=185.167.204.206:4062 , piece_id=4YYT67CBPVP5QQHT7O2IK6GVLJAFNFALH76IMWILSRTA7NVNU2YQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.528223667 (265h23m58.225792004s) [noise=true , address=185.167.204.206:4054 , piece_id=D4AZ6L635EREAOFXQB5WOZODYHI3JDX622TDCIQFYAQVQNLY5PQA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.528675321 (265h23m58.226243637s) [noise=true , address=89.149.201.147:4010 , piece_id=QPL4PZCA57NVK32MVFHIPRUZ7NAMFJWGZPQK7PP6QMTRP4QCNGUA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.532773757 (265h23m58.230342073s) [noise=true , address=185.167.204.205:4002 , piece_id=PUYVE7TVOLH4ZH5SVTDEADQLFEYCB62PH3LPNBYJDJYNN7246VPA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.539818999 (265h23m58.237387315s) [noise=true , address=81.171.14.70:4048 , piece_id=R2KPQ7VPMPZHTH6PXZCDYN6HZVWJFA7RC55LMKZTQNCUQNQV2VAA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.550626359 (265h23m58.248194665s) [noise=true , address=81.171.14.70:4041 , piece_id=7N3BCTKBLRNEHWFDA4JG5EL2724JODUSMITRCNT5GNHHQ3XMXOGA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.562449477 (265h23m58.260017793s) [noise=true , address=81.171.14.70:4036 , piece_id=2DRO2WQNKIQOLQONGLT6UPIWA3MQPWOESLFKTWLP2ALHZPGBMKDA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.581197291 (265h23m58.278765627s) [noise=true , address=89.149.201.147:4012 , piece_id=C4N4DMRVA7VHN3MVUXQ7YCGC67Q7WAW6AMM7E35XJUXQUB3F26MQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.585618260 (265h23m58.283186567s) [noise=true , address=89.149.201.147:4009 , piece_id=SJOCJGUYVOXZWMHZQEGNMZXJDCZUMB2WP5FSYJ3EAUNQGODCOFQA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.592780691 (265h23m58.290349027s) [noise=true , address=185.167.204.206:4071 , piece_id=D3SV3RVHYGAU77TLBJNHBETNKILWBLOHOKCX5POSX36USLR7YT6A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.618165813 (265h23m58.315734129s) [noise=true , address=89.149.201.147:4008 , piece_id=JKTXCHUFHQQA5HLZU4MYASODZVSGXBTXKAFIHMEB4DZVZDSWGVKA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.964120185 (265h23m58.661688521s) [noise=true , address=81.171.14.70:4037 , piece_id=I574CDK3DF4VD6DNSU2EZVEZSXV7TXQLTDQ6PXOGNZ5NBS3WLG7A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.026637691 (265h23m58.724206017s) [noise=true , address=89.149.201.147:4017 , piece_id=WV2W3UABBSPQTLLCYXM2WAKP2I5BUFE4M4XD3WECWR7EBUEOYLHQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.033231919 (265h23m58.730800256s) [noise=true , address=89.149.201.147:4006 , piece_id=TYU2VBU2E4CBT4WA7LWBTSK6WMJNOY753UFSCLPRFNQUXUMGBXUA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.040392117 (265h23m58.737960453s) [noise=true , address=81.171.14.70:4043 , piece_id=WGFJVAFZ7U52TS35UNWIMB2NY66KOXYV5DEI5PCURD2D4VFWJXIA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.040410391 (265h23m58.737978737s) [seg_pos={0 0}, upload=233340]: Segment reached optimal threshold of 26 pieces. Dec 16 16:53:11.040665407 (265h23m58.738233743s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J): protocol: expected piece hash; context canceled; EOF Dec 16 16:53:11.040681107 (265h23m58.738249453s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Long tail cancellation due to optimal threshold Dec 16 16:53:11.040938978 (265h23m58.738507314s) [noise=true , address=89.149.201.147:4019 , piece_id=QNHI7H4QBIYTA64JBQJKFPJEHK54WGHWEXOPTNME7ZFZ2FJNT7GA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2): protocol: expected piece hash; context canceled; EOF Dec 16 16:53:11.040951392 (265h23m58.738519727s) [noise=true , address=89.149.201.147:4019 , piece_id=QNHI7H4QBIYTA64JBQJKFPJEHK54WGHWEXOPTNME7ZFZ2FJNT7GA, seg_pos={0 0}, upload=233340]: Long tail cancellation due to optimal threshold Dec 16 16:53:11.041003759 (265h23m58.738572096s) [seg_pos={0 0}, upload=233340]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 16:53:11.041087015 (265h23m58.738655351s) [upload=233340]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 16:53:11.041093397 (265h23m58.738661733s) [upload=233340]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 16:54:06.282124914 (265h24m53.97969323s) [upload=233340]: Done uploading segments... Dec 16 16:54:06.282202999 (265h24m53.979771305s) [upload=233340]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.211652931s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 373.184459ms trace: https://jaeger.dev.storj.io/trace/1054383a00e42cf4 FAIL (2025-12-16 17:29:05 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 373.208425ms edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.624045107s trace: https://jaeger.dev.storj.io/trace/5683d14cc62eee41 FAIL (2025-12-16 17:28:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== . Dec 16 16:53:09.845598423 (265h23m57.543166758s) [noise=true , address=185.167.204.205:4015 , piece_id=L7P6B35RE5NTIOA3JTG535RSBF42IHHC3SJSJY7JIQGP4KJUHIYQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.846066447 (265h23m57.543634783s) [noise=true , address=185.167.204.206:4072 , piece_id=6BIZRUDCOCOYAF33R5OBNC7JFO24KVYSWPUBWAGQ5KDFMTBE25TA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.846618208 (265h23m57.544186544s) [noise=true , address=81.171.14.70:4037 , piece_id=I574CDK3DF4VD6DNSU2EZVEZSXV7TXQLTDQ6PXOGNZ5NBS3WLG7A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.847117681 (265h23m57.544686018s) [noise=true , address=185.167.204.206:4054 , piece_id=D4AZ6L635EREAOFXQB5WOZODYHI3JDX622TDCIQFYAQVQNLY5PQA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.847646829 (265h23m57.545215176s) [noise=true , address=81.171.14.70:4036 , piece_id=2DRO2WQNKIQOLQONGLT6UPIWA3MQPWOESLFKTWLP2ALHZPGBMKDA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.849322711 (265h23m57.546891047s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.849923874 (265h23m57.54749221s) [noise=true , address=89.149.201.147:4021 , piece_id=Z3CQ3EQAXFLENOPKJP3DKAYGXNO2376ST6Z55HGJSMZYEMBU73NQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.850581442 (265h23m57.548149788s) [noise=true , address=89.149.201.147:4008 , piece_id=JKTXCHUFHQQA5HLZU4MYASODZVSGXBTXKAFIHMEB4DZVZDSWGVKA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.851295546 (265h23m57.548863882s) [noise=true , address=185.167.204.206:4066 , piece_id=YAMEYYASLEP75NXGHJ65OK7HOS67BVR5ZG2WTMKNUBXCOUOBPPOQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.851846756 (265h23m57.549415132s) [noise=true , address=185.167.204.205:4033 , piece_id=F2X3ZTK52MNL5Q6W5FEDNRLBFBWJSMQ5XUX7HVNMRTYFRUP4NF5A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:10.300410080 (265h23m57.997978386s) [upload=233340]: Next returned nil segment Dec 16 16:53:10.300419738 (265h23m57.997988054s) [upload=233340]: Waiting for error group managing segments... Dec 16 16:53:10.487707706 (265h23m58.185276032s) [noise=true , address=185.167.204.206:4066 , piece_id=YAMEYYASLEP75NXGHJ65OK7HOS67BVR5ZG2WTMKNUBXCOUOBPPOQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.488519382 (265h23m58.186087698s) [noise=true , address=185.167.204.206:4072 , piece_id=6BIZRUDCOCOYAF33R5OBNC7JFO24KVYSWPUBWAGQ5KDFMTBE25TA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.488981015 (265h23m58.18654932s) [noise=true , address=185.167.204.205:4020 , piece_id=FAU7CY7IYUPFV47CRJ55FLCBTLL4QUIFJ5NGKBNYR53PUCRIKDNQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.489259936 (265h23m58.186828272s) [noise=true , address=185.167.204.205:4027 , piece_id=7DJF2FS4NNSAM7O3JLCHSXDYXW2B2TK5HBRCVHHCEPXRQ3JFFOJA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.493026132 (265h23m58.190594468s) [noise=true , address=185.167.204.205:4033 , piece_id=F2X3ZTK52MNL5Q6W5FEDNRLBFBWJSMQ5XUX7HVNMRTYFRUP4NF5A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.497763182 (265h23m58.195331487s) [noise=true , address=185.167.204.206:4063 , piece_id=CXJZQGWPLX2GR6FT4PVMJLFRIFQQCLS4FOCPAJSS4ZV34IX4DN2A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.500875446 (265h23m58.198443762s) [noise=true , address=185.167.204.205:4015 , piece_id=L7P6B35RE5NTIOA3JTG535RSBF42IHHC3SJSJY7JIQGP4KJUHIYQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.503696186 (265h23m58.201264491s) [noise=true , address=89.149.201.147:4021 , piece_id=Z3CQ3EQAXFLENOPKJP3DKAYGXNO2376ST6Z55HGJSMZYEMBU73NQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.506666203 (265h23m58.20423454s) [noise=true , address=185.167.204.205:4016 , piece_id=I7ROD6VOVVTE5OOR462FPNK6FB5E6HCFVOAOATCYEGM7GEHI36MQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.514568155 (265h23m58.212136492s) [noise=true , address=185.167.204.205:4030 , piece_id=YKGL25SO3PZ2LBJMNJEPB4FO7PLWTD62GM4IIUKBLDYZTMBLQDCA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.516326801 (265h23m58.213895117s) [noise=true , address=185.167.204.206:4064 , piece_id=2PTLHY2JHHYERJM7FFAZVP6EBDX5D7RW7RNQPABQLSFT55HJA2QQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.524488249 (265h23m58.222056635s) [noise=true , address=185.167.204.206:4062 , piece_id=4YYT67CBPVP5QQHT7O2IK6GVLJAFNFALH76IMWILSRTA7NVNU2YQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.528223667 (265h23m58.225792004s) [noise=true , address=185.167.204.206:4054 , piece_id=D4AZ6L635EREAOFXQB5WOZODYHI3JDX622TDCIQFYAQVQNLY5PQA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.528675321 (265h23m58.226243637s) [noise=true , address=89.149.201.147:4010 , piece_id=QPL4PZCA57NVK32MVFHIPRUZ7NAMFJWGZPQK7PP6QMTRP4QCNGUA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.532773757 (265h23m58.230342073s) [noise=true , address=185.167.204.205:4002 , piece_id=PUYVE7TVOLH4ZH5SVTDEADQLFEYCB62PH3LPNBYJDJYNN7246VPA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.539818999 (265h23m58.237387315s) [noise=true , address=81.171.14.70:4048 , piece_id=R2KPQ7VPMPZHTH6PXZCDYN6HZVWJFA7RC55LMKZTQNCUQNQV2VAA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.550626359 (265h23m58.248194665s) [noise=true , address=81.171.14.70:4041 , piece_id=7N3BCTKBLRNEHWFDA4JG5EL2724JODUSMITRCNT5GNHHQ3XMXOGA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.562449477 (265h23m58.260017793s) [noise=true , address=81.171.14.70:4036 , piece_id=2DRO2WQNKIQOLQONGLT6UPIWA3MQPWOESLFKTWLP2ALHZPGBMKDA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.581197291 (265h23m58.278765627s) [noise=true , address=89.149.201.147:4012 , piece_id=C4N4DMRVA7VHN3MVUXQ7YCGC67Q7WAW6AMM7E35XJUXQUB3F26MQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.585618260 (265h23m58.283186567s) [noise=true , address=89.149.201.147:4009 , piece_id=SJOCJGUYVOXZWMHZQEGNMZXJDCZUMB2WP5FSYJ3EAUNQGODCOFQA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.592780691 (265h23m58.290349027s) [noise=true , address=185.167.204.206:4071 , piece_id=D3SV3RVHYGAU77TLBJNHBETNKILWBLOHOKCX5POSX36USLR7YT6A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.618165813 (265h23m58.315734129s) [noise=true , address=89.149.201.147:4008 , piece_id=JKTXCHUFHQQA5HLZU4MYASODZVSGXBTXKAFIHMEB4DZVZDSWGVKA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.964120185 (265h23m58.661688521s) [noise=true , address=81.171.14.70:4037 , piece_id=I574CDK3DF4VD6DNSU2EZVEZSXV7TXQLTDQ6PXOGNZ5NBS3WLG7A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.026637691 (265h23m58.724206017s) [noise=true , address=89.149.201.147:4017 , piece_id=WV2W3UABBSPQTLLCYXM2WAKP2I5BUFE4M4XD3WECWR7EBUEOYLHQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.033231919 (265h23m58.730800256s) [noise=true , address=89.149.201.147:4006 , piece_id=TYU2VBU2E4CBT4WA7LWBTSK6WMJNOY753UFSCLPRFNQUXUMGBXUA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.040392117 (265h23m58.737960453s) [noise=true , address=81.171.14.70:4043 , piece_id=WGFJVAFZ7U52TS35UNWIMB2NY66KOXYV5DEI5PCURD2D4VFWJXIA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.040410391 (265h23m58.737978737s) [seg_pos={0 0}, upload=233340]: Segment reached optimal threshold of 26 pieces. Dec 16 16:53:11.040665407 (265h23m58.738233743s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J): protocol: expected piece hash; context canceled; EOF Dec 16 16:53:11.040681107 (265h23m58.738249453s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Long tail cancellation due to optimal threshold Dec 16 16:53:11.040938978 (265h23m58.738507314s) [noise=true , address=89.149.201.147:4019 , piece_id=QNHI7H4QBIYTA64JBQJKFPJEHK54WGHWEXOPTNME7ZFZ2FJNT7GA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2): protocol: expected piece hash; context canceled; EOF Dec 16 16:53:11.040951392 (265h23m58.738519727s) [noise=true , address=89.149.201.147:4019 , piece_id=QNHI7H4QBIYTA64JBQJKFPJEHK54WGHWEXOPTNME7ZFZ2FJNT7GA, seg_pos={0 0}, upload=233340]: Long tail cancellation due to optimal threshold Dec 16 16:53:11.041003759 (265h23m58.738572096s) [seg_pos={0 0}, upload=233340]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 16:53:11.041087015 (265h23m58.738655351s) [upload=233340]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 16:53:11.041093397 (265h23m58.738661733s) [upload=233340]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 16:54:06.282124914 (265h24m53.97969323s) [upload=233340]: Done uploading segments... Dec 16 16:54:06.282202999 (265h24m53.979771305s) [upload=233340]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.624069473s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 444.123195ms trace: https://jaeger.dev.storj.io/trace/1054383a00e42cf4 FAIL (2025-12-16 17:28:34 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 444.15872ms edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.804534384s trace: https://jaeger.dev.storj.io/trace/7608b45d5a11c8a3 FAIL (2025-12-16 17:28:24 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.804554691s core uplink eu1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 374.455341ms trace: https://jaeger.dev.storj.io/trace/1054383a00e42cf4 FAIL (2025-12-16 17:27:59 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 374.475259ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 398.353016ms trace: https://jaeger.dev.storj.io/trace/1054383a00e42cf4 FAIL (2025-12-16 17:27:34 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 398.378694ms edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.913740501s trace: https://jaeger.dev.storj.io/trace/7608b45d5a11c8a3 FAIL (2025-12-16 17:27:33 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.913758183s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.583479994s trace: https://jaeger.dev.storj.io/trace/5683d14cc62eee41 FAIL (2025-12-16 17:27:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== . Dec 16 16:53:09.845598423 (265h23m57.543166758s) [noise=true , address=185.167.204.205:4015 , piece_id=L7P6B35RE5NTIOA3JTG535RSBF42IHHC3SJSJY7JIQGP4KJUHIYQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.846066447 (265h23m57.543634783s) [noise=true , address=185.167.204.206:4072 , piece_id=6BIZRUDCOCOYAF33R5OBNC7JFO24KVYSWPUBWAGQ5KDFMTBE25TA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.846618208 (265h23m57.544186544s) [noise=true , address=81.171.14.70:4037 , piece_id=I574CDK3DF4VD6DNSU2EZVEZSXV7TXQLTDQ6PXOGNZ5NBS3WLG7A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.847117681 (265h23m57.544686018s) [noise=true , address=185.167.204.206:4054 , piece_id=D4AZ6L635EREAOFXQB5WOZODYHI3JDX622TDCIQFYAQVQNLY5PQA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.847646829 (265h23m57.545215176s) [noise=true , address=81.171.14.70:4036 , piece_id=2DRO2WQNKIQOLQONGLT6UPIWA3MQPWOESLFKTWLP2ALHZPGBMKDA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.849322711 (265h23m57.546891047s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.849923874 (265h23m57.54749221s) [noise=true , address=89.149.201.147:4021 , piece_id=Z3CQ3EQAXFLENOPKJP3DKAYGXNO2376ST6Z55HGJSMZYEMBU73NQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.850581442 (265h23m57.548149788s) [noise=true , address=89.149.201.147:4008 , piece_id=JKTXCHUFHQQA5HLZU4MYASODZVSGXBTXKAFIHMEB4DZVZDSWGVKA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.851295546 (265h23m57.548863882s) [noise=true , address=185.167.204.206:4066 , piece_id=YAMEYYASLEP75NXGHJ65OK7HOS67BVR5ZG2WTMKNUBXCOUOBPPOQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.851846756 (265h23m57.549415132s) [noise=true , address=185.167.204.205:4033 , piece_id=F2X3ZTK52MNL5Q6W5FEDNRLBFBWJSMQ5XUX7HVNMRTYFRUP4NF5A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:10.300410080 (265h23m57.997978386s) [upload=233340]: Next returned nil segment Dec 16 16:53:10.300419738 (265h23m57.997988054s) [upload=233340]: Waiting for error group managing segments... Dec 16 16:53:10.487707706 (265h23m58.185276032s) [noise=true , address=185.167.204.206:4066 , piece_id=YAMEYYASLEP75NXGHJ65OK7HOS67BVR5ZG2WTMKNUBXCOUOBPPOQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.488519382 (265h23m58.186087698s) [noise=true , address=185.167.204.206:4072 , piece_id=6BIZRUDCOCOYAF33R5OBNC7JFO24KVYSWPUBWAGQ5KDFMTBE25TA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.488981015 (265h23m58.18654932s) [noise=true , address=185.167.204.205:4020 , piece_id=FAU7CY7IYUPFV47CRJ55FLCBTLL4QUIFJ5NGKBNYR53PUCRIKDNQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.489259936 (265h23m58.186828272s) [noise=true , address=185.167.204.205:4027 , piece_id=7DJF2FS4NNSAM7O3JLCHSXDYXW2B2TK5HBRCVHHCEPXRQ3JFFOJA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.493026132 (265h23m58.190594468s) [noise=true , address=185.167.204.205:4033 , piece_id=F2X3ZTK52MNL5Q6W5FEDNRLBFBWJSMQ5XUX7HVNMRTYFRUP4NF5A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.497763182 (265h23m58.195331487s) [noise=true , address=185.167.204.206:4063 , piece_id=CXJZQGWPLX2GR6FT4PVMJLFRIFQQCLS4FOCPAJSS4ZV34IX4DN2A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.500875446 (265h23m58.198443762s) [noise=true , address=185.167.204.205:4015 , piece_id=L7P6B35RE5NTIOA3JTG535RSBF42IHHC3SJSJY7JIQGP4KJUHIYQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.503696186 (265h23m58.201264491s) [noise=true , address=89.149.201.147:4021 , piece_id=Z3CQ3EQAXFLENOPKJP3DKAYGXNO2376ST6Z55HGJSMZYEMBU73NQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.506666203 (265h23m58.20423454s) [noise=true , address=185.167.204.205:4016 , piece_id=I7ROD6VOVVTE5OOR462FPNK6FB5E6HCFVOAOATCYEGM7GEHI36MQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.514568155 (265h23m58.212136492s) [noise=true , address=185.167.204.205:4030 , piece_id=YKGL25SO3PZ2LBJMNJEPB4FO7PLWTD62GM4IIUKBLDYZTMBLQDCA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.516326801 (265h23m58.213895117s) [noise=true , address=185.167.204.206:4064 , piece_id=2PTLHY2JHHYERJM7FFAZVP6EBDX5D7RW7RNQPABQLSFT55HJA2QQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.524488249 (265h23m58.222056635s) [noise=true , address=185.167.204.206:4062 , piece_id=4YYT67CBPVP5QQHT7O2IK6GVLJAFNFALH76IMWILSRTA7NVNU2YQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.528223667 (265h23m58.225792004s) [noise=true , address=185.167.204.206:4054 , piece_id=D4AZ6L635EREAOFXQB5WOZODYHI3JDX622TDCIQFYAQVQNLY5PQA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.528675321 (265h23m58.226243637s) [noise=true , address=89.149.201.147:4010 , piece_id=QPL4PZCA57NVK32MVFHIPRUZ7NAMFJWGZPQK7PP6QMTRP4QCNGUA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.532773757 (265h23m58.230342073s) [noise=true , address=185.167.204.205:4002 , piece_id=PUYVE7TVOLH4ZH5SVTDEADQLFEYCB62PH3LPNBYJDJYNN7246VPA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.539818999 (265h23m58.237387315s) [noise=true , address=81.171.14.70:4048 , piece_id=R2KPQ7VPMPZHTH6PXZCDYN6HZVWJFA7RC55LMKZTQNCUQNQV2VAA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.550626359 (265h23m58.248194665s) [noise=true , address=81.171.14.70:4041 , piece_id=7N3BCTKBLRNEHWFDA4JG5EL2724JODUSMITRCNT5GNHHQ3XMXOGA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.562449477 (265h23m58.260017793s) [noise=true , address=81.171.14.70:4036 , piece_id=2DRO2WQNKIQOLQONGLT6UPIWA3MQPWOESLFKTWLP2ALHZPGBMKDA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.581197291 (265h23m58.278765627s) [noise=true , address=89.149.201.147:4012 , piece_id=C4N4DMRVA7VHN3MVUXQ7YCGC67Q7WAW6AMM7E35XJUXQUB3F26MQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.585618260 (265h23m58.283186567s) [noise=true , address=89.149.201.147:4009 , piece_id=SJOCJGUYVOXZWMHZQEGNMZXJDCZUMB2WP5FSYJ3EAUNQGODCOFQA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.592780691 (265h23m58.290349027s) [noise=true , address=185.167.204.206:4071 , piece_id=D3SV3RVHYGAU77TLBJNHBETNKILWBLOHOKCX5POSX36USLR7YT6A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.618165813 (265h23m58.315734129s) [noise=true , address=89.149.201.147:4008 , piece_id=JKTXCHUFHQQA5HLZU4MYASODZVSGXBTXKAFIHMEB4DZVZDSWGVKA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.964120185 (265h23m58.661688521s) [noise=true , address=81.171.14.70:4037 , piece_id=I574CDK3DF4VD6DNSU2EZVEZSXV7TXQLTDQ6PXOGNZ5NBS3WLG7A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.026637691 (265h23m58.724206017s) [noise=true , address=89.149.201.147:4017 , piece_id=WV2W3UABBSPQTLLCYXM2WAKP2I5BUFE4M4XD3WECWR7EBUEOYLHQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.033231919 (265h23m58.730800256s) [noise=true , address=89.149.201.147:4006 , piece_id=TYU2VBU2E4CBT4WA7LWBTSK6WMJNOY753UFSCLPRFNQUXUMGBXUA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.040392117 (265h23m58.737960453s) [noise=true , address=81.171.14.70:4043 , piece_id=WGFJVAFZ7U52TS35UNWIMB2NY66KOXYV5DEI5PCURD2D4VFWJXIA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.040410391 (265h23m58.737978737s) [seg_pos={0 0}, upload=233340]: Segment reached optimal threshold of 26 pieces. Dec 16 16:53:11.040665407 (265h23m58.738233743s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J): protocol: expected piece hash; context canceled; EOF Dec 16 16:53:11.040681107 (265h23m58.738249453s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Long tail cancellation due to optimal threshold Dec 16 16:53:11.040938978 (265h23m58.738507314s) [noise=true , address=89.149.201.147:4019 , piece_id=QNHI7H4QBIYTA64JBQJKFPJEHK54WGHWEXOPTNME7ZFZ2FJNT7GA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2): protocol: expected piece hash; context canceled; EOF Dec 16 16:53:11.040951392 (265h23m58.738519727s) [noise=true , address=89.149.201.147:4019 , piece_id=QNHI7H4QBIYTA64JBQJKFPJEHK54WGHWEXOPTNME7ZFZ2FJNT7GA, seg_pos={0 0}, upload=233340]: Long tail cancellation due to optimal threshold Dec 16 16:53:11.041003759 (265h23m58.738572096s) [seg_pos={0 0}, upload=233340]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 16:53:11.041087015 (265h23m58.738655351s) [upload=233340]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 16:53:11.041093397 (265h23m58.738661733s) [upload=233340]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 16:54:06.282124914 (265h24m53.97969323s) [upload=233340]: Done uploading segments... Dec 16 16:54:06.282202999 (265h24m53.979771305s) [upload=233340]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.583502265s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 334.119619ms trace: https://jaeger.dev.storj.io/trace/1054383a00e42cf4 FAIL (2025-12-16 17:27:14 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 334.142903ms edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.760251554s trace: https://jaeger.dev.storj.io/trace/7608b45d5a11c8a3 FAIL (2025-12-16 17:26:45 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.760263657s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.585322324s trace: https://jaeger.dev.storj.io/trace/5683d14cc62eee41 FAIL (2025-12-16 17:26:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== . Dec 16 16:53:09.845598423 (265h23m57.543166758s) [noise=true , address=185.167.204.205:4015 , piece_id=L7P6B35RE5NTIOA3JTG535RSBF42IHHC3SJSJY7JIQGP4KJUHIYQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.846066447 (265h23m57.543634783s) [noise=true , address=185.167.204.206:4072 , piece_id=6BIZRUDCOCOYAF33R5OBNC7JFO24KVYSWPUBWAGQ5KDFMTBE25TA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.846618208 (265h23m57.544186544s) [noise=true , address=81.171.14.70:4037 , piece_id=I574CDK3DF4VD6DNSU2EZVEZSXV7TXQLTDQ6PXOGNZ5NBS3WLG7A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.847117681 (265h23m57.544686018s) [noise=true , address=185.167.204.206:4054 , piece_id=D4AZ6L635EREAOFXQB5WOZODYHI3JDX622TDCIQFYAQVQNLY5PQA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.847646829 (265h23m57.545215176s) [noise=true , address=81.171.14.70:4036 , piece_id=2DRO2WQNKIQOLQONGLT6UPIWA3MQPWOESLFKTWLP2ALHZPGBMKDA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.849322711 (265h23m57.546891047s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.849923874 (265h23m57.54749221s) [noise=true , address=89.149.201.147:4021 , piece_id=Z3CQ3EQAXFLENOPKJP3DKAYGXNO2376ST6Z55HGJSMZYEMBU73NQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.850581442 (265h23m57.548149788s) [noise=true , address=89.149.201.147:4008 , piece_id=JKTXCHUFHQQA5HLZU4MYASODZVSGXBTXKAFIHMEB4DZVZDSWGVKA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.851295546 (265h23m57.548863882s) [noise=true , address=185.167.204.206:4066 , piece_id=YAMEYYASLEP75NXGHJ65OK7HOS67BVR5ZG2WTMKNUBXCOUOBPPOQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.851846756 (265h23m57.549415132s) [noise=true , address=185.167.204.205:4033 , piece_id=F2X3ZTK52MNL5Q6W5FEDNRLBFBWJSMQ5XUX7HVNMRTYFRUP4NF5A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:10.300410080 (265h23m57.997978386s) [upload=233340]: Next returned nil segment Dec 16 16:53:10.300419738 (265h23m57.997988054s) [upload=233340]: Waiting for error group managing segments... Dec 16 16:53:10.487707706 (265h23m58.185276032s) [noise=true , address=185.167.204.206:4066 , piece_id=YAMEYYASLEP75NXGHJ65OK7HOS67BVR5ZG2WTMKNUBXCOUOBPPOQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.488519382 (265h23m58.186087698s) [noise=true , address=185.167.204.206:4072 , piece_id=6BIZRUDCOCOYAF33R5OBNC7JFO24KVYSWPUBWAGQ5KDFMTBE25TA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.488981015 (265h23m58.18654932s) [noise=true , address=185.167.204.205:4020 , piece_id=FAU7CY7IYUPFV47CRJ55FLCBTLL4QUIFJ5NGKBNYR53PUCRIKDNQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.489259936 (265h23m58.186828272s) [noise=true , address=185.167.204.205:4027 , piece_id=7DJF2FS4NNSAM7O3JLCHSXDYXW2B2TK5HBRCVHHCEPXRQ3JFFOJA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.493026132 (265h23m58.190594468s) [noise=true , address=185.167.204.205:4033 , piece_id=F2X3ZTK52MNL5Q6W5FEDNRLBFBWJSMQ5XUX7HVNMRTYFRUP4NF5A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.497763182 (265h23m58.195331487s) [noise=true , address=185.167.204.206:4063 , piece_id=CXJZQGWPLX2GR6FT4PVMJLFRIFQQCLS4FOCPAJSS4ZV34IX4DN2A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.500875446 (265h23m58.198443762s) [noise=true , address=185.167.204.205:4015 , piece_id=L7P6B35RE5NTIOA3JTG535RSBF42IHHC3SJSJY7JIQGP4KJUHIYQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.503696186 (265h23m58.201264491s) [noise=true , address=89.149.201.147:4021 , piece_id=Z3CQ3EQAXFLENOPKJP3DKAYGXNO2376ST6Z55HGJSMZYEMBU73NQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.506666203 (265h23m58.20423454s) [noise=true , address=185.167.204.205:4016 , piece_id=I7ROD6VOVVTE5OOR462FPNK6FB5E6HCFVOAOATCYEGM7GEHI36MQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.514568155 (265h23m58.212136492s) [noise=true , address=185.167.204.205:4030 , piece_id=YKGL25SO3PZ2LBJMNJEPB4FO7PLWTD62GM4IIUKBLDYZTMBLQDCA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.516326801 (265h23m58.213895117s) [noise=true , address=185.167.204.206:4064 , piece_id=2PTLHY2JHHYERJM7FFAZVP6EBDX5D7RW7RNQPABQLSFT55HJA2QQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.524488249 (265h23m58.222056635s) [noise=true , address=185.167.204.206:4062 , piece_id=4YYT67CBPVP5QQHT7O2IK6GVLJAFNFALH76IMWILSRTA7NVNU2YQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.528223667 (265h23m58.225792004s) [noise=true , address=185.167.204.206:4054 , piece_id=D4AZ6L635EREAOFXQB5WOZODYHI3JDX622TDCIQFYAQVQNLY5PQA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.528675321 (265h23m58.226243637s) [noise=true , address=89.149.201.147:4010 , piece_id=QPL4PZCA57NVK32MVFHIPRUZ7NAMFJWGZPQK7PP6QMTRP4QCNGUA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.532773757 (265h23m58.230342073s) [noise=true , address=185.167.204.205:4002 , piece_id=PUYVE7TVOLH4ZH5SVTDEADQLFEYCB62PH3LPNBYJDJYNN7246VPA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.539818999 (265h23m58.237387315s) [noise=true , address=81.171.14.70:4048 , piece_id=R2KPQ7VPMPZHTH6PXZCDYN6HZVWJFA7RC55LMKZTQNCUQNQV2VAA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.550626359 (265h23m58.248194665s) [noise=true , address=81.171.14.70:4041 , piece_id=7N3BCTKBLRNEHWFDA4JG5EL2724JODUSMITRCNT5GNHHQ3XMXOGA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.562449477 (265h23m58.260017793s) [noise=true , address=81.171.14.70:4036 , piece_id=2DRO2WQNKIQOLQONGLT6UPIWA3MQPWOESLFKTWLP2ALHZPGBMKDA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.581197291 (265h23m58.278765627s) [noise=true , address=89.149.201.147:4012 , piece_id=C4N4DMRVA7VHN3MVUXQ7YCGC67Q7WAW6AMM7E35XJUXQUB3F26MQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.585618260 (265h23m58.283186567s) [noise=true , address=89.149.201.147:4009 , piece_id=SJOCJGUYVOXZWMHZQEGNMZXJDCZUMB2WP5FSYJ3EAUNQGODCOFQA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.592780691 (265h23m58.290349027s) [noise=true , address=185.167.204.206:4071 , piece_id=D3SV3RVHYGAU77TLBJNHBETNKILWBLOHOKCX5POSX36USLR7YT6A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.618165813 (265h23m58.315734129s) [noise=true , address=89.149.201.147:4008 , piece_id=JKTXCHUFHQQA5HLZU4MYASODZVSGXBTXKAFIHMEB4DZVZDSWGVKA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.964120185 (265h23m58.661688521s) [noise=true , address=81.171.14.70:4037 , piece_id=I574CDK3DF4VD6DNSU2EZVEZSXV7TXQLTDQ6PXOGNZ5NBS3WLG7A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.026637691 (265h23m58.724206017s) [noise=true , address=89.149.201.147:4017 , piece_id=WV2W3UABBSPQTLLCYXM2WAKP2I5BUFE4M4XD3WECWR7EBUEOYLHQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.033231919 (265h23m58.730800256s) [noise=true , address=89.149.201.147:4006 , piece_id=TYU2VBU2E4CBT4WA7LWBTSK6WMJNOY753UFSCLPRFNQUXUMGBXUA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.040392117 (265h23m58.737960453s) [noise=true , address=81.171.14.70:4043 , piece_id=WGFJVAFZ7U52TS35UNWIMB2NY66KOXYV5DEI5PCURD2D4VFWJXIA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.040410391 (265h23m58.737978737s) [seg_pos={0 0}, upload=233340]: Segment reached optimal threshold of 26 pieces. Dec 16 16:53:11.040665407 (265h23m58.738233743s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J): protocol: expected piece hash; context canceled; EOF Dec 16 16:53:11.040681107 (265h23m58.738249453s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Long tail cancellation due to optimal threshold Dec 16 16:53:11.040938978 (265h23m58.738507314s) [noise=true , address=89.149.201.147:4019 , piece_id=QNHI7H4QBIYTA64JBQJKFPJEHK54WGHWEXOPTNME7ZFZ2FJNT7GA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2): protocol: expected piece hash; context canceled; EOF Dec 16 16:53:11.040951392 (265h23m58.738519727s) [noise=true , address=89.149.201.147:4019 , piece_id=QNHI7H4QBIYTA64JBQJKFPJEHK54WGHWEXOPTNME7ZFZ2FJNT7GA, seg_pos={0 0}, upload=233340]: Long tail cancellation due to optimal threshold Dec 16 16:53:11.041003759 (265h23m58.738572096s) [seg_pos={0 0}, upload=233340]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 16:53:11.041087015 (265h23m58.738655351s) [upload=233340]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 16:53:11.041093397 (265h23m58.738661733s) [upload=233340]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 16:54:06.282124914 (265h24m53.97969323s) [upload=233340]: Done uploading segments... Dec 16 16:54:06.282202999 (265h24m53.979771305s) [upload=233340]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.58533627s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 392.526043ms trace: https://jaeger.dev.storj.io/trace/1054383a00e42cf4 FAIL (2025-12-16 17:26:34 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 392.542233ms edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.844800136s trace: https://jaeger.dev.storj.io/trace/7608b45d5a11c8a3 FAIL (2025-12-16 17:25:44 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.84481852s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.201136673s trace: https://jaeger.dev.storj.io/trace/5683d14cc62eee41 FAIL (2025-12-16 17:25:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== . Dec 16 16:53:09.845598423 (265h23m57.543166758s) [noise=true , address=185.167.204.205:4015 , piece_id=L7P6B35RE5NTIOA3JTG535RSBF42IHHC3SJSJY7JIQGP4KJUHIYQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.846066447 (265h23m57.543634783s) [noise=true , address=185.167.204.206:4072 , piece_id=6BIZRUDCOCOYAF33R5OBNC7JFO24KVYSWPUBWAGQ5KDFMTBE25TA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.846618208 (265h23m57.544186544s) [noise=true , address=81.171.14.70:4037 , piece_id=I574CDK3DF4VD6DNSU2EZVEZSXV7TXQLTDQ6PXOGNZ5NBS3WLG7A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.847117681 (265h23m57.544686018s) [noise=true , address=185.167.204.206:4054 , piece_id=D4AZ6L635EREAOFXQB5WOZODYHI3JDX622TDCIQFYAQVQNLY5PQA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.847646829 (265h23m57.545215176s) [noise=true , address=81.171.14.70:4036 , piece_id=2DRO2WQNKIQOLQONGLT6UPIWA3MQPWOESLFKTWLP2ALHZPGBMKDA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.849322711 (265h23m57.546891047s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.849923874 (265h23m57.54749221s) [noise=true , address=89.149.201.147:4021 , piece_id=Z3CQ3EQAXFLENOPKJP3DKAYGXNO2376ST6Z55HGJSMZYEMBU73NQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.850581442 (265h23m57.548149788s) [noise=true , address=89.149.201.147:4008 , piece_id=JKTXCHUFHQQA5HLZU4MYASODZVSGXBTXKAFIHMEB4DZVZDSWGVKA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.851295546 (265h23m57.548863882s) [noise=true , address=185.167.204.206:4066 , piece_id=YAMEYYASLEP75NXGHJ65OK7HOS67BVR5ZG2WTMKNUBXCOUOBPPOQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.851846756 (265h23m57.549415132s) [noise=true , address=185.167.204.205:4033 , piece_id=F2X3ZTK52MNL5Q6W5FEDNRLBFBWJSMQ5XUX7HVNMRTYFRUP4NF5A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:10.300410080 (265h23m57.997978386s) [upload=233340]: Next returned nil segment Dec 16 16:53:10.300419738 (265h23m57.997988054s) [upload=233340]: Waiting for error group managing segments... Dec 16 16:53:10.487707706 (265h23m58.185276032s) [noise=true , address=185.167.204.206:4066 , piece_id=YAMEYYASLEP75NXGHJ65OK7HOS67BVR5ZG2WTMKNUBXCOUOBPPOQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.488519382 (265h23m58.186087698s) [noise=true , address=185.167.204.206:4072 , piece_id=6BIZRUDCOCOYAF33R5OBNC7JFO24KVYSWPUBWAGQ5KDFMTBE25TA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.488981015 (265h23m58.18654932s) [noise=true , address=185.167.204.205:4020 , piece_id=FAU7CY7IYUPFV47CRJ55FLCBTLL4QUIFJ5NGKBNYR53PUCRIKDNQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.489259936 (265h23m58.186828272s) [noise=true , address=185.167.204.205:4027 , piece_id=7DJF2FS4NNSAM7O3JLCHSXDYXW2B2TK5HBRCVHHCEPXRQ3JFFOJA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.493026132 (265h23m58.190594468s) [noise=true , address=185.167.204.205:4033 , piece_id=F2X3ZTK52MNL5Q6W5FEDNRLBFBWJSMQ5XUX7HVNMRTYFRUP4NF5A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.497763182 (265h23m58.195331487s) [noise=true , address=185.167.204.206:4063 , piece_id=CXJZQGWPLX2GR6FT4PVMJLFRIFQQCLS4FOCPAJSS4ZV34IX4DN2A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.500875446 (265h23m58.198443762s) [noise=true , address=185.167.204.205:4015 , piece_id=L7P6B35RE5NTIOA3JTG535RSBF42IHHC3SJSJY7JIQGP4KJUHIYQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.503696186 (265h23m58.201264491s) [noise=true , address=89.149.201.147:4021 , piece_id=Z3CQ3EQAXFLENOPKJP3DKAYGXNO2376ST6Z55HGJSMZYEMBU73NQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.506666203 (265h23m58.20423454s) [noise=true , address=185.167.204.205:4016 , piece_id=I7ROD6VOVVTE5OOR462FPNK6FB5E6HCFVOAOATCYEGM7GEHI36MQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.514568155 (265h23m58.212136492s) [noise=true , address=185.167.204.205:4030 , piece_id=YKGL25SO3PZ2LBJMNJEPB4FO7PLWTD62GM4IIUKBLDYZTMBLQDCA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.516326801 (265h23m58.213895117s) [noise=true , address=185.167.204.206:4064 , piece_id=2PTLHY2JHHYERJM7FFAZVP6EBDX5D7RW7RNQPABQLSFT55HJA2QQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.524488249 (265h23m58.222056635s) [noise=true , address=185.167.204.206:4062 , piece_id=4YYT67CBPVP5QQHT7O2IK6GVLJAFNFALH76IMWILSRTA7NVNU2YQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.528223667 (265h23m58.225792004s) [noise=true , address=185.167.204.206:4054 , piece_id=D4AZ6L635EREAOFXQB5WOZODYHI3JDX622TDCIQFYAQVQNLY5PQA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.528675321 (265h23m58.226243637s) [noise=true , address=89.149.201.147:4010 , piece_id=QPL4PZCA57NVK32MVFHIPRUZ7NAMFJWGZPQK7PP6QMTRP4QCNGUA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.532773757 (265h23m58.230342073s) [noise=true , address=185.167.204.205:4002 , piece_id=PUYVE7TVOLH4ZH5SVTDEADQLFEYCB62PH3LPNBYJDJYNN7246VPA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.539818999 (265h23m58.237387315s) [noise=true , address=81.171.14.70:4048 , piece_id=R2KPQ7VPMPZHTH6PXZCDYN6HZVWJFA7RC55LMKZTQNCUQNQV2VAA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.550626359 (265h23m58.248194665s) [noise=true , address=81.171.14.70:4041 , piece_id=7N3BCTKBLRNEHWFDA4JG5EL2724JODUSMITRCNT5GNHHQ3XMXOGA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.562449477 (265h23m58.260017793s) [noise=true , address=81.171.14.70:4036 , piece_id=2DRO2WQNKIQOLQONGLT6UPIWA3MQPWOESLFKTWLP2ALHZPGBMKDA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.581197291 (265h23m58.278765627s) [noise=true , address=89.149.201.147:4012 , piece_id=C4N4DMRVA7VHN3MVUXQ7YCGC67Q7WAW6AMM7E35XJUXQUB3F26MQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.585618260 (265h23m58.283186567s) [noise=true , address=89.149.201.147:4009 , piece_id=SJOCJGUYVOXZWMHZQEGNMZXJDCZUMB2WP5FSYJ3EAUNQGODCOFQA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.592780691 (265h23m58.290349027s) [noise=true , address=185.167.204.206:4071 , piece_id=D3SV3RVHYGAU77TLBJNHBETNKILWBLOHOKCX5POSX36USLR7YT6A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.618165813 (265h23m58.315734129s) [noise=true , address=89.149.201.147:4008 , piece_id=JKTXCHUFHQQA5HLZU4MYASODZVSGXBTXKAFIHMEB4DZVZDSWGVKA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.964120185 (265h23m58.661688521s) [noise=true , address=81.171.14.70:4037 , piece_id=I574CDK3DF4VD6DNSU2EZVEZSXV7TXQLTDQ6PXOGNZ5NBS3WLG7A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.026637691 (265h23m58.724206017s) [noise=true , address=89.149.201.147:4017 , piece_id=WV2W3UABBSPQTLLCYXM2WAKP2I5BUFE4M4XD3WECWR7EBUEOYLHQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.033231919 (265h23m58.730800256s) [noise=true , address=89.149.201.147:4006 , piece_id=TYU2VBU2E4CBT4WA7LWBTSK6WMJNOY753UFSCLPRFNQUXUMGBXUA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.040392117 (265h23m58.737960453s) [noise=true , address=81.171.14.70:4043 , piece_id=WGFJVAFZ7U52TS35UNWIMB2NY66KOXYV5DEI5PCURD2D4VFWJXIA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.040410391 (265h23m58.737978737s) [seg_pos={0 0}, upload=233340]: Segment reached optimal threshold of 26 pieces. Dec 16 16:53:11.040665407 (265h23m58.738233743s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J): protocol: expected piece hash; context canceled; EOF Dec 16 16:53:11.040681107 (265h23m58.738249453s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Long tail cancellation due to optimal threshold Dec 16 16:53:11.040938978 (265h23m58.738507314s) [noise=true , address=89.149.201.147:4019 , piece_id=QNHI7H4QBIYTA64JBQJKFPJEHK54WGHWEXOPTNME7ZFZ2FJNT7GA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2): protocol: expected piece hash; context canceled; EOF Dec 16 16:53:11.040951392 (265h23m58.738519727s) [noise=true , address=89.149.201.147:4019 , piece_id=QNHI7H4QBIYTA64JBQJKFPJEHK54WGHWEXOPTNME7ZFZ2FJNT7GA, seg_pos={0 0}, upload=233340]: Long tail cancellation due to optimal threshold Dec 16 16:53:11.041003759 (265h23m58.738572096s) [seg_pos={0 0}, upload=233340]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 16:53:11.041087015 (265h23m58.738655351s) [upload=233340]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 16:53:11.041093397 (265h23m58.738661733s) [upload=233340]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 16:54:06.282124914 (265h24m53.97969323s) [upload=233340]: Done uploading segments... Dec 16 16:54:06.282202999 (265h24m53.979771305s) [upload=233340]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.20115102s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 374.584504ms trace: https://jaeger.dev.storj.io/trace/1054383a00e42cf4 FAIL (2025-12-16 17:25:27 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 374.597918ms edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.795068399s trace: https://jaeger.dev.storj.io/trace/7608b45d5a11c8a3 FAIL (2025-12-16 17:25:21 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.795119084s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.595690887s trace: https://jaeger.dev.storj.io/trace/5683d14cc62eee41 FAIL (2025-12-16 17:25:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== . Dec 16 16:53:09.845598423 (265h23m57.543166758s) [noise=true , address=185.167.204.205:4015 , piece_id=L7P6B35RE5NTIOA3JTG535RSBF42IHHC3SJSJY7JIQGP4KJUHIYQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.846066447 (265h23m57.543634783s) [noise=true , address=185.167.204.206:4072 , piece_id=6BIZRUDCOCOYAF33R5OBNC7JFO24KVYSWPUBWAGQ5KDFMTBE25TA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.846618208 (265h23m57.544186544s) [noise=true , address=81.171.14.70:4037 , piece_id=I574CDK3DF4VD6DNSU2EZVEZSXV7TXQLTDQ6PXOGNZ5NBS3WLG7A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.847117681 (265h23m57.544686018s) [noise=true , address=185.167.204.206:4054 , piece_id=D4AZ6L635EREAOFXQB5WOZODYHI3JDX622TDCIQFYAQVQNLY5PQA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.847646829 (265h23m57.545215176s) [noise=true , address=81.171.14.70:4036 , piece_id=2DRO2WQNKIQOLQONGLT6UPIWA3MQPWOESLFKTWLP2ALHZPGBMKDA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.849322711 (265h23m57.546891047s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.849923874 (265h23m57.54749221s) [noise=true , address=89.149.201.147:4021 , piece_id=Z3CQ3EQAXFLENOPKJP3DKAYGXNO2376ST6Z55HGJSMZYEMBU73NQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.850581442 (265h23m57.548149788s) [noise=true , address=89.149.201.147:4008 , piece_id=JKTXCHUFHQQA5HLZU4MYASODZVSGXBTXKAFIHMEB4DZVZDSWGVKA, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.851295546 (265h23m57.548863882s) [noise=true , address=185.167.204.206:4066 , piece_id=YAMEYYASLEP75NXGHJ65OK7HOS67BVR5ZG2WTMKNUBXCOUOBPPOQ, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:09.851846756 (265h23m57.549415132s) [noise=true , address=185.167.204.205:4033 , piece_id=F2X3ZTK52MNL5Q6W5FEDNRLBFBWJSMQ5XUX7HVNMRTYFRUP4NF5A, seg_pos={0 0}, upload=233340]: Uploading piece... Dec 16 16:53:10.300410080 (265h23m57.997978386s) [upload=233340]: Next returned nil segment Dec 16 16:53:10.300419738 (265h23m57.997988054s) [upload=233340]: Waiting for error group managing segments... Dec 16 16:53:10.487707706 (265h23m58.185276032s) [noise=true , address=185.167.204.206:4066 , piece_id=YAMEYYASLEP75NXGHJ65OK7HOS67BVR5ZG2WTMKNUBXCOUOBPPOQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.488519382 (265h23m58.186087698s) [noise=true , address=185.167.204.206:4072 , piece_id=6BIZRUDCOCOYAF33R5OBNC7JFO24KVYSWPUBWAGQ5KDFMTBE25TA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.488981015 (265h23m58.18654932s) [noise=true , address=185.167.204.205:4020 , piece_id=FAU7CY7IYUPFV47CRJ55FLCBTLL4QUIFJ5NGKBNYR53PUCRIKDNQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.489259936 (265h23m58.186828272s) [noise=true , address=185.167.204.205:4027 , piece_id=7DJF2FS4NNSAM7O3JLCHSXDYXW2B2TK5HBRCVHHCEPXRQ3JFFOJA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.493026132 (265h23m58.190594468s) [noise=true , address=185.167.204.205:4033 , piece_id=F2X3ZTK52MNL5Q6W5FEDNRLBFBWJSMQ5XUX7HVNMRTYFRUP4NF5A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.497763182 (265h23m58.195331487s) [noise=true , address=185.167.204.206:4063 , piece_id=CXJZQGWPLX2GR6FT4PVMJLFRIFQQCLS4FOCPAJSS4ZV34IX4DN2A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.500875446 (265h23m58.198443762s) [noise=true , address=185.167.204.205:4015 , piece_id=L7P6B35RE5NTIOA3JTG535RSBF42IHHC3SJSJY7JIQGP4KJUHIYQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.503696186 (265h23m58.201264491s) [noise=true , address=89.149.201.147:4021 , piece_id=Z3CQ3EQAXFLENOPKJP3DKAYGXNO2376ST6Z55HGJSMZYEMBU73NQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.506666203 (265h23m58.20423454s) [noise=true , address=185.167.204.205:4016 , piece_id=I7ROD6VOVVTE5OOR462FPNK6FB5E6HCFVOAOATCYEGM7GEHI36MQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.514568155 (265h23m58.212136492s) [noise=true , address=185.167.204.205:4030 , piece_id=YKGL25SO3PZ2LBJMNJEPB4FO7PLWTD62GM4IIUKBLDYZTMBLQDCA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.516326801 (265h23m58.213895117s) [noise=true , address=185.167.204.206:4064 , piece_id=2PTLHY2JHHYERJM7FFAZVP6EBDX5D7RW7RNQPABQLSFT55HJA2QQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.524488249 (265h23m58.222056635s) [noise=true , address=185.167.204.206:4062 , piece_id=4YYT67CBPVP5QQHT7O2IK6GVLJAFNFALH76IMWILSRTA7NVNU2YQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.528223667 (265h23m58.225792004s) [noise=true , address=185.167.204.206:4054 , piece_id=D4AZ6L635EREAOFXQB5WOZODYHI3JDX622TDCIQFYAQVQNLY5PQA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.528675321 (265h23m58.226243637s) [noise=true , address=89.149.201.147:4010 , piece_id=QPL4PZCA57NVK32MVFHIPRUZ7NAMFJWGZPQK7PP6QMTRP4QCNGUA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.532773757 (265h23m58.230342073s) [noise=true , address=185.167.204.205:4002 , piece_id=PUYVE7TVOLH4ZH5SVTDEADQLFEYCB62PH3LPNBYJDJYNN7246VPA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.539818999 (265h23m58.237387315s) [noise=true , address=81.171.14.70:4048 , piece_id=R2KPQ7VPMPZHTH6PXZCDYN6HZVWJFA7RC55LMKZTQNCUQNQV2VAA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.550626359 (265h23m58.248194665s) [noise=true , address=81.171.14.70:4041 , piece_id=7N3BCTKBLRNEHWFDA4JG5EL2724JODUSMITRCNT5GNHHQ3XMXOGA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.562449477 (265h23m58.260017793s) [noise=true , address=81.171.14.70:4036 , piece_id=2DRO2WQNKIQOLQONGLT6UPIWA3MQPWOESLFKTWLP2ALHZPGBMKDA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.581197291 (265h23m58.278765627s) [noise=true , address=89.149.201.147:4012 , piece_id=C4N4DMRVA7VHN3MVUXQ7YCGC67Q7WAW6AMM7E35XJUXQUB3F26MQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.585618260 (265h23m58.283186567s) [noise=true , address=89.149.201.147:4009 , piece_id=SJOCJGUYVOXZWMHZQEGNMZXJDCZUMB2WP5FSYJ3EAUNQGODCOFQA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.592780691 (265h23m58.290349027s) [noise=true , address=185.167.204.206:4071 , piece_id=D3SV3RVHYGAU77TLBJNHBETNKILWBLOHOKCX5POSX36USLR7YT6A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.618165813 (265h23m58.315734129s) [noise=true , address=89.149.201.147:4008 , piece_id=JKTXCHUFHQQA5HLZU4MYASODZVSGXBTXKAFIHMEB4DZVZDSWGVKA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:10.964120185 (265h23m58.661688521s) [noise=true , address=81.171.14.70:4037 , piece_id=I574CDK3DF4VD6DNSU2EZVEZSXV7TXQLTDQ6PXOGNZ5NBS3WLG7A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.026637691 (265h23m58.724206017s) [noise=true , address=89.149.201.147:4017 , piece_id=WV2W3UABBSPQTLLCYXM2WAKP2I5BUFE4M4XD3WECWR7EBUEOYLHQ, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.033231919 (265h23m58.730800256s) [noise=true , address=89.149.201.147:4006 , piece_id=TYU2VBU2E4CBT4WA7LWBTSK6WMJNOY753UFSCLPRFNQUXUMGBXUA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.040392117 (265h23m58.737960453s) [noise=true , address=81.171.14.70:4043 , piece_id=WGFJVAFZ7U52TS35UNWIMB2NY66KOXYV5DEI5PCURD2D4VFWJXIA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: <nil> Dec 16 16:53:11.040410391 (265h23m58.737978737s) [seg_pos={0 0}, upload=233340]: Segment reached optimal threshold of 26 pieces. Dec 16 16:53:11.040665407 (265h23m58.738233743s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J): protocol: expected piece hash; context canceled; EOF Dec 16 16:53:11.040681107 (265h23m58.738249453s) [noise=true , address=89.149.201.147:4013 , piece_id=K3QBGLIOZ3LUYJV24CNESXAEJVSTM4BREEY2NTRNVBGZYTESTK4A, seg_pos={0 0}, upload=233340]: Long tail cancellation due to optimal threshold Dec 16 16:53:11.040938978 (265h23m58.738507314s) [noise=true , address=89.149.201.147:4019 , piece_id=QNHI7H4QBIYTA64JBQJKFPJEHK54WGHWEXOPTNME7ZFZ2FJNT7GA, seg_pos={0 0}, upload=233340]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2): protocol: expected piece hash; context canceled; EOF Dec 16 16:53:11.040951392 (265h23m58.738519727s) [noise=true , address=89.149.201.147:4019 , piece_id=QNHI7H4QBIYTA64JBQJKFPJEHK54WGHWEXOPTNME7ZFZ2FJNT7GA, seg_pos={0 0}, upload=233340]: Long tail cancellation due to optimal threshold Dec 16 16:53:11.041003759 (265h23m58.738572096s) [seg_pos={0 0}, upload=233340]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 16 16:53:11.041087015 (265h23m58.738655351s) [upload=233340]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 16 16:53:11.041093397 (265h23m58.738661733s) [upload=233340]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 16 16:54:06.282124914 (265h24m53.97969323s) [upload=233340]: Done uploading segments... Dec 16 16:54:06.282202999 (265h24m53.979771305s) [upload=233340]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.595714071s core uplink eu-select-1 eu1-placement-15

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)