Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.654203809s trace: https://jaeger.dev.storj.io/trace/19084e8d3cf2aae8 FAIL (2025-12-13 14:53:34 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708151385 (190h45m0.405719722s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708453380 (190h45m0.406021686s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708592289 (190h45m0.406160635s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708744243 (190h45m0.406312559s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708993619 (190h45m0.406561965s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709023485 (190h45m0.406591801s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709282308 (190h45m0.406850624s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709529339 (190h45m0.407097646s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709802660 (190h45m0.407370976s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.710052527 (190h45m0.407620833s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:13.180560502 (190h45m0.878128818s) [upload=167512]: Next returned nil segment Dec 13 14:14:13.180570781 (190h45m0.878139097s) [upload=167512]: Waiting for error group managing segments... Dec 13 14:14:13.346901236 (190h45m1.044469572s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349132333 (190h45m1.04670071s) [noise=true , address=185.167.204.205:4035 , piece_id=OPSRXVKUGC3AR4UNZ2NE2KR3IJIFFYEEGKJOYCEGLN3GKXDT6SHA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349252939 (190h45m1.046821285s) [noise=true , address=185.167.204.206:4043 , piece_id=JHOOH5DLKU2JKFMHEA4PRJ7D34HB3LRWUVDLTHFIUGOWX4TXRHUA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.350369674 (190h45m1.047938011s) [noise=true , address=185.167.204.206:4068 , piece_id=XUOIL7W3VRDX3SHVNKBFZ5JIIXBWULMY2PITDG22DTBQVZSGXYLA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.353825971 (190h45m1.051394318s) [noise=true , address=185.167.204.205:4006 , piece_id=YBXNX4FGALNOSBBNPU3SH2XRZUAB356LWMKAZ6DYI5XKPCOJ2IEA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.354886973 (190h45m1.052455309s) [noise=true , address=185.167.204.206:4060 , piece_id=22WIJIT3QKLZIK7TPG3QKRD6C2GKF44VIVAKPQFCWVX6ZLMFVTZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.355743614 (190h45m1.053311949s) [noise=true , address=185.167.204.206:4065 , piece_id=XQFKTLPSN2IDR23N43LS4KNAGKMQFH23BXY7ISSQT6IJ2ASPKWSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.356926985 (190h45m1.05449533s) [noise=true , address=185.167.204.206:4070 , piece_id=5HA3IAW4S64SUYEWIXRMOGF2UR5BPTOY7QR4PN5NYHIWQ4NG63BA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.357882078 (190h45m1.055450485s) [noise=true , address=185.167.204.206:4048 , piece_id=LEAXXSSHIFJU3TS5J3BQDIWXJ3C5XIWME4RNIT7BJ5IVAKTWO6BQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.359020014 (190h45m1.05658835s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.361154070 (190h45m1.058722407s) [noise=true , address=185.167.204.205:4019 , piece_id=YZAF4ZJT6LFSPIIWIK7XZJCB5WFAIO7RZEI4LUWSJWGHRQPKZPUQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.362240620 (190h45m1.059808946s) [noise=true , address=185.167.204.206:4046 , piece_id=JTH4RAAVDOV4ZWVD234M3FND3HGBN7AMR7OYRH6RT77NEKRHUXSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.364011889 (190h45m1.061580205s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.375789861 (190h45m1.073358196s) [noise=true , address=185.167.204.206:4041 , piece_id=GB54B2DACB4YEFK6M3IZB5SQ5DPPD35DNVIGCT3LZ25OIFPASMMQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.379015597 (190h45m1.076583903s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.381428725 (190h45m1.078997041s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.387461184 (190h45m1.085029489s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390251637 (190h45m1.087819963s) [noise=true , address=185.167.204.206:4050 , piece_id=BI7ZNHPGLKGI7AGBGLQLV4GOF566LNZAVIXUZEJF6Y4D53T6OTBA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390490352 (190h45m1.088058658s) [noise=true , address=185.167.204.205:4020 , piece_id=IIP6TB55BMI447B22NQSY7MUXRBWAPWAW43HOMHR5KCE3JNB7WZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.392613419 (190h45m1.090181725s) [noise=true , address=81.171.14.70:4025 , piece_id=KGFO6JJAWV3PGU2R5VWZFE6SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.403941520 (190h45m1.101509826s) [noise=true , address=185.167.204.205:4031 , piece_id=VQML3S4F6PYYCX3DG54Q54VIEWMIZRFHIWBGIELYDW3V6CJVDVKA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.404283930 (190h45m1.101852266s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.439393256 (190h45m1.136961592s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.461982804 (190h45m1.15955112s) [noise=true , address=89.149.201.147:4005 , piece_id=OMXI6IUWPJ4R5CF2NU35WBAOWP32S6VJY4NFSSGD3DEDV4JWR4CQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.866666394 (190h45m1.56423473s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876288660 (190h45m1.573856996s) [noise=true , address=81.171.14.70:4027 , piece_id=GFCC4YJ6WI45RQSA5UU22PI2DCHNKCOPJNWJXBUKDOFHU7CJAGAQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876310151 (190h45m1.573878486s) [seg_pos={0 0}, upload=167512]: Segment reached optimal threshold of 26 pieces. Dec 13 14:14:13.876577870 (190h45m1.574146207s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876587379 (190h45m1.574155724s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876711831 (190h45m1.574280167s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876726428 (190h45m1.574294774s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876765780 (190h45m1.574334117s) [seg_pos={0 0}, upload=167512]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 14:14:13.876880185 (190h45m1.574448522s) [upload=167512]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 14:14:13.876886387 (190h45m1.574454723s) [upload=167512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 14:14:39.731793972 (190h45m27.429362317s) [upload=167512]: Done uploading segments... Dec 13 14:14:39.731821442 (190h45m27.429389779s) [upload=167512]: Upload finished. err: <nil> Duration: 2.654225119s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.652336895s trace: https://jaeger.dev.storj.io/trace/19084e8d3cf2aae8 FAIL (2025-12-13 14:53:13 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708151385 (190h45m0.405719722s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708453380 (190h45m0.406021686s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708592289 (190h45m0.406160635s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708744243 (190h45m0.406312559s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708993619 (190h45m0.406561965s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709023485 (190h45m0.406591801s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709282308 (190h45m0.406850624s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709529339 (190h45m0.407097646s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709802660 (190h45m0.407370976s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.710052527 (190h45m0.407620833s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:13.180560502 (190h45m0.878128818s) [upload=167512]: Next returned nil segment Dec 13 14:14:13.180570781 (190h45m0.878139097s) [upload=167512]: Waiting for error group managing segments... Dec 13 14:14:13.346901236 (190h45m1.044469572s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349132333 (190h45m1.04670071s) [noise=true , address=185.167.204.205:4035 , piece_id=OPSRXVKUGC3AR4UNZ2NE2KR3IJIFFYEEGKJOYCEGLN3GKXDT6SHA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349252939 (190h45m1.046821285s) [noise=true , address=185.167.204.206:4043 , piece_id=JHOOH5DLKU2JKFMHEA4PRJ7D34HB3LRWUVDLTHFIUGOWX4TXRHUA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.350369674 (190h45m1.047938011s) [noise=true , address=185.167.204.206:4068 , piece_id=XUOIL7W3VRDX3SHVNKBFZ5JIIXBWULMY2PITDG22DTBQVZSGXYLA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.353825971 (190h45m1.051394318s) [noise=true , address=185.167.204.205:4006 , piece_id=YBXNX4FGALNOSBBNPU3SH2XRZUAB356LWMKAZ6DYI5XKPCOJ2IEA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.354886973 (190h45m1.052455309s) [noise=true , address=185.167.204.206:4060 , piece_id=22WIJIT3QKLZIK7TPG3QKRD6C2GKF44VIVAKPQFCWVX6ZLMFVTZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.355743614 (190h45m1.053311949s) [noise=true , address=185.167.204.206:4065 , piece_id=XQFKTLPSN2IDR23N43LS4KNAGKMQFH23BXY7ISSQT6IJ2ASPKWSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.356926985 (190h45m1.05449533s) [noise=true , address=185.167.204.206:4070 , piece_id=5HA3IAW4S64SUYEWIXRMOGF2UR5BPTOY7QR4PN5NYHIWQ4NG63BA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.357882078 (190h45m1.055450485s) [noise=true , address=185.167.204.206:4048 , piece_id=LEAXXSSHIFJU3TS5J3BQDIWXJ3C5XIWME4RNIT7BJ5IVAKTWO6BQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.359020014 (190h45m1.05658835s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.361154070 (190h45m1.058722407s) [noise=true , address=185.167.204.205:4019 , piece_id=YZAF4ZJT6LFSPIIWIK7XZJCB5WFAIO7RZEI4LUWSJWGHRQPKZPUQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.362240620 (190h45m1.059808946s) [noise=true , address=185.167.204.206:4046 , piece_id=JTH4RAAVDOV4ZWVD234M3FND3HGBN7AMR7OYRH6RT77NEKRHUXSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.364011889 (190h45m1.061580205s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.375789861 (190h45m1.073358196s) [noise=true , address=185.167.204.206:4041 , piece_id=GB54B2DACB4YEFK6M3IZB5SQ5DPPD35DNVIGCT3LZ25OIFPASMMQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.379015597 (190h45m1.076583903s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.381428725 (190h45m1.078997041s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.387461184 (190h45m1.085029489s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390251637 (190h45m1.087819963s) [noise=true , address=185.167.204.206:4050 , piece_id=BI7ZNHPGLKGI7AGBGLQLV4GOF566LNZAVIXUZEJF6Y4D53T6OTBA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390490352 (190h45m1.088058658s) [noise=true , address=185.167.204.205:4020 , piece_id=IIP6TB55BMI447B22NQSY7MUXRBWAPWAW43HOMHR5KCE3JNB7WZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.392613419 (190h45m1.090181725s) [noise=true , address=81.171.14.70:4025 , piece_id=KGFO6JJAWV3PGU2R5VWZFE6SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.403941520 (190h45m1.101509826s) [noise=true , address=185.167.204.205:4031 , piece_id=VQML3S4F6PYYCX3DG54Q54VIEWMIZRFHIWBGIELYDW3V6CJVDVKA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.404283930 (190h45m1.101852266s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.439393256 (190h45m1.136961592s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.461982804 (190h45m1.15955112s) [noise=true , address=89.149.201.147:4005 , piece_id=OMXI6IUWPJ4R5CF2NU35WBAOWP32S6VJY4NFSSGD3DEDV4JWR4CQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.866666394 (190h45m1.56423473s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876288660 (190h45m1.573856996s) [noise=true , address=81.171.14.70:4027 , piece_id=GFCC4YJ6WI45RQSA5UU22PI2DCHNKCOPJNWJXBUKDOFHU7CJAGAQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876310151 (190h45m1.573878486s) [seg_pos={0 0}, upload=167512]: Segment reached optimal threshold of 26 pieces. Dec 13 14:14:13.876577870 (190h45m1.574146207s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876587379 (190h45m1.574155724s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876711831 (190h45m1.574280167s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876726428 (190h45m1.574294774s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876765780 (190h45m1.574334117s) [seg_pos={0 0}, upload=167512]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 14:14:13.876880185 (190h45m1.574448522s) [upload=167512]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 14:14:13.876886387 (190h45m1.574454723s) [upload=167512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 14:14:39.731793972 (190h45m27.429362317s) [upload=167512]: Done uploading segments... Dec 13 14:14:39.731821442 (190h45m27.429389779s) [upload=167512]: Upload finished. err: <nil> Duration: 2.652364978s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 4 out of 60 is failed (threshold=3) [............X.........XX..........X.........................] duration: 3.574983045s trace: https://jaeger.dev.storj.io/trace/14df685fb176a112 FAIL (2025-12-13 14:52:51 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.574995939s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 3.141187039s trace: https://jaeger.dev.storj.io/trace/19084e8d3cf2aae8 FAIL (2025-12-13 14:52:42 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708151385 (190h45m0.405719722s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708453380 (190h45m0.406021686s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708592289 (190h45m0.406160635s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708744243 (190h45m0.406312559s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708993619 (190h45m0.406561965s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709023485 (190h45m0.406591801s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709282308 (190h45m0.406850624s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709529339 (190h45m0.407097646s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709802660 (190h45m0.407370976s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.710052527 (190h45m0.407620833s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:13.180560502 (190h45m0.878128818s) [upload=167512]: Next returned nil segment Dec 13 14:14:13.180570781 (190h45m0.878139097s) [upload=167512]: Waiting for error group managing segments... Dec 13 14:14:13.346901236 (190h45m1.044469572s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349132333 (190h45m1.04670071s) [noise=true , address=185.167.204.205:4035 , piece_id=OPSRXVKUGC3AR4UNZ2NE2KR3IJIFFYEEGKJOYCEGLN3GKXDT6SHA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349252939 (190h45m1.046821285s) [noise=true , address=185.167.204.206:4043 , piece_id=JHOOH5DLKU2JKFMHEA4PRJ7D34HB3LRWUVDLTHFIUGOWX4TXRHUA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.350369674 (190h45m1.047938011s) [noise=true , address=185.167.204.206:4068 , piece_id=XUOIL7W3VRDX3SHVNKBFZ5JIIXBWULMY2PITDG22DTBQVZSGXYLA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.353825971 (190h45m1.051394318s) [noise=true , address=185.167.204.205:4006 , piece_id=YBXNX4FGALNOSBBNPU3SH2XRZUAB356LWMKAZ6DYI5XKPCOJ2IEA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.354886973 (190h45m1.052455309s) [noise=true , address=185.167.204.206:4060 , piece_id=22WIJIT3QKLZIK7TPG3QKRD6C2GKF44VIVAKPQFCWVX6ZLMFVTZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.355743614 (190h45m1.053311949s) [noise=true , address=185.167.204.206:4065 , piece_id=XQFKTLPSN2IDR23N43LS4KNAGKMQFH23BXY7ISSQT6IJ2ASPKWSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.356926985 (190h45m1.05449533s) [noise=true , address=185.167.204.206:4070 , piece_id=5HA3IAW4S64SUYEWIXRMOGF2UR5BPTOY7QR4PN5NYHIWQ4NG63BA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.357882078 (190h45m1.055450485s) [noise=true , address=185.167.204.206:4048 , piece_id=LEAXXSSHIFJU3TS5J3BQDIWXJ3C5XIWME4RNIT7BJ5IVAKTWO6BQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.359020014 (190h45m1.05658835s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.361154070 (190h45m1.058722407s) [noise=true , address=185.167.204.205:4019 , piece_id=YZAF4ZJT6LFSPIIWIK7XZJCB5WFAIO7RZEI4LUWSJWGHRQPKZPUQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.362240620 (190h45m1.059808946s) [noise=true , address=185.167.204.206:4046 , piece_id=JTH4RAAVDOV4ZWVD234M3FND3HGBN7AMR7OYRH6RT77NEKRHUXSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.364011889 (190h45m1.061580205s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.375789861 (190h45m1.073358196s) [noise=true , address=185.167.204.206:4041 , piece_id=GB54B2DACB4YEFK6M3IZB5SQ5DPPD35DNVIGCT3LZ25OIFPASMMQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.379015597 (190h45m1.076583903s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.381428725 (190h45m1.078997041s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.387461184 (190h45m1.085029489s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390251637 (190h45m1.087819963s) [noise=true , address=185.167.204.206:4050 , piece_id=BI7ZNHPGLKGI7AGBGLQLV4GOF566LNZAVIXUZEJF6Y4D53T6OTBA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390490352 (190h45m1.088058658s) [noise=true , address=185.167.204.205:4020 , piece_id=IIP6TB55BMI447B22NQSY7MUXRBWAPWAW43HOMHR5KCE3JNB7WZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.392613419 (190h45m1.090181725s) [noise=true , address=81.171.14.70:4025 , piece_id=KGFO6JJAWV3PGU2R5VWZFE6SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.403941520 (190h45m1.101509826s) [noise=true , address=185.167.204.205:4031 , piece_id=VQML3S4F6PYYCX3DG54Q54VIEWMIZRFHIWBGIELYDW3V6CJVDVKA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.404283930 (190h45m1.101852266s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.439393256 (190h45m1.136961592s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.461982804 (190h45m1.15955112s) [noise=true , address=89.149.201.147:4005 , piece_id=OMXI6IUWPJ4R5CF2NU35WBAOWP32S6VJY4NFSSGD3DEDV4JWR4CQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.866666394 (190h45m1.56423473s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876288660 (190h45m1.573856996s) [noise=true , address=81.171.14.70:4027 , piece_id=GFCC4YJ6WI45RQSA5UU22PI2DCHNKCOPJNWJXBUKDOFHU7CJAGAQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876310151 (190h45m1.573878486s) [seg_pos={0 0}, upload=167512]: Segment reached optimal threshold of 26 pieces. Dec 13 14:14:13.876577870 (190h45m1.574146207s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876587379 (190h45m1.574155724s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876711831 (190h45m1.574280167s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876726428 (190h45m1.574294774s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876765780 (190h45m1.574334117s) [seg_pos={0 0}, upload=167512]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 14:14:13.876880185 (190h45m1.574448522s) [upload=167512]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 14:14:13.876886387 (190h45m1.574454723s) [upload=167512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 14:14:39.731793972 (190h45m27.429362317s) [upload=167512]: Done uploading segments... Dec 13 14:14:39.731821442 (190h45m27.429389779s) [upload=167512]: Upload finished. err: <nil> Duration: 3.141210172s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 5.79269814s trace: https://jaeger.dev.storj.io/trace/197d5bf95cf2aac7 FAIL (2025-12-13 14:52:39 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 5.792717757s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.765051479s trace: https://jaeger.dev.storj.io/trace/19084e8d3cf2aae8 FAIL (2025-12-13 14:52:14 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708151385 (190h45m0.405719722s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708453380 (190h45m0.406021686s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708592289 (190h45m0.406160635s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708744243 (190h45m0.406312559s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708993619 (190h45m0.406561965s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709023485 (190h45m0.406591801s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709282308 (190h45m0.406850624s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709529339 (190h45m0.407097646s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709802660 (190h45m0.407370976s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.710052527 (190h45m0.407620833s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:13.180560502 (190h45m0.878128818s) [upload=167512]: Next returned nil segment Dec 13 14:14:13.180570781 (190h45m0.878139097s) [upload=167512]: Waiting for error group managing segments... Dec 13 14:14:13.346901236 (190h45m1.044469572s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349132333 (190h45m1.04670071s) [noise=true , address=185.167.204.205:4035 , piece_id=OPSRXVKUGC3AR4UNZ2NE2KR3IJIFFYEEGKJOYCEGLN3GKXDT6SHA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349252939 (190h45m1.046821285s) [noise=true , address=185.167.204.206:4043 , piece_id=JHOOH5DLKU2JKFMHEA4PRJ7D34HB3LRWUVDLTHFIUGOWX4TXRHUA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.350369674 (190h45m1.047938011s) [noise=true , address=185.167.204.206:4068 , piece_id=XUOIL7W3VRDX3SHVNKBFZ5JIIXBWULMY2PITDG22DTBQVZSGXYLA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.353825971 (190h45m1.051394318s) [noise=true , address=185.167.204.205:4006 , piece_id=YBXNX4FGALNOSBBNPU3SH2XRZUAB356LWMKAZ6DYI5XKPCOJ2IEA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.354886973 (190h45m1.052455309s) [noise=true , address=185.167.204.206:4060 , piece_id=22WIJIT3QKLZIK7TPG3QKRD6C2GKF44VIVAKPQFCWVX6ZLMFVTZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.355743614 (190h45m1.053311949s) [noise=true , address=185.167.204.206:4065 , piece_id=XQFKTLPSN2IDR23N43LS4KNAGKMQFH23BXY7ISSQT6IJ2ASPKWSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.356926985 (190h45m1.05449533s) [noise=true , address=185.167.204.206:4070 , piece_id=5HA3IAW4S64SUYEWIXRMOGF2UR5BPTOY7QR4PN5NYHIWQ4NG63BA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.357882078 (190h45m1.055450485s) [noise=true , address=185.167.204.206:4048 , piece_id=LEAXXSSHIFJU3TS5J3BQDIWXJ3C5XIWME4RNIT7BJ5IVAKTWO6BQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.359020014 (190h45m1.05658835s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.361154070 (190h45m1.058722407s) [noise=true , address=185.167.204.205:4019 , piece_id=YZAF4ZJT6LFSPIIWIK7XZJCB5WFAIO7RZEI4LUWSJWGHRQPKZPUQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.362240620 (190h45m1.059808946s) [noise=true , address=185.167.204.206:4046 , piece_id=JTH4RAAVDOV4ZWVD234M3FND3HGBN7AMR7OYRH6RT77NEKRHUXSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.364011889 (190h45m1.061580205s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.375789861 (190h45m1.073358196s) [noise=true , address=185.167.204.206:4041 , piece_id=GB54B2DACB4YEFK6M3IZB5SQ5DPPD35DNVIGCT3LZ25OIFPASMMQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.379015597 (190h45m1.076583903s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.381428725 (190h45m1.078997041s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.387461184 (190h45m1.085029489s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390251637 (190h45m1.087819963s) [noise=true , address=185.167.204.206:4050 , piece_id=BI7ZNHPGLKGI7AGBGLQLV4GOF566LNZAVIXUZEJF6Y4D53T6OTBA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390490352 (190h45m1.088058658s) [noise=true , address=185.167.204.205:4020 , piece_id=IIP6TB55BMI447B22NQSY7MUXRBWAPWAW43HOMHR5KCE3JNB7WZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.392613419 (190h45m1.090181725s) [noise=true , address=81.171.14.70:4025 , piece_id=KGFO6JJAWV3PGU2R5VWZFE6SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.403941520 (190h45m1.101509826s) [noise=true , address=185.167.204.205:4031 , piece_id=VQML3S4F6PYYCX3DG54Q54VIEWMIZRFHIWBGIELYDW3V6CJVDVKA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.404283930 (190h45m1.101852266s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.439393256 (190h45m1.136961592s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.461982804 (190h45m1.15955112s) [noise=true , address=89.149.201.147:4005 , piece_id=OMXI6IUWPJ4R5CF2NU35WBAOWP32S6VJY4NFSSGD3DEDV4JWR4CQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.866666394 (190h45m1.56423473s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876288660 (190h45m1.573856996s) [noise=true , address=81.171.14.70:4027 , piece_id=GFCC4YJ6WI45RQSA5UU22PI2DCHNKCOPJNWJXBUKDOFHU7CJAGAQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876310151 (190h45m1.573878486s) [seg_pos={0 0}, upload=167512]: Segment reached optimal threshold of 26 pieces. Dec 13 14:14:13.876577870 (190h45m1.574146207s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876587379 (190h45m1.574155724s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876711831 (190h45m1.574280167s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876726428 (190h45m1.574294774s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876765780 (190h45m1.574334117s) [seg_pos={0 0}, upload=167512]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 14:14:13.876880185 (190h45m1.574448522s) [upload=167512]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 14:14:13.876886387 (190h45m1.574454723s) [upload=167512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 14:14:39.731793972 (190h45m27.429362317s) [upload=167512]: Done uploading segments... Dec 13 14:14:39.731821442 (190h45m27.429389779s) [upload=167512]: Upload finished. err: <nil> Duration: 2.76507311s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 1.00015663s trace: https://jaeger.dev.storj.io/trace/197d5bf95cf2aac7 FAIL (2025-12-13 14:52:14 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 1.000193038s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.............X.........XX..........X........................] duration: 2.808041805s trace: https://jaeger.dev.storj.io/trace/14df685fb176a112 FAIL (2025-12-13 14:52:03 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.80806537s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 969.084095ms trace: https://jaeger.dev.storj.io/trace/197d5bf95cf2aac7 FAIL (2025-12-13 14:51:28 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 969.103962ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.233862387s trace: https://jaeger.dev.storj.io/trace/19084e8d3cf2aae8 FAIL (2025-12-13 14:51:01 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708151385 (190h45m0.405719722s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708453380 (190h45m0.406021686s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708592289 (190h45m0.406160635s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708744243 (190h45m0.406312559s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708993619 (190h45m0.406561965s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709023485 (190h45m0.406591801s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709282308 (190h45m0.406850624s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709529339 (190h45m0.407097646s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709802660 (190h45m0.407370976s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.710052527 (190h45m0.407620833s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:13.180560502 (190h45m0.878128818s) [upload=167512]: Next returned nil segment Dec 13 14:14:13.180570781 (190h45m0.878139097s) [upload=167512]: Waiting for error group managing segments... Dec 13 14:14:13.346901236 (190h45m1.044469572s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349132333 (190h45m1.04670071s) [noise=true , address=185.167.204.205:4035 , piece_id=OPSRXVKUGC3AR4UNZ2NE2KR3IJIFFYEEGKJOYCEGLN3GKXDT6SHA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349252939 (190h45m1.046821285s) [noise=true , address=185.167.204.206:4043 , piece_id=JHOOH5DLKU2JKFMHEA4PRJ7D34HB3LRWUVDLTHFIUGOWX4TXRHUA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.350369674 (190h45m1.047938011s) [noise=true , address=185.167.204.206:4068 , piece_id=XUOIL7W3VRDX3SHVNKBFZ5JIIXBWULMY2PITDG22DTBQVZSGXYLA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.353825971 (190h45m1.051394318s) [noise=true , address=185.167.204.205:4006 , piece_id=YBXNX4FGALNOSBBNPU3SH2XRZUAB356LWMKAZ6DYI5XKPCOJ2IEA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.354886973 (190h45m1.052455309s) [noise=true , address=185.167.204.206:4060 , piece_id=22WIJIT3QKLZIK7TPG3QKRD6C2GKF44VIVAKPQFCWVX6ZLMFVTZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.355743614 (190h45m1.053311949s) [noise=true , address=185.167.204.206:4065 , piece_id=XQFKTLPSN2IDR23N43LS4KNAGKMQFH23BXY7ISSQT6IJ2ASPKWSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.356926985 (190h45m1.05449533s) [noise=true , address=185.167.204.206:4070 , piece_id=5HA3IAW4S64SUYEWIXRMOGF2UR5BPTOY7QR4PN5NYHIWQ4NG63BA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.357882078 (190h45m1.055450485s) [noise=true , address=185.167.204.206:4048 , piece_id=LEAXXSSHIFJU3TS5J3BQDIWXJ3C5XIWME4RNIT7BJ5IVAKTWO6BQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.359020014 (190h45m1.05658835s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.361154070 (190h45m1.058722407s) [noise=true , address=185.167.204.205:4019 , piece_id=YZAF4ZJT6LFSPIIWIK7XZJCB5WFAIO7RZEI4LUWSJWGHRQPKZPUQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.362240620 (190h45m1.059808946s) [noise=true , address=185.167.204.206:4046 , piece_id=JTH4RAAVDOV4ZWVD234M3FND3HGBN7AMR7OYRH6RT77NEKRHUXSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.364011889 (190h45m1.061580205s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.375789861 (190h45m1.073358196s) [noise=true , address=185.167.204.206:4041 , piece_id=GB54B2DACB4YEFK6M3IZB5SQ5DPPD35DNVIGCT3LZ25OIFPASMMQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.379015597 (190h45m1.076583903s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.381428725 (190h45m1.078997041s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.387461184 (190h45m1.085029489s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390251637 (190h45m1.087819963s) [noise=true , address=185.167.204.206:4050 , piece_id=BI7ZNHPGLKGI7AGBGLQLV4GOF566LNZAVIXUZEJF6Y4D53T6OTBA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390490352 (190h45m1.088058658s) [noise=true , address=185.167.204.205:4020 , piece_id=IIP6TB55BMI447B22NQSY7MUXRBWAPWAW43HOMHR5KCE3JNB7WZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.392613419 (190h45m1.090181725s) [noise=true , address=81.171.14.70:4025 , piece_id=KGFO6JJAWV3PGU2R5VWZFE6SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.403941520 (190h45m1.101509826s) [noise=true , address=185.167.204.205:4031 , piece_id=VQML3S4F6PYYCX3DG54Q54VIEWMIZRFHIWBGIELYDW3V6CJVDVKA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.404283930 (190h45m1.101852266s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.439393256 (190h45m1.136961592s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.461982804 (190h45m1.15955112s) [noise=true , address=89.149.201.147:4005 , piece_id=OMXI6IUWPJ4R5CF2NU35WBAOWP32S6VJY4NFSSGD3DEDV4JWR4CQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.866666394 (190h45m1.56423473s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876288660 (190h45m1.573856996s) [noise=true , address=81.171.14.70:4027 , piece_id=GFCC4YJ6WI45RQSA5UU22PI2DCHNKCOPJNWJXBUKDOFHU7CJAGAQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876310151 (190h45m1.573878486s) [seg_pos={0 0}, upload=167512]: Segment reached optimal threshold of 26 pieces. Dec 13 14:14:13.876577870 (190h45m1.574146207s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876587379 (190h45m1.574155724s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876711831 (190h45m1.574280167s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876726428 (190h45m1.574294774s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876765780 (190h45m1.574334117s) [seg_pos={0 0}, upload=167512]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 14:14:13.876880185 (190h45m1.574448522s) [upload=167512]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 14:14:13.876886387 (190h45m1.574454723s) [upload=167512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 14:14:39.731793972 (190h45m27.429362317s) [upload=167512]: Done uploading segments... Dec 13 14:14:39.731821442 (190h45m27.429389779s) [upload=167512]: Upload finished. err: <nil> Duration: 2.23387459s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..............X.........XX..........X.......................] duration: 2.736452914s trace: https://jaeger.dev.storj.io/trace/14df685fb176a112 FAIL (2025-12-13 14:50:59 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.736470928s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 961.672269ms trace: https://jaeger.dev.storj.io/trace/197d5bf95cf2aac7 FAIL (2025-12-13 14:50:46 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 961.702044ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 4 out of 60 is failed (threshold=3) [...............X.........XX..........X......................] duration: 12.18685719s trace: https://jaeger.dev.storj.io/trace/14df685fb176a112 FAIL (2025-12-13 14:50:21 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 12.186876647s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 889.883672ms trace: https://jaeger.dev.storj.io/trace/197d5bf95cf2aac7 FAIL (2025-12-13 14:50:11 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 889.895624ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.212080979s trace: https://jaeger.dev.storj.io/trace/19084e8d3cf2aae8 FAIL (2025-12-13 14:49:49 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708151385 (190h45m0.405719722s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708453380 (190h45m0.406021686s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708592289 (190h45m0.406160635s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708744243 (190h45m0.406312559s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708993619 (190h45m0.406561965s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709023485 (190h45m0.406591801s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709282308 (190h45m0.406850624s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709529339 (190h45m0.407097646s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709802660 (190h45m0.407370976s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.710052527 (190h45m0.407620833s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:13.180560502 (190h45m0.878128818s) [upload=167512]: Next returned nil segment Dec 13 14:14:13.180570781 (190h45m0.878139097s) [upload=167512]: Waiting for error group managing segments... Dec 13 14:14:13.346901236 (190h45m1.044469572s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349132333 (190h45m1.04670071s) [noise=true , address=185.167.204.205:4035 , piece_id=OPSRXVKUGC3AR4UNZ2NE2KR3IJIFFYEEGKJOYCEGLN3GKXDT6SHA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349252939 (190h45m1.046821285s) [noise=true , address=185.167.204.206:4043 , piece_id=JHOOH5DLKU2JKFMHEA4PRJ7D34HB3LRWUVDLTHFIUGOWX4TXRHUA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.350369674 (190h45m1.047938011s) [noise=true , address=185.167.204.206:4068 , piece_id=XUOIL7W3VRDX3SHVNKBFZ5JIIXBWULMY2PITDG22DTBQVZSGXYLA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.353825971 (190h45m1.051394318s) [noise=true , address=185.167.204.205:4006 , piece_id=YBXNX4FGALNOSBBNPU3SH2XRZUAB356LWMKAZ6DYI5XKPCOJ2IEA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.354886973 (190h45m1.052455309s) [noise=true , address=185.167.204.206:4060 , piece_id=22WIJIT3QKLZIK7TPG3QKRD6C2GKF44VIVAKPQFCWVX6ZLMFVTZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.355743614 (190h45m1.053311949s) [noise=true , address=185.167.204.206:4065 , piece_id=XQFKTLPSN2IDR23N43LS4KNAGKMQFH23BXY7ISSQT6IJ2ASPKWSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.356926985 (190h45m1.05449533s) [noise=true , address=185.167.204.206:4070 , piece_id=5HA3IAW4S64SUYEWIXRMOGF2UR5BPTOY7QR4PN5NYHIWQ4NG63BA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.357882078 (190h45m1.055450485s) [noise=true , address=185.167.204.206:4048 , piece_id=LEAXXSSHIFJU3TS5J3BQDIWXJ3C5XIWME4RNIT7BJ5IVAKTWO6BQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.359020014 (190h45m1.05658835s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.361154070 (190h45m1.058722407s) [noise=true , address=185.167.204.205:4019 , piece_id=YZAF4ZJT6LFSPIIWIK7XZJCB5WFAIO7RZEI4LUWSJWGHRQPKZPUQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.362240620 (190h45m1.059808946s) [noise=true , address=185.167.204.206:4046 , piece_id=JTH4RAAVDOV4ZWVD234M3FND3HGBN7AMR7OYRH6RT77NEKRHUXSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.364011889 (190h45m1.061580205s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.375789861 (190h45m1.073358196s) [noise=true , address=185.167.204.206:4041 , piece_id=GB54B2DACB4YEFK6M3IZB5SQ5DPPD35DNVIGCT3LZ25OIFPASMMQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.379015597 (190h45m1.076583903s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.381428725 (190h45m1.078997041s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.387461184 (190h45m1.085029489s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390251637 (190h45m1.087819963s) [noise=true , address=185.167.204.206:4050 , piece_id=BI7ZNHPGLKGI7AGBGLQLV4GOF566LNZAVIXUZEJF6Y4D53T6OTBA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390490352 (190h45m1.088058658s) [noise=true , address=185.167.204.205:4020 , piece_id=IIP6TB55BMI447B22NQSY7MUXRBWAPWAW43HOMHR5KCE3JNB7WZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.392613419 (190h45m1.090181725s) [noise=true , address=81.171.14.70:4025 , piece_id=KGFO6JJAWV3PGU2R5VWZFE6SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.403941520 (190h45m1.101509826s) [noise=true , address=185.167.204.205:4031 , piece_id=VQML3S4F6PYYCX3DG54Q54VIEWMIZRFHIWBGIELYDW3V6CJVDVKA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.404283930 (190h45m1.101852266s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.439393256 (190h45m1.136961592s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.461982804 (190h45m1.15955112s) [noise=true , address=89.149.201.147:4005 , piece_id=OMXI6IUWPJ4R5CF2NU35WBAOWP32S6VJY4NFSSGD3DEDV4JWR4CQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.866666394 (190h45m1.56423473s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876288660 (190h45m1.573856996s) [noise=true , address=81.171.14.70:4027 , piece_id=GFCC4YJ6WI45RQSA5UU22PI2DCHNKCOPJNWJXBUKDOFHU7CJAGAQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876310151 (190h45m1.573878486s) [seg_pos={0 0}, upload=167512]: Segment reached optimal threshold of 26 pieces. Dec 13 14:14:13.876577870 (190h45m1.574146207s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876587379 (190h45m1.574155724s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876711831 (190h45m1.574280167s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876726428 (190h45m1.574294774s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876765780 (190h45m1.574334117s) [seg_pos={0 0}, upload=167512]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 14:14:13.876880185 (190h45m1.574448522s) [upload=167512]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 14:14:13.876886387 (190h45m1.574454723s) [upload=167512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 14:14:39.731793972 (190h45m27.429362317s) [upload=167512]: Done uploading segments... Dec 13 14:14:39.731821442 (190h45m27.429389779s) [upload=167512]: Upload finished. err: <nil> Duration: 2.212101506s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 1.001511599s trace: https://jaeger.dev.storj.io/trace/197d5bf95cf2aac7 FAIL (2025-12-13 14:49:35 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 1.00153365s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 4 out of 60 is failed (threshold=3) [................X.........XX..........X.....................] duration: 2.792971505s trace: https://jaeger.dev.storj.io/trace/14df685fb176a112 FAIL (2025-12-13 14:49:21 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.792993826s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.................X.........XX..........X....................] duration: 2.734151655s trace: https://jaeger.dev.storj.io/trace/14df685fb176a112 FAIL (2025-12-13 14:48:54 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.734169729s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 883.521657ms trace: https://jaeger.dev.storj.io/trace/197d5bf95cf2aac7 FAIL (2025-12-13 14:48:54 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 883.533429ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.155142515s trace: https://jaeger.dev.storj.io/trace/19084e8d3cf2aae8 FAIL (2025-12-13 14:48:50 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708151385 (190h45m0.405719722s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708453380 (190h45m0.406021686s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708592289 (190h45m0.406160635s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708744243 (190h45m0.406312559s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708993619 (190h45m0.406561965s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709023485 (190h45m0.406591801s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709282308 (190h45m0.406850624s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709529339 (190h45m0.407097646s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709802660 (190h45m0.407370976s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.710052527 (190h45m0.407620833s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:13.180560502 (190h45m0.878128818s) [upload=167512]: Next returned nil segment Dec 13 14:14:13.180570781 (190h45m0.878139097s) [upload=167512]: Waiting for error group managing segments... Dec 13 14:14:13.346901236 (190h45m1.044469572s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349132333 (190h45m1.04670071s) [noise=true , address=185.167.204.205:4035 , piece_id=OPSRXVKUGC3AR4UNZ2NE2KR3IJIFFYEEGKJOYCEGLN3GKXDT6SHA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349252939 (190h45m1.046821285s) [noise=true , address=185.167.204.206:4043 , piece_id=JHOOH5DLKU2JKFMHEA4PRJ7D34HB3LRWUVDLTHFIUGOWX4TXRHUA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.350369674 (190h45m1.047938011s) [noise=true , address=185.167.204.206:4068 , piece_id=XUOIL7W3VRDX3SHVNKBFZ5JIIXBWULMY2PITDG22DTBQVZSGXYLA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.353825971 (190h45m1.051394318s) [noise=true , address=185.167.204.205:4006 , piece_id=YBXNX4FGALNOSBBNPU3SH2XRZUAB356LWMKAZ6DYI5XKPCOJ2IEA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.354886973 (190h45m1.052455309s) [noise=true , address=185.167.204.206:4060 , piece_id=22WIJIT3QKLZIK7TPG3QKRD6C2GKF44VIVAKPQFCWVX6ZLMFVTZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.355743614 (190h45m1.053311949s) [noise=true , address=185.167.204.206:4065 , piece_id=XQFKTLPSN2IDR23N43LS4KNAGKMQFH23BXY7ISSQT6IJ2ASPKWSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.356926985 (190h45m1.05449533s) [noise=true , address=185.167.204.206:4070 , piece_id=5HA3IAW4S64SUYEWIXRMOGF2UR5BPTOY7QR4PN5NYHIWQ4NG63BA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.357882078 (190h45m1.055450485s) [noise=true , address=185.167.204.206:4048 , piece_id=LEAXXSSHIFJU3TS5J3BQDIWXJ3C5XIWME4RNIT7BJ5IVAKTWO6BQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.359020014 (190h45m1.05658835s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.361154070 (190h45m1.058722407s) [noise=true , address=185.167.204.205:4019 , piece_id=YZAF4ZJT6LFSPIIWIK7XZJCB5WFAIO7RZEI4LUWSJWGHRQPKZPUQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.362240620 (190h45m1.059808946s) [noise=true , address=185.167.204.206:4046 , piece_id=JTH4RAAVDOV4ZWVD234M3FND3HGBN7AMR7OYRH6RT77NEKRHUXSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.364011889 (190h45m1.061580205s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.375789861 (190h45m1.073358196s) [noise=true , address=185.167.204.206:4041 , piece_id=GB54B2DACB4YEFK6M3IZB5SQ5DPPD35DNVIGCT3LZ25OIFPASMMQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.379015597 (190h45m1.076583903s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.381428725 (190h45m1.078997041s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.387461184 (190h45m1.085029489s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390251637 (190h45m1.087819963s) [noise=true , address=185.167.204.206:4050 , piece_id=BI7ZNHPGLKGI7AGBGLQLV4GOF566LNZAVIXUZEJF6Y4D53T6OTBA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390490352 (190h45m1.088058658s) [noise=true , address=185.167.204.205:4020 , piece_id=IIP6TB55BMI447B22NQSY7MUXRBWAPWAW43HOMHR5KCE3JNB7WZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.392613419 (190h45m1.090181725s) [noise=true , address=81.171.14.70:4025 , piece_id=KGFO6JJAWV3PGU2R5VWZFE6SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.403941520 (190h45m1.101509826s) [noise=true , address=185.167.204.205:4031 , piece_id=VQML3S4F6PYYCX3DG54Q54VIEWMIZRFHIWBGIELYDW3V6CJVDVKA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.404283930 (190h45m1.101852266s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.439393256 (190h45m1.136961592s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.461982804 (190h45m1.15955112s) [noise=true , address=89.149.201.147:4005 , piece_id=OMXI6IUWPJ4R5CF2NU35WBAOWP32S6VJY4NFSSGD3DEDV4JWR4CQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.866666394 (190h45m1.56423473s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876288660 (190h45m1.573856996s) [noise=true , address=81.171.14.70:4027 , piece_id=GFCC4YJ6WI45RQSA5UU22PI2DCHNKCOPJNWJXBUKDOFHU7CJAGAQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876310151 (190h45m1.573878486s) [seg_pos={0 0}, upload=167512]: Segment reached optimal threshold of 26 pieces. Dec 13 14:14:13.876577870 (190h45m1.574146207s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876587379 (190h45m1.574155724s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876711831 (190h45m1.574280167s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876726428 (190h45m1.574294774s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876765780 (190h45m1.574334117s) [seg_pos={0 0}, upload=167512]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 14:14:13.876880185 (190h45m1.574448522s) [upload=167512]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 14:14:13.876886387 (190h45m1.574454723s) [upload=167512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 14:14:39.731793972 (190h45m27.429362317s) [upload=167512]: Done uploading segments... Dec 13 14:14:39.731821442 (190h45m27.429389779s) [upload=167512]: Upload finished. err: <nil> Duration: 2.155160007s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.656737478s trace: https://jaeger.dev.storj.io/trace/19084e8d3cf2aae8 FAIL (2025-12-13 14:48:14 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708151385 (190h45m0.405719722s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708453380 (190h45m0.406021686s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708592289 (190h45m0.406160635s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708744243 (190h45m0.406312559s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708993619 (190h45m0.406561965s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709023485 (190h45m0.406591801s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709282308 (190h45m0.406850624s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709529339 (190h45m0.407097646s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709802660 (190h45m0.407370976s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.710052527 (190h45m0.407620833s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:13.180560502 (190h45m0.878128818s) [upload=167512]: Next returned nil segment Dec 13 14:14:13.180570781 (190h45m0.878139097s) [upload=167512]: Waiting for error group managing segments... Dec 13 14:14:13.346901236 (190h45m1.044469572s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349132333 (190h45m1.04670071s) [noise=true , address=185.167.204.205:4035 , piece_id=OPSRXVKUGC3AR4UNZ2NE2KR3IJIFFYEEGKJOYCEGLN3GKXDT6SHA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349252939 (190h45m1.046821285s) [noise=true , address=185.167.204.206:4043 , piece_id=JHOOH5DLKU2JKFMHEA4PRJ7D34HB3LRWUVDLTHFIUGOWX4TXRHUA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.350369674 (190h45m1.047938011s) [noise=true , address=185.167.204.206:4068 , piece_id=XUOIL7W3VRDX3SHVNKBFZ5JIIXBWULMY2PITDG22DTBQVZSGXYLA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.353825971 (190h45m1.051394318s) [noise=true , address=185.167.204.205:4006 , piece_id=YBXNX4FGALNOSBBNPU3SH2XRZUAB356LWMKAZ6DYI5XKPCOJ2IEA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.354886973 (190h45m1.052455309s) [noise=true , address=185.167.204.206:4060 , piece_id=22WIJIT3QKLZIK7TPG3QKRD6C2GKF44VIVAKPQFCWVX6ZLMFVTZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.355743614 (190h45m1.053311949s) [noise=true , address=185.167.204.206:4065 , piece_id=XQFKTLPSN2IDR23N43LS4KNAGKMQFH23BXY7ISSQT6IJ2ASPKWSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.356926985 (190h45m1.05449533s) [noise=true , address=185.167.204.206:4070 , piece_id=5HA3IAW4S64SUYEWIXRMOGF2UR5BPTOY7QR4PN5NYHIWQ4NG63BA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.357882078 (190h45m1.055450485s) [noise=true , address=185.167.204.206:4048 , piece_id=LEAXXSSHIFJU3TS5J3BQDIWXJ3C5XIWME4RNIT7BJ5IVAKTWO6BQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.359020014 (190h45m1.05658835s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.361154070 (190h45m1.058722407s) [noise=true , address=185.167.204.205:4019 , piece_id=YZAF4ZJT6LFSPIIWIK7XZJCB5WFAIO7RZEI4LUWSJWGHRQPKZPUQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.362240620 (190h45m1.059808946s) [noise=true , address=185.167.204.206:4046 , piece_id=JTH4RAAVDOV4ZWVD234M3FND3HGBN7AMR7OYRH6RT77NEKRHUXSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.364011889 (190h45m1.061580205s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.375789861 (190h45m1.073358196s) [noise=true , address=185.167.204.206:4041 , piece_id=GB54B2DACB4YEFK6M3IZB5SQ5DPPD35DNVIGCT3LZ25OIFPASMMQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.379015597 (190h45m1.076583903s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.381428725 (190h45m1.078997041s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.387461184 (190h45m1.085029489s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390251637 (190h45m1.087819963s) [noise=true , address=185.167.204.206:4050 , piece_id=BI7ZNHPGLKGI7AGBGLQLV4GOF566LNZAVIXUZEJF6Y4D53T6OTBA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390490352 (190h45m1.088058658s) [noise=true , address=185.167.204.205:4020 , piece_id=IIP6TB55BMI447B22NQSY7MUXRBWAPWAW43HOMHR5KCE3JNB7WZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.392613419 (190h45m1.090181725s) [noise=true , address=81.171.14.70:4025 , piece_id=KGFO6JJAWV3PGU2R5VWZFE6SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.403941520 (190h45m1.101509826s) [noise=true , address=185.167.204.205:4031 , piece_id=VQML3S4F6PYYCX3DG54Q54VIEWMIZRFHIWBGIELYDW3V6CJVDVKA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.404283930 (190h45m1.101852266s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.439393256 (190h45m1.136961592s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.461982804 (190h45m1.15955112s) [noise=true , address=89.149.201.147:4005 , piece_id=OMXI6IUWPJ4R5CF2NU35WBAOWP32S6VJY4NFSSGD3DEDV4JWR4CQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.866666394 (190h45m1.56423473s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876288660 (190h45m1.573856996s) [noise=true , address=81.171.14.70:4027 , piece_id=GFCC4YJ6WI45RQSA5UU22PI2DCHNKCOPJNWJXBUKDOFHU7CJAGAQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876310151 (190h45m1.573878486s) [seg_pos={0 0}, upload=167512]: Segment reached optimal threshold of 26 pieces. Dec 13 14:14:13.876577870 (190h45m1.574146207s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876587379 (190h45m1.574155724s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876711831 (190h45m1.574280167s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876726428 (190h45m1.574294774s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876765780 (190h45m1.574334117s) [seg_pos={0 0}, upload=167512]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 14:14:13.876880185 (190h45m1.574448522s) [upload=167512]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 14:14:13.876886387 (190h45m1.574454723s) [upload=167512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 14:14:39.731793972 (190h45m27.429362317s) [upload=167512]: Done uploading segments... Dec 13 14:14:39.731821442 (190h45m27.429389779s) [upload=167512]: Upload finished. err: <nil> Duration: 2.656754992s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 7.998651071s trace: https://jaeger.dev.storj.io/trace/19084e8d3cf2aae8 FAIL (2025-12-13 14:47:48 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708151385 (190h45m0.405719722s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708453380 (190h45m0.406021686s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708592289 (190h45m0.406160635s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708744243 (190h45m0.406312559s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708993619 (190h45m0.406561965s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709023485 (190h45m0.406591801s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709282308 (190h45m0.406850624s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709529339 (190h45m0.407097646s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709802660 (190h45m0.407370976s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.710052527 (190h45m0.407620833s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:13.180560502 (190h45m0.878128818s) [upload=167512]: Next returned nil segment Dec 13 14:14:13.180570781 (190h45m0.878139097s) [upload=167512]: Waiting for error group managing segments... Dec 13 14:14:13.346901236 (190h45m1.044469572s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349132333 (190h45m1.04670071s) [noise=true , address=185.167.204.205:4035 , piece_id=OPSRXVKUGC3AR4UNZ2NE2KR3IJIFFYEEGKJOYCEGLN3GKXDT6SHA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349252939 (190h45m1.046821285s) [noise=true , address=185.167.204.206:4043 , piece_id=JHOOH5DLKU2JKFMHEA4PRJ7D34HB3LRWUVDLTHFIUGOWX4TXRHUA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.350369674 (190h45m1.047938011s) [noise=true , address=185.167.204.206:4068 , piece_id=XUOIL7W3VRDX3SHVNKBFZ5JIIXBWULMY2PITDG22DTBQVZSGXYLA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.353825971 (190h45m1.051394318s) [noise=true , address=185.167.204.205:4006 , piece_id=YBXNX4FGALNOSBBNPU3SH2XRZUAB356LWMKAZ6DYI5XKPCOJ2IEA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.354886973 (190h45m1.052455309s) [noise=true , address=185.167.204.206:4060 , piece_id=22WIJIT3QKLZIK7TPG3QKRD6C2GKF44VIVAKPQFCWVX6ZLMFVTZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.355743614 (190h45m1.053311949s) [noise=true , address=185.167.204.206:4065 , piece_id=XQFKTLPSN2IDR23N43LS4KNAGKMQFH23BXY7ISSQT6IJ2ASPKWSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.356926985 (190h45m1.05449533s) [noise=true , address=185.167.204.206:4070 , piece_id=5HA3IAW4S64SUYEWIXRMOGF2UR5BPTOY7QR4PN5NYHIWQ4NG63BA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.357882078 (190h45m1.055450485s) [noise=true , address=185.167.204.206:4048 , piece_id=LEAXXSSHIFJU3TS5J3BQDIWXJ3C5XIWME4RNIT7BJ5IVAKTWO6BQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.359020014 (190h45m1.05658835s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.361154070 (190h45m1.058722407s) [noise=true , address=185.167.204.205:4019 , piece_id=YZAF4ZJT6LFSPIIWIK7XZJCB5WFAIO7RZEI4LUWSJWGHRQPKZPUQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.362240620 (190h45m1.059808946s) [noise=true , address=185.167.204.206:4046 , piece_id=JTH4RAAVDOV4ZWVD234M3FND3HGBN7AMR7OYRH6RT77NEKRHUXSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.364011889 (190h45m1.061580205s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.375789861 (190h45m1.073358196s) [noise=true , address=185.167.204.206:4041 , piece_id=GB54B2DACB4YEFK6M3IZB5SQ5DPPD35DNVIGCT3LZ25OIFPASMMQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.379015597 (190h45m1.076583903s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.381428725 (190h45m1.078997041s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.387461184 (190h45m1.085029489s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390251637 (190h45m1.087819963s) [noise=true , address=185.167.204.206:4050 , piece_id=BI7ZNHPGLKGI7AGBGLQLV4GOF566LNZAVIXUZEJF6Y4D53T6OTBA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390490352 (190h45m1.088058658s) [noise=true , address=185.167.204.205:4020 , piece_id=IIP6TB55BMI447B22NQSY7MUXRBWAPWAW43HOMHR5KCE3JNB7WZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.392613419 (190h45m1.090181725s) [noise=true , address=81.171.14.70:4025 , piece_id=KGFO6JJAWV3PGU2R5VWZFE6SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.403941520 (190h45m1.101509826s) [noise=true , address=185.167.204.205:4031 , piece_id=VQML3S4F6PYYCX3DG54Q54VIEWMIZRFHIWBGIELYDW3V6CJVDVKA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.404283930 (190h45m1.101852266s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.439393256 (190h45m1.136961592s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.461982804 (190h45m1.15955112s) [noise=true , address=89.149.201.147:4005 , piece_id=OMXI6IUWPJ4R5CF2NU35WBAOWP32S6VJY4NFSSGD3DEDV4JWR4CQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.866666394 (190h45m1.56423473s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876288660 (190h45m1.573856996s) [noise=true , address=81.171.14.70:4027 , piece_id=GFCC4YJ6WI45RQSA5UU22PI2DCHNKCOPJNWJXBUKDOFHU7CJAGAQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876310151 (190h45m1.573878486s) [seg_pos={0 0}, upload=167512]: Segment reached optimal threshold of 26 pieces. Dec 13 14:14:13.876577870 (190h45m1.574146207s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876587379 (190h45m1.574155724s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876711831 (190h45m1.574280167s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876726428 (190h45m1.574294774s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876765780 (190h45m1.574334117s) [seg_pos={0 0}, upload=167512]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 14:14:13.876880185 (190h45m1.574448522s) [upload=167512]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 14:14:13.876886387 (190h45m1.574454723s) [upload=167512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 14:14:39.731793972 (190h45m27.429362317s) [upload=167512]: Done uploading segments... Dec 13 14:14:39.731821442 (190h45m27.429389779s) [upload=167512]: Upload finished. err: <nil> Duration: 7.998673263s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..................X.........XX..........X...................] duration: 2.804323491s trace: https://jaeger.dev.storj.io/trace/14df685fb176a112 FAIL (2025-12-13 14:47:46 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.804338849s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 923.120772ms trace: https://jaeger.dev.storj.io/trace/197d5bf95cf2aac7 FAIL (2025-12-13 14:47:44 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 923.141ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 4 out of 60 is failed (threshold=3) [...................X.........XX..........X..................] duration: 8.651395201s trace: https://jaeger.dev.storj.io/trace/14df685fb176a112 FAIL (2025-12-13 14:47:21 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 8.65141576s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 1.214371824s trace: https://jaeger.dev.storj.io/trace/197d5bf95cf2aac7 FAIL (2025-12-13 14:46:53 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 1.214395939s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 4.72607014s trace: https://jaeger.dev.storj.io/trace/19084e8d3cf2aae8 FAIL (2025-12-13 14:46:40 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708151385 (190h45m0.405719722s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708453380 (190h45m0.406021686s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708592289 (190h45m0.406160635s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708744243 (190h45m0.406312559s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708993619 (190h45m0.406561965s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709023485 (190h45m0.406591801s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709282308 (190h45m0.406850624s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709529339 (190h45m0.407097646s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709802660 (190h45m0.407370976s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.710052527 (190h45m0.407620833s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:13.180560502 (190h45m0.878128818s) [upload=167512]: Next returned nil segment Dec 13 14:14:13.180570781 (190h45m0.878139097s) [upload=167512]: Waiting for error group managing segments... Dec 13 14:14:13.346901236 (190h45m1.044469572s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349132333 (190h45m1.04670071s) [noise=true , address=185.167.204.205:4035 , piece_id=OPSRXVKUGC3AR4UNZ2NE2KR3IJIFFYEEGKJOYCEGLN3GKXDT6SHA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349252939 (190h45m1.046821285s) [noise=true , address=185.167.204.206:4043 , piece_id=JHOOH5DLKU2JKFMHEA4PRJ7D34HB3LRWUVDLTHFIUGOWX4TXRHUA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.350369674 (190h45m1.047938011s) [noise=true , address=185.167.204.206:4068 , piece_id=XUOIL7W3VRDX3SHVNKBFZ5JIIXBWULMY2PITDG22DTBQVZSGXYLA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.353825971 (190h45m1.051394318s) [noise=true , address=185.167.204.205:4006 , piece_id=YBXNX4FGALNOSBBNPU3SH2XRZUAB356LWMKAZ6DYI5XKPCOJ2IEA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.354886973 (190h45m1.052455309s) [noise=true , address=185.167.204.206:4060 , piece_id=22WIJIT3QKLZIK7TPG3QKRD6C2GKF44VIVAKPQFCWVX6ZLMFVTZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.355743614 (190h45m1.053311949s) [noise=true , address=185.167.204.206:4065 , piece_id=XQFKTLPSN2IDR23N43LS4KNAGKMQFH23BXY7ISSQT6IJ2ASPKWSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.356926985 (190h45m1.05449533s) [noise=true , address=185.167.204.206:4070 , piece_id=5HA3IAW4S64SUYEWIXRMOGF2UR5BPTOY7QR4PN5NYHIWQ4NG63BA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.357882078 (190h45m1.055450485s) [noise=true , address=185.167.204.206:4048 , piece_id=LEAXXSSHIFJU3TS5J3BQDIWXJ3C5XIWME4RNIT7BJ5IVAKTWO6BQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.359020014 (190h45m1.05658835s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.361154070 (190h45m1.058722407s) [noise=true , address=185.167.204.205:4019 , piece_id=YZAF4ZJT6LFSPIIWIK7XZJCB5WFAIO7RZEI4LUWSJWGHRQPKZPUQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.362240620 (190h45m1.059808946s) [noise=true , address=185.167.204.206:4046 , piece_id=JTH4RAAVDOV4ZWVD234M3FND3HGBN7AMR7OYRH6RT77NEKRHUXSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.364011889 (190h45m1.061580205s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.375789861 (190h45m1.073358196s) [noise=true , address=185.167.204.206:4041 , piece_id=GB54B2DACB4YEFK6M3IZB5SQ5DPPD35DNVIGCT3LZ25OIFPASMMQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.379015597 (190h45m1.076583903s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.381428725 (190h45m1.078997041s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.387461184 (190h45m1.085029489s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390251637 (190h45m1.087819963s) [noise=true , address=185.167.204.206:4050 , piece_id=BI7ZNHPGLKGI7AGBGLQLV4GOF566LNZAVIXUZEJF6Y4D53T6OTBA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390490352 (190h45m1.088058658s) [noise=true , address=185.167.204.205:4020 , piece_id=IIP6TB55BMI447B22NQSY7MUXRBWAPWAW43HOMHR5KCE3JNB7WZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.392613419 (190h45m1.090181725s) [noise=true , address=81.171.14.70:4025 , piece_id=KGFO6JJAWV3PGU2R5VWZFE6SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.403941520 (190h45m1.101509826s) [noise=true , address=185.167.204.205:4031 , piece_id=VQML3S4F6PYYCX3DG54Q54VIEWMIZRFHIWBGIELYDW3V6CJVDVKA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.404283930 (190h45m1.101852266s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.439393256 (190h45m1.136961592s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.461982804 (190h45m1.15955112s) [noise=true , address=89.149.201.147:4005 , piece_id=OMXI6IUWPJ4R5CF2NU35WBAOWP32S6VJY4NFSSGD3DEDV4JWR4CQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.866666394 (190h45m1.56423473s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876288660 (190h45m1.573856996s) [noise=true , address=81.171.14.70:4027 , piece_id=GFCC4YJ6WI45RQSA5UU22PI2DCHNKCOPJNWJXBUKDOFHU7CJAGAQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876310151 (190h45m1.573878486s) [seg_pos={0 0}, upload=167512]: Segment reached optimal threshold of 26 pieces. Dec 13 14:14:13.876577870 (190h45m1.574146207s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876587379 (190h45m1.574155724s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876711831 (190h45m1.574280167s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876726428 (190h45m1.574294774s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876765780 (190h45m1.574334117s) [seg_pos={0 0}, upload=167512]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 14:14:13.876880185 (190h45m1.574448522s) [upload=167512]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 14:14:13.876886387 (190h45m1.574454723s) [upload=167512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 14:14:39.731793972 (190h45m27.429362317s) [upload=167512]: Done uploading segments... Dec 13 14:14:39.731821442 (190h45m27.429389779s) [upload=167512]: Upload finished. err: <nil> Duration: 4.726116065s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 4 out of 60 is failed (threshold=3) [....................X.........XX..........X.................] duration: 3.235156942s trace: https://jaeger.dev.storj.io/trace/14df685fb176a112 FAIL (2025-12-13 14:46:34 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.235189773s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....................X.........XX..........X................] duration: 20.462469605s trace: https://jaeger.dev.storj.io/trace/14df685fb176a112 FAIL (2025-12-13 14:46:28 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 20.462488871s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 1.391092058s trace: https://jaeger.dev.storj.io/trace/197d5bf95cf2aac7 FAIL (2025-12-13 14:46:00 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 1.39110954s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 1.230139457s trace: https://jaeger.dev.storj.io/trace/197d5bf95cf2aac7 FAIL (2025-12-13 14:45:37 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 1.230159805s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.441667381s trace: https://jaeger.dev.storj.io/trace/19084e8d3cf2aae8 FAIL (2025-12-13 14:45:26 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708151385 (190h45m0.405719722s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708453380 (190h45m0.406021686s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708592289 (190h45m0.406160635s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708744243 (190h45m0.406312559s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708993619 (190h45m0.406561965s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709023485 (190h45m0.406591801s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709282308 (190h45m0.406850624s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709529339 (190h45m0.407097646s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709802660 (190h45m0.407370976s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.710052527 (190h45m0.407620833s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:13.180560502 (190h45m0.878128818s) [upload=167512]: Next returned nil segment Dec 13 14:14:13.180570781 (190h45m0.878139097s) [upload=167512]: Waiting for error group managing segments... Dec 13 14:14:13.346901236 (190h45m1.044469572s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349132333 (190h45m1.04670071s) [noise=true , address=185.167.204.205:4035 , piece_id=OPSRXVKUGC3AR4UNZ2NE2KR3IJIFFYEEGKJOYCEGLN3GKXDT6SHA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349252939 (190h45m1.046821285s) [noise=true , address=185.167.204.206:4043 , piece_id=JHOOH5DLKU2JKFMHEA4PRJ7D34HB3LRWUVDLTHFIUGOWX4TXRHUA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.350369674 (190h45m1.047938011s) [noise=true , address=185.167.204.206:4068 , piece_id=XUOIL7W3VRDX3SHVNKBFZ5JIIXBWULMY2PITDG22DTBQVZSGXYLA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.353825971 (190h45m1.051394318s) [noise=true , address=185.167.204.205:4006 , piece_id=YBXNX4FGALNOSBBNPU3SH2XRZUAB356LWMKAZ6DYI5XKPCOJ2IEA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.354886973 (190h45m1.052455309s) [noise=true , address=185.167.204.206:4060 , piece_id=22WIJIT3QKLZIK7TPG3QKRD6C2GKF44VIVAKPQFCWVX6ZLMFVTZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.355743614 (190h45m1.053311949s) [noise=true , address=185.167.204.206:4065 , piece_id=XQFKTLPSN2IDR23N43LS4KNAGKMQFH23BXY7ISSQT6IJ2ASPKWSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.356926985 (190h45m1.05449533s) [noise=true , address=185.167.204.206:4070 , piece_id=5HA3IAW4S64SUYEWIXRMOGF2UR5BPTOY7QR4PN5NYHIWQ4NG63BA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.357882078 (190h45m1.055450485s) [noise=true , address=185.167.204.206:4048 , piece_id=LEAXXSSHIFJU3TS5J3BQDIWXJ3C5XIWME4RNIT7BJ5IVAKTWO6BQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.359020014 (190h45m1.05658835s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.361154070 (190h45m1.058722407s) [noise=true , address=185.167.204.205:4019 , piece_id=YZAF4ZJT6LFSPIIWIK7XZJCB5WFAIO7RZEI4LUWSJWGHRQPKZPUQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.362240620 (190h45m1.059808946s) [noise=true , address=185.167.204.206:4046 , piece_id=JTH4RAAVDOV4ZWVD234M3FND3HGBN7AMR7OYRH6RT77NEKRHUXSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.364011889 (190h45m1.061580205s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.375789861 (190h45m1.073358196s) [noise=true , address=185.167.204.206:4041 , piece_id=GB54B2DACB4YEFK6M3IZB5SQ5DPPD35DNVIGCT3LZ25OIFPASMMQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.379015597 (190h45m1.076583903s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.381428725 (190h45m1.078997041s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.387461184 (190h45m1.085029489s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390251637 (190h45m1.087819963s) [noise=true , address=185.167.204.206:4050 , piece_id=BI7ZNHPGLKGI7AGBGLQLV4GOF566LNZAVIXUZEJF6Y4D53T6OTBA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390490352 (190h45m1.088058658s) [noise=true , address=185.167.204.205:4020 , piece_id=IIP6TB55BMI447B22NQSY7MUXRBWAPWAW43HOMHR5KCE3JNB7WZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.392613419 (190h45m1.090181725s) [noise=true , address=81.171.14.70:4025 , piece_id=KGFO6JJAWV3PGU2R5VWZFE6SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.403941520 (190h45m1.101509826s) [noise=true , address=185.167.204.205:4031 , piece_id=VQML3S4F6PYYCX3DG54Q54VIEWMIZRFHIWBGIELYDW3V6CJVDVKA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.404283930 (190h45m1.101852266s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.439393256 (190h45m1.136961592s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.461982804 (190h45m1.15955112s) [noise=true , address=89.149.201.147:4005 , piece_id=OMXI6IUWPJ4R5CF2NU35WBAOWP32S6VJY4NFSSGD3DEDV4JWR4CQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.866666394 (190h45m1.56423473s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876288660 (190h45m1.573856996s) [noise=true , address=81.171.14.70:4027 , piece_id=GFCC4YJ6WI45RQSA5UU22PI2DCHNKCOPJNWJXBUKDOFHU7CJAGAQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876310151 (190h45m1.573878486s) [seg_pos={0 0}, upload=167512]: Segment reached optimal threshold of 26 pieces. Dec 13 14:14:13.876577870 (190h45m1.574146207s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876587379 (190h45m1.574155724s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876711831 (190h45m1.574280167s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876726428 (190h45m1.574294774s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876765780 (190h45m1.574334117s) [seg_pos={0 0}, upload=167512]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 14:14:13.876880185 (190h45m1.574448522s) [upload=167512]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 14:14:13.876886387 (190h45m1.574454723s) [upload=167512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 14:14:39.731793972 (190h45m27.429362317s) [upload=167512]: Done uploading segments... Dec 13 14:14:39.731821442 (190h45m27.429389779s) [upload=167512]: Upload finished. err: <nil> Duration: 2.441691377s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.504789023s trace: https://jaeger.dev.storj.io/trace/19084e8d3cf2aae8 FAIL (2025-12-13 14:45:05 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708151385 (190h45m0.405719722s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708453380 (190h45m0.406021686s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708592289 (190h45m0.406160635s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708744243 (190h45m0.406312559s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708993619 (190h45m0.406561965s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709023485 (190h45m0.406591801s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709282308 (190h45m0.406850624s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709529339 (190h45m0.407097646s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709802660 (190h45m0.407370976s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.710052527 (190h45m0.407620833s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:13.180560502 (190h45m0.878128818s) [upload=167512]: Next returned nil segment Dec 13 14:14:13.180570781 (190h45m0.878139097s) [upload=167512]: Waiting for error group managing segments... Dec 13 14:14:13.346901236 (190h45m1.044469572s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349132333 (190h45m1.04670071s) [noise=true , address=185.167.204.205:4035 , piece_id=OPSRXVKUGC3AR4UNZ2NE2KR3IJIFFYEEGKJOYCEGLN3GKXDT6SHA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349252939 (190h45m1.046821285s) [noise=true , address=185.167.204.206:4043 , piece_id=JHOOH5DLKU2JKFMHEA4PRJ7D34HB3LRWUVDLTHFIUGOWX4TXRHUA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.350369674 (190h45m1.047938011s) [noise=true , address=185.167.204.206:4068 , piece_id=XUOIL7W3VRDX3SHVNKBFZ5JIIXBWULMY2PITDG22DTBQVZSGXYLA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.353825971 (190h45m1.051394318s) [noise=true , address=185.167.204.205:4006 , piece_id=YBXNX4FGALNOSBBNPU3SH2XRZUAB356LWMKAZ6DYI5XKPCOJ2IEA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.354886973 (190h45m1.052455309s) [noise=true , address=185.167.204.206:4060 , piece_id=22WIJIT3QKLZIK7TPG3QKRD6C2GKF44VIVAKPQFCWVX6ZLMFVTZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.355743614 (190h45m1.053311949s) [noise=true , address=185.167.204.206:4065 , piece_id=XQFKTLPSN2IDR23N43LS4KNAGKMQFH23BXY7ISSQT6IJ2ASPKWSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.356926985 (190h45m1.05449533s) [noise=true , address=185.167.204.206:4070 , piece_id=5HA3IAW4S64SUYEWIXRMOGF2UR5BPTOY7QR4PN5NYHIWQ4NG63BA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.357882078 (190h45m1.055450485s) [noise=true , address=185.167.204.206:4048 , piece_id=LEAXXSSHIFJU3TS5J3BQDIWXJ3C5XIWME4RNIT7BJ5IVAKTWO6BQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.359020014 (190h45m1.05658835s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.361154070 (190h45m1.058722407s) [noise=true , address=185.167.204.205:4019 , piece_id=YZAF4ZJT6LFSPIIWIK7XZJCB5WFAIO7RZEI4LUWSJWGHRQPKZPUQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.362240620 (190h45m1.059808946s) [noise=true , address=185.167.204.206:4046 , piece_id=JTH4RAAVDOV4ZWVD234M3FND3HGBN7AMR7OYRH6RT77NEKRHUXSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.364011889 (190h45m1.061580205s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.375789861 (190h45m1.073358196s) [noise=true , address=185.167.204.206:4041 , piece_id=GB54B2DACB4YEFK6M3IZB5SQ5DPPD35DNVIGCT3LZ25OIFPASMMQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.379015597 (190h45m1.076583903s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.381428725 (190h45m1.078997041s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.387461184 (190h45m1.085029489s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390251637 (190h45m1.087819963s) [noise=true , address=185.167.204.206:4050 , piece_id=BI7ZNHPGLKGI7AGBGLQLV4GOF566LNZAVIXUZEJF6Y4D53T6OTBA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390490352 (190h45m1.088058658s) [noise=true , address=185.167.204.205:4020 , piece_id=IIP6TB55BMI447B22NQSY7MUXRBWAPWAW43HOMHR5KCE3JNB7WZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.392613419 (190h45m1.090181725s) [noise=true , address=81.171.14.70:4025 , piece_id=KGFO6JJAWV3PGU2R5VWZFE6SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.403941520 (190h45m1.101509826s) [noise=true , address=185.167.204.205:4031 , piece_id=VQML3S4F6PYYCX3DG54Q54VIEWMIZRFHIWBGIELYDW3V6CJVDVKA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.404283930 (190h45m1.101852266s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.439393256 (190h45m1.136961592s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.461982804 (190h45m1.15955112s) [noise=true , address=89.149.201.147:4005 , piece_id=OMXI6IUWPJ4R5CF2NU35WBAOWP32S6VJY4NFSSGD3DEDV4JWR4CQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.866666394 (190h45m1.56423473s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876288660 (190h45m1.573856996s) [noise=true , address=81.171.14.70:4027 , piece_id=GFCC4YJ6WI45RQSA5UU22PI2DCHNKCOPJNWJXBUKDOFHU7CJAGAQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876310151 (190h45m1.573878486s) [seg_pos={0 0}, upload=167512]: Segment reached optimal threshold of 26 pieces. Dec 13 14:14:13.876577870 (190h45m1.574146207s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876587379 (190h45m1.574155724s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876711831 (190h45m1.574280167s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876726428 (190h45m1.574294774s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876765780 (190h45m1.574334117s) [seg_pos={0 0}, upload=167512]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 14:14:13.876880185 (190h45m1.574448522s) [upload=167512]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 14:14:13.876886387 (190h45m1.574454723s) [upload=167512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 14:14:39.731793972 (190h45m27.429362317s) [upload=167512]: Done uploading segments... Dec 13 14:14:39.731821442 (190h45m27.429389779s) [upload=167512]: Upload finished. err: <nil> Duration: 2.504806998s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 4 out of 60 is failed (threshold=3) [......................X.........XX..........X...............] duration: 3.167853943s trace: https://jaeger.dev.storj.io/trace/14df685fb176a112 FAIL (2025-12-13 14:44:59 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 3.167872899s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 931.438159ms trace: https://jaeger.dev.storj.io/trace/197d5bf95cf2aac7 FAIL (2025-12-13 14:44:46 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 931.477592ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.316715011s trace: https://jaeger.dev.storj.io/trace/19084e8d3cf2aae8 FAIL (2025-12-13 14:44:35 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708151385 (190h45m0.405719722s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708453380 (190h45m0.406021686s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708592289 (190h45m0.406160635s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708744243 (190h45m0.406312559s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708993619 (190h45m0.406561965s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709023485 (190h45m0.406591801s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709282308 (190h45m0.406850624s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709529339 (190h45m0.407097646s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709802660 (190h45m0.407370976s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.710052527 (190h45m0.407620833s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:13.180560502 (190h45m0.878128818s) [upload=167512]: Next returned nil segment Dec 13 14:14:13.180570781 (190h45m0.878139097s) [upload=167512]: Waiting for error group managing segments... Dec 13 14:14:13.346901236 (190h45m1.044469572s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349132333 (190h45m1.04670071s) [noise=true , address=185.167.204.205:4035 , piece_id=OPSRXVKUGC3AR4UNZ2NE2KR3IJIFFYEEGKJOYCEGLN3GKXDT6SHA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349252939 (190h45m1.046821285s) [noise=true , address=185.167.204.206:4043 , piece_id=JHOOH5DLKU2JKFMHEA4PRJ7D34HB3LRWUVDLTHFIUGOWX4TXRHUA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.350369674 (190h45m1.047938011s) [noise=true , address=185.167.204.206:4068 , piece_id=XUOIL7W3VRDX3SHVNKBFZ5JIIXBWULMY2PITDG22DTBQVZSGXYLA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.353825971 (190h45m1.051394318s) [noise=true , address=185.167.204.205:4006 , piece_id=YBXNX4FGALNOSBBNPU3SH2XRZUAB356LWMKAZ6DYI5XKPCOJ2IEA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.354886973 (190h45m1.052455309s) [noise=true , address=185.167.204.206:4060 , piece_id=22WIJIT3QKLZIK7TPG3QKRD6C2GKF44VIVAKPQFCWVX6ZLMFVTZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.355743614 (190h45m1.053311949s) [noise=true , address=185.167.204.206:4065 , piece_id=XQFKTLPSN2IDR23N43LS4KNAGKMQFH23BXY7ISSQT6IJ2ASPKWSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.356926985 (190h45m1.05449533s) [noise=true , address=185.167.204.206:4070 , piece_id=5HA3IAW4S64SUYEWIXRMOGF2UR5BPTOY7QR4PN5NYHIWQ4NG63BA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.357882078 (190h45m1.055450485s) [noise=true , address=185.167.204.206:4048 , piece_id=LEAXXSSHIFJU3TS5J3BQDIWXJ3C5XIWME4RNIT7BJ5IVAKTWO6BQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.359020014 (190h45m1.05658835s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.361154070 (190h45m1.058722407s) [noise=true , address=185.167.204.205:4019 , piece_id=YZAF4ZJT6LFSPIIWIK7XZJCB5WFAIO7RZEI4LUWSJWGHRQPKZPUQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.362240620 (190h45m1.059808946s) [noise=true , address=185.167.204.206:4046 , piece_id=JTH4RAAVDOV4ZWVD234M3FND3HGBN7AMR7OYRH6RT77NEKRHUXSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.364011889 (190h45m1.061580205s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.375789861 (190h45m1.073358196s) [noise=true , address=185.167.204.206:4041 , piece_id=GB54B2DACB4YEFK6M3IZB5SQ5DPPD35DNVIGCT3LZ25OIFPASMMQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.379015597 (190h45m1.076583903s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.381428725 (190h45m1.078997041s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.387461184 (190h45m1.085029489s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390251637 (190h45m1.087819963s) [noise=true , address=185.167.204.206:4050 , piece_id=BI7ZNHPGLKGI7AGBGLQLV4GOF566LNZAVIXUZEJF6Y4D53T6OTBA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390490352 (190h45m1.088058658s) [noise=true , address=185.167.204.205:4020 , piece_id=IIP6TB55BMI447B22NQSY7MUXRBWAPWAW43HOMHR5KCE3JNB7WZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.392613419 (190h45m1.090181725s) [noise=true , address=81.171.14.70:4025 , piece_id=KGFO6JJAWV3PGU2R5VWZFE6SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.403941520 (190h45m1.101509826s) [noise=true , address=185.167.204.205:4031 , piece_id=VQML3S4F6PYYCX3DG54Q54VIEWMIZRFHIWBGIELYDW3V6CJVDVKA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.404283930 (190h45m1.101852266s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.439393256 (190h45m1.136961592s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.461982804 (190h45m1.15955112s) [noise=true , address=89.149.201.147:4005 , piece_id=OMXI6IUWPJ4R5CF2NU35WBAOWP32S6VJY4NFSSGD3DEDV4JWR4CQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.866666394 (190h45m1.56423473s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876288660 (190h45m1.573856996s) [noise=true , address=81.171.14.70:4027 , piece_id=GFCC4YJ6WI45RQSA5UU22PI2DCHNKCOPJNWJXBUKDOFHU7CJAGAQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876310151 (190h45m1.573878486s) [seg_pos={0 0}, upload=167512]: Segment reached optimal threshold of 26 pieces. Dec 13 14:14:13.876577870 (190h45m1.574146207s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876587379 (190h45m1.574155724s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876711831 (190h45m1.574280167s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876726428 (190h45m1.574294774s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876765780 (190h45m1.574334117s) [seg_pos={0 0}, upload=167512]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 14:14:13.876880185 (190h45m1.574448522s) [upload=167512]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 14:14:13.876886387 (190h45m1.574454723s) [upload=167512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 14:14:39.731793972 (190h45m27.429362317s) [upload=167512]: Done uploading segments... Dec 13 14:14:39.731821442 (190h45m27.429389779s) [upload=167512]: Upload finished. err: <nil> Duration: 2.316734919s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 983.674799ms trace: https://jaeger.dev.storj.io/trace/197d5bf95cf2aac7 FAIL (2025-12-13 14:44:23 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 983.70205ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.......................X.........XX..........X..............] duration: 2.745975452s trace: https://jaeger.dev.storj.io/trace/14df685fb176a112 FAIL (2025-12-13 14:43:50 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.745991521s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.675904707s trace: https://jaeger.dev.storj.io/trace/19084e8d3cf2aae8 FAIL (2025-12-13 14:43:27 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708151385 (190h45m0.405719722s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708453380 (190h45m0.406021686s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708592289 (190h45m0.406160635s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708744243 (190h45m0.406312559s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708993619 (190h45m0.406561965s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709023485 (190h45m0.406591801s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709282308 (190h45m0.406850624s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709529339 (190h45m0.407097646s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709802660 (190h45m0.407370976s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.710052527 (190h45m0.407620833s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:13.180560502 (190h45m0.878128818s) [upload=167512]: Next returned nil segment Dec 13 14:14:13.180570781 (190h45m0.878139097s) [upload=167512]: Waiting for error group managing segments... Dec 13 14:14:13.346901236 (190h45m1.044469572s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349132333 (190h45m1.04670071s) [noise=true , address=185.167.204.205:4035 , piece_id=OPSRXVKUGC3AR4UNZ2NE2KR3IJIFFYEEGKJOYCEGLN3GKXDT6SHA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349252939 (190h45m1.046821285s) [noise=true , address=185.167.204.206:4043 , piece_id=JHOOH5DLKU2JKFMHEA4PRJ7D34HB3LRWUVDLTHFIUGOWX4TXRHUA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.350369674 (190h45m1.047938011s) [noise=true , address=185.167.204.206:4068 , piece_id=XUOIL7W3VRDX3SHVNKBFZ5JIIXBWULMY2PITDG22DTBQVZSGXYLA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.353825971 (190h45m1.051394318s) [noise=true , address=185.167.204.205:4006 , piece_id=YBXNX4FGALNOSBBNPU3SH2XRZUAB356LWMKAZ6DYI5XKPCOJ2IEA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.354886973 (190h45m1.052455309s) [noise=true , address=185.167.204.206:4060 , piece_id=22WIJIT3QKLZIK7TPG3QKRD6C2GKF44VIVAKPQFCWVX6ZLMFVTZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.355743614 (190h45m1.053311949s) [noise=true , address=185.167.204.206:4065 , piece_id=XQFKTLPSN2IDR23N43LS4KNAGKMQFH23BXY7ISSQT6IJ2ASPKWSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.356926985 (190h45m1.05449533s) [noise=true , address=185.167.204.206:4070 , piece_id=5HA3IAW4S64SUYEWIXRMOGF2UR5BPTOY7QR4PN5NYHIWQ4NG63BA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.357882078 (190h45m1.055450485s) [noise=true , address=185.167.204.206:4048 , piece_id=LEAXXSSHIFJU3TS5J3BQDIWXJ3C5XIWME4RNIT7BJ5IVAKTWO6BQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.359020014 (190h45m1.05658835s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.361154070 (190h45m1.058722407s) [noise=true , address=185.167.204.205:4019 , piece_id=YZAF4ZJT6LFSPIIWIK7XZJCB5WFAIO7RZEI4LUWSJWGHRQPKZPUQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.362240620 (190h45m1.059808946s) [noise=true , address=185.167.204.206:4046 , piece_id=JTH4RAAVDOV4ZWVD234M3FND3HGBN7AMR7OYRH6RT77NEKRHUXSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.364011889 (190h45m1.061580205s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.375789861 (190h45m1.073358196s) [noise=true , address=185.167.204.206:4041 , piece_id=GB54B2DACB4YEFK6M3IZB5SQ5DPPD35DNVIGCT3LZ25OIFPASMMQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.379015597 (190h45m1.076583903s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.381428725 (190h45m1.078997041s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.387461184 (190h45m1.085029489s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390251637 (190h45m1.087819963s) [noise=true , address=185.167.204.206:4050 , piece_id=BI7ZNHPGLKGI7AGBGLQLV4GOF566LNZAVIXUZEJF6Y4D53T6OTBA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390490352 (190h45m1.088058658s) [noise=true , address=185.167.204.205:4020 , piece_id=IIP6TB55BMI447B22NQSY7MUXRBWAPWAW43HOMHR5KCE3JNB7WZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.392613419 (190h45m1.090181725s) [noise=true , address=81.171.14.70:4025 , piece_id=KGFO6JJAWV3PGU2R5VWZFE6SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.403941520 (190h45m1.101509826s) [noise=true , address=185.167.204.205:4031 , piece_id=VQML3S4F6PYYCX3DG54Q54VIEWMIZRFHIWBGIELYDW3V6CJVDVKA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.404283930 (190h45m1.101852266s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.439393256 (190h45m1.136961592s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.461982804 (190h45m1.15955112s) [noise=true , address=89.149.201.147:4005 , piece_id=OMXI6IUWPJ4R5CF2NU35WBAOWP32S6VJY4NFSSGD3DEDV4JWR4CQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.866666394 (190h45m1.56423473s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876288660 (190h45m1.573856996s) [noise=true , address=81.171.14.70:4027 , piece_id=GFCC4YJ6WI45RQSA5UU22PI2DCHNKCOPJNWJXBUKDOFHU7CJAGAQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876310151 (190h45m1.573878486s) [seg_pos={0 0}, upload=167512]: Segment reached optimal threshold of 26 pieces. Dec 13 14:14:13.876577870 (190h45m1.574146207s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876587379 (190h45m1.574155724s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876711831 (190h45m1.574280167s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876726428 (190h45m1.574294774s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876765780 (190h45m1.574334117s) [seg_pos={0 0}, upload=167512]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 14:14:13.876880185 (190h45m1.574448522s) [upload=167512]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 14:14:13.876886387 (190h45m1.574454723s) [upload=167512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 14:14:39.731793972 (190h45m27.429362317s) [upload=167512]: Done uploading segments... Dec 13 14:14:39.731821442 (190h45m27.429389779s) [upload=167512]: Upload finished. err: <nil> Duration: 2.67592746s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 4 out of 60 is failed (threshold=3) [........................X.........XX..........X.............] duration: 2.703027794s trace: https://jaeger.dev.storj.io/trace/14df685fb176a112 FAIL (2025-12-13 14:43:16 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.70304739s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 948.718298ms trace: https://jaeger.dev.storj.io/trace/197d5bf95cf2aac7 FAIL (2025-12-13 14:43:14 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 948.734267ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.........................X.........XX..........X............] duration: 2.683483736s trace: https://jaeger.dev.storj.io/trace/14df685fb176a112 FAIL (2025-12-13 14:42:52 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.683497952s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.48058507s trace: https://jaeger.dev.storj.io/trace/19084e8d3cf2aae8 FAIL (2025-12-13 14:42:28 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708151385 (190h45m0.405719722s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708453380 (190h45m0.406021686s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708592289 (190h45m0.406160635s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708744243 (190h45m0.406312559s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708993619 (190h45m0.406561965s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709023485 (190h45m0.406591801s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709282308 (190h45m0.406850624s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709529339 (190h45m0.407097646s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709802660 (190h45m0.407370976s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.710052527 (190h45m0.407620833s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:13.180560502 (190h45m0.878128818s) [upload=167512]: Next returned nil segment Dec 13 14:14:13.180570781 (190h45m0.878139097s) [upload=167512]: Waiting for error group managing segments... Dec 13 14:14:13.346901236 (190h45m1.044469572s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349132333 (190h45m1.04670071s) [noise=true , address=185.167.204.205:4035 , piece_id=OPSRXVKUGC3AR4UNZ2NE2KR3IJIFFYEEGKJOYCEGLN3GKXDT6SHA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349252939 (190h45m1.046821285s) [noise=true , address=185.167.204.206:4043 , piece_id=JHOOH5DLKU2JKFMHEA4PRJ7D34HB3LRWUVDLTHFIUGOWX4TXRHUA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.350369674 (190h45m1.047938011s) [noise=true , address=185.167.204.206:4068 , piece_id=XUOIL7W3VRDX3SHVNKBFZ5JIIXBWULMY2PITDG22DTBQVZSGXYLA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.353825971 (190h45m1.051394318s) [noise=true , address=185.167.204.205:4006 , piece_id=YBXNX4FGALNOSBBNPU3SH2XRZUAB356LWMKAZ6DYI5XKPCOJ2IEA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.354886973 (190h45m1.052455309s) [noise=true , address=185.167.204.206:4060 , piece_id=22WIJIT3QKLZIK7TPG3QKRD6C2GKF44VIVAKPQFCWVX6ZLMFVTZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.355743614 (190h45m1.053311949s) [noise=true , address=185.167.204.206:4065 , piece_id=XQFKTLPSN2IDR23N43LS4KNAGKMQFH23BXY7ISSQT6IJ2ASPKWSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.356926985 (190h45m1.05449533s) [noise=true , address=185.167.204.206:4070 , piece_id=5HA3IAW4S64SUYEWIXRMOGF2UR5BPTOY7QR4PN5NYHIWQ4NG63BA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.357882078 (190h45m1.055450485s) [noise=true , address=185.167.204.206:4048 , piece_id=LEAXXSSHIFJU3TS5J3BQDIWXJ3C5XIWME4RNIT7BJ5IVAKTWO6BQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.359020014 (190h45m1.05658835s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.361154070 (190h45m1.058722407s) [noise=true , address=185.167.204.205:4019 , piece_id=YZAF4ZJT6LFSPIIWIK7XZJCB5WFAIO7RZEI4LUWSJWGHRQPKZPUQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.362240620 (190h45m1.059808946s) [noise=true , address=185.167.204.206:4046 , piece_id=JTH4RAAVDOV4ZWVD234M3FND3HGBN7AMR7OYRH6RT77NEKRHUXSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.364011889 (190h45m1.061580205s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.375789861 (190h45m1.073358196s) [noise=true , address=185.167.204.206:4041 , piece_id=GB54B2DACB4YEFK6M3IZB5SQ5DPPD35DNVIGCT3LZ25OIFPASMMQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.379015597 (190h45m1.076583903s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.381428725 (190h45m1.078997041s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.387461184 (190h45m1.085029489s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390251637 (190h45m1.087819963s) [noise=true , address=185.167.204.206:4050 , piece_id=BI7ZNHPGLKGI7AGBGLQLV4GOF566LNZAVIXUZEJF6Y4D53T6OTBA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390490352 (190h45m1.088058658s) [noise=true , address=185.167.204.205:4020 , piece_id=IIP6TB55BMI447B22NQSY7MUXRBWAPWAW43HOMHR5KCE3JNB7WZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.392613419 (190h45m1.090181725s) [noise=true , address=81.171.14.70:4025 , piece_id=KGFO6JJAWV3PGU2R5VWZFE6SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.403941520 (190h45m1.101509826s) [noise=true , address=185.167.204.205:4031 , piece_id=VQML3S4F6PYYCX3DG54Q54VIEWMIZRFHIWBGIELYDW3V6CJVDVKA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.404283930 (190h45m1.101852266s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.439393256 (190h45m1.136961592s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.461982804 (190h45m1.15955112s) [noise=true , address=89.149.201.147:4005 , piece_id=OMXI6IUWPJ4R5CF2NU35WBAOWP32S6VJY4NFSSGD3DEDV4JWR4CQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.866666394 (190h45m1.56423473s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876288660 (190h45m1.573856996s) [noise=true , address=81.171.14.70:4027 , piece_id=GFCC4YJ6WI45RQSA5UU22PI2DCHNKCOPJNWJXBUKDOFHU7CJAGAQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876310151 (190h45m1.573878486s) [seg_pos={0 0}, upload=167512]: Segment reached optimal threshold of 26 pieces. Dec 13 14:14:13.876577870 (190h45m1.574146207s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876587379 (190h45m1.574155724s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876711831 (190h45m1.574280167s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876726428 (190h45m1.574294774s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876765780 (190h45m1.574334117s) [seg_pos={0 0}, upload=167512]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 14:14:13.876880185 (190h45m1.574448522s) [upload=167512]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 14:14:13.876886387 (190h45m1.574454723s) [upload=167512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 14:14:39.731793972 (190h45m27.429362317s) [upload=167512]: Done uploading segments... Dec 13 14:14:39.731821442 (190h45m27.429389779s) [upload=167512]: Upload finished. err: <nil> Duration: 2.480602844s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 866.469053ms trace: https://jaeger.dev.storj.io/trace/197d5bf95cf2aac7 FAIL (2025-12-13 14:42:13 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 866.490061ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..........................X.........XX..........X...........] duration: 2.938997039s trace: https://jaeger.dev.storj.io/trace/14df685fb176a112 FAIL (2025-12-13 14:41:56 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.939021614s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.633740411s trace: https://jaeger.dev.storj.io/trace/19084e8d3cf2aae8 FAIL (2025-12-13 14:41:27 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708151385 (190h45m0.405719722s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708453380 (190h45m0.406021686s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708592289 (190h45m0.406160635s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708744243 (190h45m0.406312559s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.708993619 (190h45m0.406561965s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709023485 (190h45m0.406591801s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709282308 (190h45m0.406850624s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709529339 (190h45m0.407097646s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.709802660 (190h45m0.407370976s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:12.710052527 (190h45m0.407620833s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Uploading piece... Dec 13 14:14:13.180560502 (190h45m0.878128818s) [upload=167512]: Next returned nil segment Dec 13 14:14:13.180570781 (190h45m0.878139097s) [upload=167512]: Waiting for error group managing segments... Dec 13 14:14:13.346901236 (190h45m1.044469572s) [noise=true , address=185.167.204.205:4033 , piece_id=GFEHNUBTV5UJUWSEBYQFNXXNFNTYGULKSKSQKQS7BP4YPFE67YOA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349132333 (190h45m1.04670071s) [noise=true , address=185.167.204.205:4035 , piece_id=OPSRXVKUGC3AR4UNZ2NE2KR3IJIFFYEEGKJOYCEGLN3GKXDT6SHA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.349252939 (190h45m1.046821285s) [noise=true , address=185.167.204.206:4043 , piece_id=JHOOH5DLKU2JKFMHEA4PRJ7D34HB3LRWUVDLTHFIUGOWX4TXRHUA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.350369674 (190h45m1.047938011s) [noise=true , address=185.167.204.206:4068 , piece_id=XUOIL7W3VRDX3SHVNKBFZ5JIIXBWULMY2PITDG22DTBQVZSGXYLA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.353825971 (190h45m1.051394318s) [noise=true , address=185.167.204.205:4006 , piece_id=YBXNX4FGALNOSBBNPU3SH2XRZUAB356LWMKAZ6DYI5XKPCOJ2IEA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.354886973 (190h45m1.052455309s) [noise=true , address=185.167.204.206:4060 , piece_id=22WIJIT3QKLZIK7TPG3QKRD6C2GKF44VIVAKPQFCWVX6ZLMFVTZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.355743614 (190h45m1.053311949s) [noise=true , address=185.167.204.206:4065 , piece_id=XQFKTLPSN2IDR23N43LS4KNAGKMQFH23BXY7ISSQT6IJ2ASPKWSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.356926985 (190h45m1.05449533s) [noise=true , address=185.167.204.206:4070 , piece_id=5HA3IAW4S64SUYEWIXRMOGF2UR5BPTOY7QR4PN5NYHIWQ4NG63BA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.357882078 (190h45m1.055450485s) [noise=true , address=185.167.204.206:4048 , piece_id=LEAXXSSHIFJU3TS5J3BQDIWXJ3C5XIWME4RNIT7BJ5IVAKTWO6BQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.359020014 (190h45m1.05658835s) [noise=true , address=185.167.204.206:4072 , piece_id=TKJOZQHQPNOPIEE2IENF7YHITIUONCAYEO5BHOCPHGYMZMEFYNIA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.361154070 (190h45m1.058722407s) [noise=true , address=185.167.204.205:4019 , piece_id=YZAF4ZJT6LFSPIIWIK7XZJCB5WFAIO7RZEI4LUWSJWGHRQPKZPUQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.362240620 (190h45m1.059808946s) [noise=true , address=185.167.204.206:4046 , piece_id=JTH4RAAVDOV4ZWVD234M3FND3HGBN7AMR7OYRH6RT77NEKRHUXSA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.364011889 (190h45m1.061580205s) [noise=true , address=185.167.204.205:4005 , piece_id=2UZLFIVDRF2AVGKWZ5BMVA75JAJ5WLYLPEE42QSAKHHZFXG3RBRQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.375789861 (190h45m1.073358196s) [noise=true , address=185.167.204.206:4041 , piece_id=GB54B2DACB4YEFK6M3IZB5SQ5DPPD35DNVIGCT3LZ25OIFPASMMQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.379015597 (190h45m1.076583903s) [noise=true , address=185.167.204.205:4015 , piece_id=GBP45VHS5HFIJ62SRRAC2EUS2PZQSZAYNBCGBHHOETJGVJ676E7A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.381428725 (190h45m1.078997041s) [noise=true , address=185.167.204.205:4030 , piece_id=OY6MRBGY6C2A6TU4CR4Y3IFBR7AIWDJPTZV4R3PG3FTGZNCJSQNA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.387461184 (190h45m1.085029489s) [noise=true , address=185.167.204.205:4026 , piece_id=G2S3P6OLW6PRHTHW6YKCU4A3XQDCYAAWW4MT7G5SONKYVUOSKQOQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390251637 (190h45m1.087819963s) [noise=true , address=185.167.204.206:4050 , piece_id=BI7ZNHPGLKGI7AGBGLQLV4GOF566LNZAVIXUZEJF6Y4D53T6OTBA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.390490352 (190h45m1.088058658s) [noise=true , address=185.167.204.205:4020 , piece_id=IIP6TB55BMI447B22NQSY7MUXRBWAPWAW43HOMHR5KCE3JNB7WZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.392613419 (190h45m1.090181725s) [noise=true , address=81.171.14.70:4025 , piece_id=KGFO6JJAWV3PGU2R5VWZFE6SOD2QR5OXNDYKFRM2HGU7SFVUHXZA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.403941520 (190h45m1.101509826s) [noise=true , address=185.167.204.205:4031 , piece_id=VQML3S4F6PYYCX3DG54Q54VIEWMIZRFHIWBGIELYDW3V6CJVDVKA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.404283930 (190h45m1.101852266s) [noise=true , address=185.167.204.205:4021 , piece_id=I63MPSYIFUMY25KHIK4VMVCBP5NAMLAH4IRPYPTNL27CGGG6575A, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.439393256 (190h45m1.136961592s) [noise=true , address=81.171.14.70:4039 , piece_id=X5FKSGQGJYE2QLB4O7W6KS5B5HDSG3GOA4IXMU4YGAKTY2L2VZHQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.461982804 (190h45m1.15955112s) [noise=true , address=89.149.201.147:4005 , piece_id=OMXI6IUWPJ4R5CF2NU35WBAOWP32S6VJY4NFSSGD3DEDV4JWR4CQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.866666394 (190h45m1.56423473s) [noise=true , address=81.171.14.70:4045 , piece_id=MHUNCLQFUDGUHBUKGR3CK3N3P7XEDVKQES4WEVTB477GUC3W6OBQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876288660 (190h45m1.573856996s) [noise=true , address=81.171.14.70:4027 , piece_id=GFCC4YJ6WI45RQSA5UU22PI2DCHNKCOPJNWJXBUKDOFHU7CJAGAQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: <nil> Dec 13 14:14:13.876310151 (190h45m1.573878486s) [seg_pos={0 0}, upload=167512]: Segment reached optimal threshold of 26 pieces. Dec 13 14:14:13.876577870 (190h45m1.574146207s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876587379 (190h45m1.574155724s) [noise=true , address=81.171.14.70:4041 , piece_id=TZ7LLSBDDJVI6CA7JMC6ITAHZ6R5OXJ5ZVRYBJAT4XYUAW3RAZDA, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876711831 (190h45m1.574280167s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5): protocol: expected piece hash; context canceled; EOF Dec 13 14:14:13.876726428 (190h45m1.574294774s) [noise=true , address=89.149.201.147:4016 , piece_id=BPJOMCVLU4BUEGQ66NPCZMY2WCCL7TR2P4KPEBXBNJD7CUUUAAWQ, seg_pos={0 0}, upload=167512]: Long tail cancellation due to optimal threshold Dec 13 14:14:13.876765780 (190h45m1.574334117s) [seg_pos={0 0}, upload=167512]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 13 14:14:13.876880185 (190h45m1.574448522s) [upload=167512]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 13 14:14:13.876886387 (190h45m1.574454723s) [upload=167512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 13 14:14:39.731793972 (190h45m27.429362317s) [upload=167512]: Done uploading segments... Dec 13 14:14:39.731821442 (190h45m27.429389779s) [upload=167512]: Upload finished. err: <nil> Duration: 2.633764696s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 4 out of 60 is failed (threshold=3) [...........................X.........XX..........X..........] duration: 2.790505337s trace: https://jaeger.dev.storj.io/trace/14df685fb176a112 FAIL (2025-12-13 14:41:11 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.790524724s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 890.724213ms trace: https://jaeger.dev.storj.io/trace/197d5bf95cf2aac7 FAIL (2025-12-13 14:41:00 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 890.74399ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 4 out of 60 is failed (threshold=3) [............................X.........XX..........X.........] duration: 2.703973547s trace: https://jaeger.dev.storj.io/trace/14df685fb176a112 FAIL (2025-12-13 14:40:32 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.704024123s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 896.945283ms trace: https://jaeger.dev.storj.io/trace/197d5bf95cf2aac7 FAIL (2025-12-13 14:40:22 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 896.971691ms core uplink eu1

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)