Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
164.281202ms
FAIL (2025-10-07 10:28:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 7 10:12:10.229965070 (932h3m45.582750178s) [upload=820275]: Starting upload Oct 7 10:12:10.230038448 (932h3m45.582823556s) [upload=820275]: Done starting upload Oct 7 10:12:10.230096046 (932h3m45.582881154s) [upload=820275]: Uploading segments... Oct 7 10:12:10.230132875 (932h3m45.582917983s) [upload=820275]: Got next segment. Inline: true Oct 7 10:12:10.230138986 (932h3m45.582924094s) [upload=820275]: Waiting for error group managing segments... Oct 7 10:12:10.230171558 (932h3m45.582956656s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 7 10:12:10.230175415 (932h3m45.582960513s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 7 10:12:10.230177529 (932h3m45.582962628s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 7 10:13:10.202118923 (932h4m45.554904031s) [upload=820275]: Done uploading segments... Oct 7 10:13:10.202134061 (932h4m45.55491917s) [upload=820275]: Upload finished. err: metaclient: context deadline exceeded
Duration: 164.329422ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
2.279843329s
FAIL (2025-10-07 10:28:28 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 2.279873606s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
189.660348ms
FAIL (2025-10-07 10:28:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 7 10:12:10.229965070 (932h3m45.582750178s) [upload=820275]: Starting upload Oct 7 10:12:10.230038448 (932h3m45.582823556s) [upload=820275]: Done starting upload Oct 7 10:12:10.230096046 (932h3m45.582881154s) [upload=820275]: Uploading segments... Oct 7 10:12:10.230132875 (932h3m45.582917983s) [upload=820275]: Got next segment. Inline: true Oct 7 10:12:10.230138986 (932h3m45.582924094s) [upload=820275]: Waiting for error group managing segments... Oct 7 10:12:10.230171558 (932h3m45.582956656s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 7 10:12:10.230175415 (932h3m45.582960513s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 7 10:12:10.230177529 (932h3m45.582962628s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 7 10:13:10.202118923 (932h4m45.554904031s) [upload=820275]: Done uploading segments... Oct 7 10:13:10.202134061 (932h4m45.55491917s) [upload=820275]: Upload finished. err: metaclient: context deadline exceeded
Duration: 189.678552ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [XX..........................................................] duration:
2.351966461s
FAIL (2025-10-07 10:28:05 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 23)
======LOGS======
WFZRTA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156581014 (931h35m48.509366112s) [noise=true , address=89.149.201.147:4013 , piece_id=ZDSSVS4VXF4HBWWASN2C7G2YFF2LDX3Q3SDBMUIFRFK3B2XXSBOQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156754609 (931h35m48.509539717s) [noise=true , address=81.171.14.70:4029 , piece_id=5PUSRNZMLVD52TK33GQ3OTWC3U5N3526V4JPJOTZU4N53J6IQMGQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156760662 (931h35m48.50954576s) [noise=true , address=81.171.14.70:4035 , piece_id=SLUDX3Y4VBI7NXJWDAK4MRFW5EJU5JRBSFCSHXRP75GOBCBQU5WQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157022393 (931h35m48.509807491s) [noise=true , address=81.171.14.70:4026 , piece_id=MVAEP4WRG5CQ4QAWOMB5JI7LFXQ2XXIQUWLKGD6FGYZO6OXNAWNA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157319349 (931h35m48.510104448s) [noise=true , address=185.167.204.205:4021 , piece_id=ZABC4XM4B3GI76CQ63FC3DPFJUNKD3SW3RRGWR6WHKSID2GLOKDA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157684756 (931h35m48.510469864s) [noise=true , address=89.149.201.147:4008 , piece_id=4VDQ3YJIO7WTIC3YV56ZAYYXE2BRTTWL2G2ZCVXSBBX57R2XCUYA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.158173573 (931h35m48.510958681s) [noise=true , address=185.167.204.205:4012 , piece_id=JCTVQTWNU5X7IB2JLL5E4ANPBIJOZFGHDIUAX6SL7ZLN6XYDUWGA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.158368348 (931h35m48.511153446s) [noise=true , address=185.167.204.206:4044 , piece_id=3ZDCAY4VYLT52AJORNLAFMYYI7WA6SEVUZQ4DR625DUSTWQ4J2VQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.159021985 (931h35m48.511807073s) [noise=true , address=81.171.14.70:4034 , piece_id=YADJOEALDIEY3LS5ZGQ5WP3YXWJDQ325HALNAHTQP43Q5ACABIBQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.607848645 (931h35m48.960633743s) [upload=819867]: Next returned nil segment
Oct 7 09:44:13.607861248 (931h35m48.960646356s) [upload=819867]: Waiting for error group managing segments...
Oct 7 09:44:13.778748780 (931h35m49.131533888s) [noise=true , address=81.171.14.70:4045 , piece_id=FSR77DDZPZUOWG664OGJIHMG4QMXDLYJDFZSIDEBM2JOYT7VOWZQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.781688647 (931h35m49.134473755s) [noise=true , address=81.171.14.70:4040 , piece_id=R2QKQJ7M7L26V3UMJKGHSXTCQODRGKDWT4GXCG5MEKD56YSI7KUQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.797470124 (931h35m49.150255232s) [noise=true , address=185.167.204.206:4068 , piece_id=HRQ7RG3QCA3YRUJTKTXCZ2QXGJQQJFKBZX5PHYF4AG3XWRSTEYQQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.798945413 (931h35m49.151730521s) [noise=true , address=185.167.204.206:4066 , piece_id=MC6WNACVRGQRCLF2OHLDTLLJCKUGA3XJPBN5T4QZUHC4RBR57NSA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.799672778 (931h35m49.152457886s) [noise=true , address=185.167.204.206:4044 , piece_id=3ZDCAY4VYLT52AJORNLAFMYYI7WA6SEVUZQ4DR625DUSTWQ4J2VQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.800694025 (931h35m49.153479133s) [noise=true , address=81.171.14.70:4043 , piece_id=GXEEOBGLYCQRH3R23NOQZ2XZLPY3PTHBWFF37UBQLL4QDVWFZRTA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.800815923 (931h35m49.153601031s) [noise=true , address=185.167.204.205:4021 , piece_id=ZABC4XM4B3GI76CQ63FC3DPFJUNKD3SW3RRGWR6WHKSID2GLOKDA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.803356381 (931h35m49.15614149s) [noise=true , address=185.167.204.206:4051 , piece_id=BNG3DAFHD4FOFXZMOZVPDLGBUX4HER2RX32POUNEX26DXU6GOTMA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.819254868 (931h35m49.172039976s) [noise=true , address=185.167.204.205:4012 , piece_id=JCTVQTWNU5X7IB2JLL5E4ANPBIJOZFGHDIUAX6SL7ZLN6XYDUWGA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.828359534 (931h35m49.181144643s) [noise=true , address=185.167.204.206:4063 , piece_id=ENFSIKRYEECUMNC76PCD442FCYYN4X4ZPKFXSPLEVNBBYA7QWS3Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.829841225 (931h35m49.182626323s) [noise=true , address=185.167.204.206:4041 , piece_id=KXQ5UIZXHDIWTOTTZR3G5EGRH7I55LWNH6OKR5HB6F3MOMBN4TDQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.830076737 (931h35m49.182861836s) [noise=true , address=89.149.201.147:4009 , piece_id=XUFZXG6VXQMI64FZFML6AX2VSZFEXDVDC2JDW7HDHSZ2C6UG55FA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.831280656 (931h35m49.184065754s) [noise=true , address=185.167.204.205:4029 , piece_id=GKGZUB2TTAIT67CCUMOOTPYMTMSGWD4RHW5GAXMIXQLXXQYPDY6Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.835538818 (931h35m49.188323926s) [noise=true , address=185.167.204.205:4009 , piece_id=F2OXD55LMZBZWP3OOD47VECF6QO74ND2LGMSLCBP6XMTBYLKKIDA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.839852703 (931h35m49.192637811s) [noise=true , address=185.167.204.206:4058 , piece_id=CWCQOHWD3LCWGDIE7FG26AB67NKYT442MPVIKICIHEAJ7RB5WDWA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.841847307 (931h35m49.194632406s) [noise=true , address=81.171.14.70:4035 , piece_id=SLUDX3Y4VBI7NXJWDAK4MRFW5EJU5JRBSFCSHXRP75GOBCBQU5WQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.849204934 (931h35m49.201990032s) [noise=true , address=89.149.201.147:4014 , piece_id=DWVUVNFYMZYWRIF4QU2UM5S4JBQWM2CBDNKVUOQOZDX4AY3KCF6Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.849297689 (931h35m49.202082787s) [noise=true , address=89.149.201.147:4010 , piece_id=PAKKECZ4EI45MTDWKQ6ACFVS3LQNCJJXO5NPRGAZ2ZUATYTX6ROQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.850790530 (931h35m49.203575629s) [noise=true , address=89.149.201.147:4011 , piece_id=23CV6F4FGTKWKAWDE7AUGQRWDFZGN37BIUQPJQXUH3HQWTURHUZQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.856762598 (931h35m49.209547696s) [noise=true , address=89.149.201.147:4008 , piece_id=4VDQ3YJIO7WTIC3YV56ZAYYXE2BRTTWL2G2ZCVXSBBX57R2XCUYA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.858751770 (931h35m49.211536869s) [noise=true , address=89.149.201.147:4013 , piece_id=ZDSSVS4VXF4HBWWASN2C7G2YFF2LDX3Q3SDBMUIFRFK3B2XXSBOQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.883309048 (931h35m49.236094146s) [noise=true , address=89.149.201.147:4002 , piece_id=BBRHLQDW22HSJE2P7LPE4Y67TOIQKFBQ4VQ5GKSF4KK5UDK3E23A, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.890627422 (931h35m49.24341253s) [noise=true , address=89.149.201.147:4012 , piece_id=VNITDM4Z3CWAGWHGOFMC3LP3E2GTVMFUT2FQL3I53HDK5ANYRNMA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:45:12.644603566 (931h36m47.997388694s) [noise=true , address=81.171.14.70:4033 , piece_id=FEOAQXS524JOQ76MV3AQPLIUCSGQUZBQOG4FJ43NKMFGOPWA6YQA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: write tcp 5.161.89.252:15820->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644683927 (931h36m47.997469065s) [noise=true , address=81.171.14.70:4029 , piece_id=5PUSRNZMLVD52TK33GQ3OTWC3U5N3526V4JPJOTZU4N53J6IQMGQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 5.161.89.252:42584->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644856971 (931h36m47.9976421s) [noise=true , address=81.171.14.70:4026 , piece_id=MVAEP4WRG5CQ4QAWOMB5JI7LFXQ2XXIQUWLKGD6FGYZO6OXNAWNA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: write tcp 5.161.89.252:25768->81.171.14.70:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644943003 (931h36m47.997728101s) [noise=true , address=81.171.14.70:4042 , piece_id=E2W7OQ3WJV5WBZVCR7UT3TPNGIZAQHKWVSVDFYXE3EYXPAKUOVRQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 5.161.89.252:48912->81.171.14.70:4042: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644981655 (931h36m47.997766803s) [noise=true , address=81.171.14.70:4034 , piece_id=YADJOEALDIEY3LS5ZGQ5WP3YXWJDQ325HALNAHTQP43Q5ACABIBQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: write tcp 5.161.89.252:57700->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.645044964 (931h36m47.997830102s) [seg_pos={0 0}, upload=819867]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil>
Oct 7 09:45:12.748884760 (931h36m48.101669889s) [upload=819867]: Done uploading segments...
Oct 7 09:45:12.748905800 (931h36m48.101690928s) [upload=819867]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23)
Duration: 2.351986329s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
285.51115ms
FAIL (2025-10-07 10:27:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 7 10:12:10.229965070 (932h3m45.582750178s) [upload=820275]: Starting upload Oct 7 10:12:10.230038448 (932h3m45.582823556s) [upload=820275]: Done starting upload Oct 7 10:12:10.230096046 (932h3m45.582881154s) [upload=820275]: Uploading segments... Oct 7 10:12:10.230132875 (932h3m45.582917983s) [upload=820275]: Got next segment. Inline: true Oct 7 10:12:10.230138986 (932h3m45.582924094s) [upload=820275]: Waiting for error group managing segments... Oct 7 10:12:10.230171558 (932h3m45.582956656s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 7 10:12:10.230175415 (932h3m45.582960513s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 7 10:12:10.230177529 (932h3m45.582962628s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 7 10:13:10.202118923 (932h4m45.554904031s) [upload=820275]: Done uploading segments... Oct 7 10:13:10.202134061 (932h4m45.55491917s) [upload=820275]: Upload finished. err: metaclient: context deadline exceeded
Duration: 285.533553ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
1.777566s
FAIL (2025-10-07 10:27:45 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 1.77758207s
core
uplink
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [XXX.........................................................] duration:
2.233303949s
FAIL (2025-10-07 10:27:27 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 23)
======LOGS======
WFZRTA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156581014 (931h35m48.509366112s) [noise=true , address=89.149.201.147:4013 , piece_id=ZDSSVS4VXF4HBWWASN2C7G2YFF2LDX3Q3SDBMUIFRFK3B2XXSBOQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156754609 (931h35m48.509539717s) [noise=true , address=81.171.14.70:4029 , piece_id=5PUSRNZMLVD52TK33GQ3OTWC3U5N3526V4JPJOTZU4N53J6IQMGQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156760662 (931h35m48.50954576s) [noise=true , address=81.171.14.70:4035 , piece_id=SLUDX3Y4VBI7NXJWDAK4MRFW5EJU5JRBSFCSHXRP75GOBCBQU5WQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157022393 (931h35m48.509807491s) [noise=true , address=81.171.14.70:4026 , piece_id=MVAEP4WRG5CQ4QAWOMB5JI7LFXQ2XXIQUWLKGD6FGYZO6OXNAWNA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157319349 (931h35m48.510104448s) [noise=true , address=185.167.204.205:4021 , piece_id=ZABC4XM4B3GI76CQ63FC3DPFJUNKD3SW3RRGWR6WHKSID2GLOKDA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157684756 (931h35m48.510469864s) [noise=true , address=89.149.201.147:4008 , piece_id=4VDQ3YJIO7WTIC3YV56ZAYYXE2BRTTWL2G2ZCVXSBBX57R2XCUYA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.158173573 (931h35m48.510958681s) [noise=true , address=185.167.204.205:4012 , piece_id=JCTVQTWNU5X7IB2JLL5E4ANPBIJOZFGHDIUAX6SL7ZLN6XYDUWGA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.158368348 (931h35m48.511153446s) [noise=true , address=185.167.204.206:4044 , piece_id=3ZDCAY4VYLT52AJORNLAFMYYI7WA6SEVUZQ4DR625DUSTWQ4J2VQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.159021985 (931h35m48.511807073s) [noise=true , address=81.171.14.70:4034 , piece_id=YADJOEALDIEY3LS5ZGQ5WP3YXWJDQ325HALNAHTQP43Q5ACABIBQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.607848645 (931h35m48.960633743s) [upload=819867]: Next returned nil segment
Oct 7 09:44:13.607861248 (931h35m48.960646356s) [upload=819867]: Waiting for error group managing segments...
Oct 7 09:44:13.778748780 (931h35m49.131533888s) [noise=true , address=81.171.14.70:4045 , piece_id=FSR77DDZPZUOWG664OGJIHMG4QMXDLYJDFZSIDEBM2JOYT7VOWZQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.781688647 (931h35m49.134473755s) [noise=true , address=81.171.14.70:4040 , piece_id=R2QKQJ7M7L26V3UMJKGHSXTCQODRGKDWT4GXCG5MEKD56YSI7KUQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.797470124 (931h35m49.150255232s) [noise=true , address=185.167.204.206:4068 , piece_id=HRQ7RG3QCA3YRUJTKTXCZ2QXGJQQJFKBZX5PHYF4AG3XWRSTEYQQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.798945413 (931h35m49.151730521s) [noise=true , address=185.167.204.206:4066 , piece_id=MC6WNACVRGQRCLF2OHLDTLLJCKUGA3XJPBN5T4QZUHC4RBR57NSA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.799672778 (931h35m49.152457886s) [noise=true , address=185.167.204.206:4044 , piece_id=3ZDCAY4VYLT52AJORNLAFMYYI7WA6SEVUZQ4DR625DUSTWQ4J2VQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.800694025 (931h35m49.153479133s) [noise=true , address=81.171.14.70:4043 , piece_id=GXEEOBGLYCQRH3R23NOQZ2XZLPY3PTHBWFF37UBQLL4QDVWFZRTA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.800815923 (931h35m49.153601031s) [noise=true , address=185.167.204.205:4021 , piece_id=ZABC4XM4B3GI76CQ63FC3DPFJUNKD3SW3RRGWR6WHKSID2GLOKDA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.803356381 (931h35m49.15614149s) [noise=true , address=185.167.204.206:4051 , piece_id=BNG3DAFHD4FOFXZMOZVPDLGBUX4HER2RX32POUNEX26DXU6GOTMA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.819254868 (931h35m49.172039976s) [noise=true , address=185.167.204.205:4012 , piece_id=JCTVQTWNU5X7IB2JLL5E4ANPBIJOZFGHDIUAX6SL7ZLN6XYDUWGA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.828359534 (931h35m49.181144643s) [noise=true , address=185.167.204.206:4063 , piece_id=ENFSIKRYEECUMNC76PCD442FCYYN4X4ZPKFXSPLEVNBBYA7QWS3Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.829841225 (931h35m49.182626323s) [noise=true , address=185.167.204.206:4041 , piece_id=KXQ5UIZXHDIWTOTTZR3G5EGRH7I55LWNH6OKR5HB6F3MOMBN4TDQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.830076737 (931h35m49.182861836s) [noise=true , address=89.149.201.147:4009 , piece_id=XUFZXG6VXQMI64FZFML6AX2VSZFEXDVDC2JDW7HDHSZ2C6UG55FA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.831280656 (931h35m49.184065754s) [noise=true , address=185.167.204.205:4029 , piece_id=GKGZUB2TTAIT67CCUMOOTPYMTMSGWD4RHW5GAXMIXQLXXQYPDY6Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.835538818 (931h35m49.188323926s) [noise=true , address=185.167.204.205:4009 , piece_id=F2OXD55LMZBZWP3OOD47VECF6QO74ND2LGMSLCBP6XMTBYLKKIDA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.839852703 (931h35m49.192637811s) [noise=true , address=185.167.204.206:4058 , piece_id=CWCQOHWD3LCWGDIE7FG26AB67NKYT442MPVIKICIHEAJ7RB5WDWA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.841847307 (931h35m49.194632406s) [noise=true , address=81.171.14.70:4035 , piece_id=SLUDX3Y4VBI7NXJWDAK4MRFW5EJU5JRBSFCSHXRP75GOBCBQU5WQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.849204934 (931h35m49.201990032s) [noise=true , address=89.149.201.147:4014 , piece_id=DWVUVNFYMZYWRIF4QU2UM5S4JBQWM2CBDNKVUOQOZDX4AY3KCF6Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.849297689 (931h35m49.202082787s) [noise=true , address=89.149.201.147:4010 , piece_id=PAKKECZ4EI45MTDWKQ6ACFVS3LQNCJJXO5NPRGAZ2ZUATYTX6ROQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.850790530 (931h35m49.203575629s) [noise=true , address=89.149.201.147:4011 , piece_id=23CV6F4FGTKWKAWDE7AUGQRWDFZGN37BIUQPJQXUH3HQWTURHUZQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.856762598 (931h35m49.209547696s) [noise=true , address=89.149.201.147:4008 , piece_id=4VDQ3YJIO7WTIC3YV56ZAYYXE2BRTTWL2G2ZCVXSBBX57R2XCUYA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.858751770 (931h35m49.211536869s) [noise=true , address=89.149.201.147:4013 , piece_id=ZDSSVS4VXF4HBWWASN2C7G2YFF2LDX3Q3SDBMUIFRFK3B2XXSBOQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.883309048 (931h35m49.236094146s) [noise=true , address=89.149.201.147:4002 , piece_id=BBRHLQDW22HSJE2P7LPE4Y67TOIQKFBQ4VQ5GKSF4KK5UDK3E23A, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.890627422 (931h35m49.24341253s) [noise=true , address=89.149.201.147:4012 , piece_id=VNITDM4Z3CWAGWHGOFMC3LP3E2GTVMFUT2FQL3I53HDK5ANYRNMA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:45:12.644603566 (931h36m47.997388694s) [noise=true , address=81.171.14.70:4033 , piece_id=FEOAQXS524JOQ76MV3AQPLIUCSGQUZBQOG4FJ43NKMFGOPWA6YQA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: write tcp 5.161.89.252:15820->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644683927 (931h36m47.997469065s) [noise=true , address=81.171.14.70:4029 , piece_id=5PUSRNZMLVD52TK33GQ3OTWC3U5N3526V4JPJOTZU4N53J6IQMGQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 5.161.89.252:42584->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644856971 (931h36m47.9976421s) [noise=true , address=81.171.14.70:4026 , piece_id=MVAEP4WRG5CQ4QAWOMB5JI7LFXQ2XXIQUWLKGD6FGYZO6OXNAWNA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: write tcp 5.161.89.252:25768->81.171.14.70:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644943003 (931h36m47.997728101s) [noise=true , address=81.171.14.70:4042 , piece_id=E2W7OQ3WJV5WBZVCR7UT3TPNGIZAQHKWVSVDFYXE3EYXPAKUOVRQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 5.161.89.252:48912->81.171.14.70:4042: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644981655 (931h36m47.997766803s) [noise=true , address=81.171.14.70:4034 , piece_id=YADJOEALDIEY3LS5ZGQ5WP3YXWJDQ325HALNAHTQP43Q5ACABIBQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: write tcp 5.161.89.252:57700->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.645044964 (931h36m47.997830102s) [seg_pos={0 0}, upload=819867]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil>
Oct 7 09:45:12.748884760 (931h36m48.101669889s) [upload=819867]: Done uploading segments...
Oct 7 09:45:12.748905800 (931h36m48.101690928s) [upload=819867]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23)
Duration: 2.233328946s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
214.363872ms
FAIL (2025-10-07 10:26:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 7 10:12:10.229965070 (932h3m45.582750178s) [upload=820275]: Starting upload Oct 7 10:12:10.230038448 (932h3m45.582823556s) [upload=820275]: Done starting upload Oct 7 10:12:10.230096046 (932h3m45.582881154s) [upload=820275]: Uploading segments... Oct 7 10:12:10.230132875 (932h3m45.582917983s) [upload=820275]: Got next segment. Inline: true Oct 7 10:12:10.230138986 (932h3m45.582924094s) [upload=820275]: Waiting for error group managing segments... Oct 7 10:12:10.230171558 (932h3m45.582956656s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 7 10:12:10.230175415 (932h3m45.582960513s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 7 10:12:10.230177529 (932h3m45.582962628s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 7 10:13:10.202118923 (932h4m45.554904031s) [upload=820275]: Done uploading segments... Oct 7 10:13:10.202134061 (932h4m45.55491917s) [upload=820275]: Upload finished. err: metaclient: context deadline exceeded
Duration: 214.390803ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [.XXX........................................................] duration:
2.279914813s
FAIL (2025-10-07 10:26:37 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 23)
======LOGS======
WFZRTA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156581014 (931h35m48.509366112s) [noise=true , address=89.149.201.147:4013 , piece_id=ZDSSVS4VXF4HBWWASN2C7G2YFF2LDX3Q3SDBMUIFRFK3B2XXSBOQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156754609 (931h35m48.509539717s) [noise=true , address=81.171.14.70:4029 , piece_id=5PUSRNZMLVD52TK33GQ3OTWC3U5N3526V4JPJOTZU4N53J6IQMGQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156760662 (931h35m48.50954576s) [noise=true , address=81.171.14.70:4035 , piece_id=SLUDX3Y4VBI7NXJWDAK4MRFW5EJU5JRBSFCSHXRP75GOBCBQU5WQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157022393 (931h35m48.509807491s) [noise=true , address=81.171.14.70:4026 , piece_id=MVAEP4WRG5CQ4QAWOMB5JI7LFXQ2XXIQUWLKGD6FGYZO6OXNAWNA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157319349 (931h35m48.510104448s) [noise=true , address=185.167.204.205:4021 , piece_id=ZABC4XM4B3GI76CQ63FC3DPFJUNKD3SW3RRGWR6WHKSID2GLOKDA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157684756 (931h35m48.510469864s) [noise=true , address=89.149.201.147:4008 , piece_id=4VDQ3YJIO7WTIC3YV56ZAYYXE2BRTTWL2G2ZCVXSBBX57R2XCUYA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.158173573 (931h35m48.510958681s) [noise=true , address=185.167.204.205:4012 , piece_id=JCTVQTWNU5X7IB2JLL5E4ANPBIJOZFGHDIUAX6SL7ZLN6XYDUWGA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.158368348 (931h35m48.511153446s) [noise=true , address=185.167.204.206:4044 , piece_id=3ZDCAY4VYLT52AJORNLAFMYYI7WA6SEVUZQ4DR625DUSTWQ4J2VQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.159021985 (931h35m48.511807073s) [noise=true , address=81.171.14.70:4034 , piece_id=YADJOEALDIEY3LS5ZGQ5WP3YXWJDQ325HALNAHTQP43Q5ACABIBQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.607848645 (931h35m48.960633743s) [upload=819867]: Next returned nil segment
Oct 7 09:44:13.607861248 (931h35m48.960646356s) [upload=819867]: Waiting for error group managing segments...
Oct 7 09:44:13.778748780 (931h35m49.131533888s) [noise=true , address=81.171.14.70:4045 , piece_id=FSR77DDZPZUOWG664OGJIHMG4QMXDLYJDFZSIDEBM2JOYT7VOWZQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.781688647 (931h35m49.134473755s) [noise=true , address=81.171.14.70:4040 , piece_id=R2QKQJ7M7L26V3UMJKGHSXTCQODRGKDWT4GXCG5MEKD56YSI7KUQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.797470124 (931h35m49.150255232s) [noise=true , address=185.167.204.206:4068 , piece_id=HRQ7RG3QCA3YRUJTKTXCZ2QXGJQQJFKBZX5PHYF4AG3XWRSTEYQQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.798945413 (931h35m49.151730521s) [noise=true , address=185.167.204.206:4066 , piece_id=MC6WNACVRGQRCLF2OHLDTLLJCKUGA3XJPBN5T4QZUHC4RBR57NSA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.799672778 (931h35m49.152457886s) [noise=true , address=185.167.204.206:4044 , piece_id=3ZDCAY4VYLT52AJORNLAFMYYI7WA6SEVUZQ4DR625DUSTWQ4J2VQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.800694025 (931h35m49.153479133s) [noise=true , address=81.171.14.70:4043 , piece_id=GXEEOBGLYCQRH3R23NOQZ2XZLPY3PTHBWFF37UBQLL4QDVWFZRTA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.800815923 (931h35m49.153601031s) [noise=true , address=185.167.204.205:4021 , piece_id=ZABC4XM4B3GI76CQ63FC3DPFJUNKD3SW3RRGWR6WHKSID2GLOKDA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.803356381 (931h35m49.15614149s) [noise=true , address=185.167.204.206:4051 , piece_id=BNG3DAFHD4FOFXZMOZVPDLGBUX4HER2RX32POUNEX26DXU6GOTMA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.819254868 (931h35m49.172039976s) [noise=true , address=185.167.204.205:4012 , piece_id=JCTVQTWNU5X7IB2JLL5E4ANPBIJOZFGHDIUAX6SL7ZLN6XYDUWGA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.828359534 (931h35m49.181144643s) [noise=true , address=185.167.204.206:4063 , piece_id=ENFSIKRYEECUMNC76PCD442FCYYN4X4ZPKFXSPLEVNBBYA7QWS3Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.829841225 (931h35m49.182626323s) [noise=true , address=185.167.204.206:4041 , piece_id=KXQ5UIZXHDIWTOTTZR3G5EGRH7I55LWNH6OKR5HB6F3MOMBN4TDQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.830076737 (931h35m49.182861836s) [noise=true , address=89.149.201.147:4009 , piece_id=XUFZXG6VXQMI64FZFML6AX2VSZFEXDVDC2JDW7HDHSZ2C6UG55FA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.831280656 (931h35m49.184065754s) [noise=true , address=185.167.204.205:4029 , piece_id=GKGZUB2TTAIT67CCUMOOTPYMTMSGWD4RHW5GAXMIXQLXXQYPDY6Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.835538818 (931h35m49.188323926s) [noise=true , address=185.167.204.205:4009 , piece_id=F2OXD55LMZBZWP3OOD47VECF6QO74ND2LGMSLCBP6XMTBYLKKIDA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.839852703 (931h35m49.192637811s) [noise=true , address=185.167.204.206:4058 , piece_id=CWCQOHWD3LCWGDIE7FG26AB67NKYT442MPVIKICIHEAJ7RB5WDWA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.841847307 (931h35m49.194632406s) [noise=true , address=81.171.14.70:4035 , piece_id=SLUDX3Y4VBI7NXJWDAK4MRFW5EJU5JRBSFCSHXRP75GOBCBQU5WQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.849204934 (931h35m49.201990032s) [noise=true , address=89.149.201.147:4014 , piece_id=DWVUVNFYMZYWRIF4QU2UM5S4JBQWM2CBDNKVUOQOZDX4AY3KCF6Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.849297689 (931h35m49.202082787s) [noise=true , address=89.149.201.147:4010 , piece_id=PAKKECZ4EI45MTDWKQ6ACFVS3LQNCJJXO5NPRGAZ2ZUATYTX6ROQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.850790530 (931h35m49.203575629s) [noise=true , address=89.149.201.147:4011 , piece_id=23CV6F4FGTKWKAWDE7AUGQRWDFZGN37BIUQPJQXUH3HQWTURHUZQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.856762598 (931h35m49.209547696s) [noise=true , address=89.149.201.147:4008 , piece_id=4VDQ3YJIO7WTIC3YV56ZAYYXE2BRTTWL2G2ZCVXSBBX57R2XCUYA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.858751770 (931h35m49.211536869s) [noise=true , address=89.149.201.147:4013 , piece_id=ZDSSVS4VXF4HBWWASN2C7G2YFF2LDX3Q3SDBMUIFRFK3B2XXSBOQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.883309048 (931h35m49.236094146s) [noise=true , address=89.149.201.147:4002 , piece_id=BBRHLQDW22HSJE2P7LPE4Y67TOIQKFBQ4VQ5GKSF4KK5UDK3E23A, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.890627422 (931h35m49.24341253s) [noise=true , address=89.149.201.147:4012 , piece_id=VNITDM4Z3CWAGWHGOFMC3LP3E2GTVMFUT2FQL3I53HDK5ANYRNMA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:45:12.644603566 (931h36m47.997388694s) [noise=true , address=81.171.14.70:4033 , piece_id=FEOAQXS524JOQ76MV3AQPLIUCSGQUZBQOG4FJ43NKMFGOPWA6YQA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: write tcp 5.161.89.252:15820->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644683927 (931h36m47.997469065s) [noise=true , address=81.171.14.70:4029 , piece_id=5PUSRNZMLVD52TK33GQ3OTWC3U5N3526V4JPJOTZU4N53J6IQMGQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 5.161.89.252:42584->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644856971 (931h36m47.9976421s) [noise=true , address=81.171.14.70:4026 , piece_id=MVAEP4WRG5CQ4QAWOMB5JI7LFXQ2XXIQUWLKGD6FGYZO6OXNAWNA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: write tcp 5.161.89.252:25768->81.171.14.70:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644943003 (931h36m47.997728101s) [noise=true , address=81.171.14.70:4042 , piece_id=E2W7OQ3WJV5WBZVCR7UT3TPNGIZAQHKWVSVDFYXE3EYXPAKUOVRQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 5.161.89.252:48912->81.171.14.70:4042: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644981655 (931h36m47.997766803s) [noise=true , address=81.171.14.70:4034 , piece_id=YADJOEALDIEY3LS5ZGQ5WP3YXWJDQ325HALNAHTQP43Q5ACABIBQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: write tcp 5.161.89.252:57700->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.645044964 (931h36m47.997830102s) [seg_pos={0 0}, upload=819867]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil>
Oct 7 09:45:12.748884760 (931h36m48.101669889s) [upload=819867]: Done uploading segments...
Oct 7 09:45:12.748905800 (931h36m48.101690928s) [upload=819867]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23)
Duration: 2.279939759s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
1.829564563s
FAIL (2025-10-07 10:26:34 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 1.829585161s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
1.679419169s
FAIL (2025-10-07 10:26:17 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 1.679436161s
core
uplink
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [..XXX.......................................................] duration:
2.347209791s
FAIL (2025-10-07 10:26:11 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 23)
======LOGS======
WFZRTA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156581014 (931h35m48.509366112s) [noise=true , address=89.149.201.147:4013 , piece_id=ZDSSVS4VXF4HBWWASN2C7G2YFF2LDX3Q3SDBMUIFRFK3B2XXSBOQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156754609 (931h35m48.509539717s) [noise=true , address=81.171.14.70:4029 , piece_id=5PUSRNZMLVD52TK33GQ3OTWC3U5N3526V4JPJOTZU4N53J6IQMGQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156760662 (931h35m48.50954576s) [noise=true , address=81.171.14.70:4035 , piece_id=SLUDX3Y4VBI7NXJWDAK4MRFW5EJU5JRBSFCSHXRP75GOBCBQU5WQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157022393 (931h35m48.509807491s) [noise=true , address=81.171.14.70:4026 , piece_id=MVAEP4WRG5CQ4QAWOMB5JI7LFXQ2XXIQUWLKGD6FGYZO6OXNAWNA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157319349 (931h35m48.510104448s) [noise=true , address=185.167.204.205:4021 , piece_id=ZABC4XM4B3GI76CQ63FC3DPFJUNKD3SW3RRGWR6WHKSID2GLOKDA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157684756 (931h35m48.510469864s) [noise=true , address=89.149.201.147:4008 , piece_id=4VDQ3YJIO7WTIC3YV56ZAYYXE2BRTTWL2G2ZCVXSBBX57R2XCUYA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.158173573 (931h35m48.510958681s) [noise=true , address=185.167.204.205:4012 , piece_id=JCTVQTWNU5X7IB2JLL5E4ANPBIJOZFGHDIUAX6SL7ZLN6XYDUWGA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.158368348 (931h35m48.511153446s) [noise=true , address=185.167.204.206:4044 , piece_id=3ZDCAY4VYLT52AJORNLAFMYYI7WA6SEVUZQ4DR625DUSTWQ4J2VQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.159021985 (931h35m48.511807073s) [noise=true , address=81.171.14.70:4034 , piece_id=YADJOEALDIEY3LS5ZGQ5WP3YXWJDQ325HALNAHTQP43Q5ACABIBQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.607848645 (931h35m48.960633743s) [upload=819867]: Next returned nil segment
Oct 7 09:44:13.607861248 (931h35m48.960646356s) [upload=819867]: Waiting for error group managing segments...
Oct 7 09:44:13.778748780 (931h35m49.131533888s) [noise=true , address=81.171.14.70:4045 , piece_id=FSR77DDZPZUOWG664OGJIHMG4QMXDLYJDFZSIDEBM2JOYT7VOWZQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.781688647 (931h35m49.134473755s) [noise=true , address=81.171.14.70:4040 , piece_id=R2QKQJ7M7L26V3UMJKGHSXTCQODRGKDWT4GXCG5MEKD56YSI7KUQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.797470124 (931h35m49.150255232s) [noise=true , address=185.167.204.206:4068 , piece_id=HRQ7RG3QCA3YRUJTKTXCZ2QXGJQQJFKBZX5PHYF4AG3XWRSTEYQQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.798945413 (931h35m49.151730521s) [noise=true , address=185.167.204.206:4066 , piece_id=MC6WNACVRGQRCLF2OHLDTLLJCKUGA3XJPBN5T4QZUHC4RBR57NSA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.799672778 (931h35m49.152457886s) [noise=true , address=185.167.204.206:4044 , piece_id=3ZDCAY4VYLT52AJORNLAFMYYI7WA6SEVUZQ4DR625DUSTWQ4J2VQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.800694025 (931h35m49.153479133s) [noise=true , address=81.171.14.70:4043 , piece_id=GXEEOBGLYCQRH3R23NOQZ2XZLPY3PTHBWFF37UBQLL4QDVWFZRTA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.800815923 (931h35m49.153601031s) [noise=true , address=185.167.204.205:4021 , piece_id=ZABC4XM4B3GI76CQ63FC3DPFJUNKD3SW3RRGWR6WHKSID2GLOKDA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.803356381 (931h35m49.15614149s) [noise=true , address=185.167.204.206:4051 , piece_id=BNG3DAFHD4FOFXZMOZVPDLGBUX4HER2RX32POUNEX26DXU6GOTMA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.819254868 (931h35m49.172039976s) [noise=true , address=185.167.204.205:4012 , piece_id=JCTVQTWNU5X7IB2JLL5E4ANPBIJOZFGHDIUAX6SL7ZLN6XYDUWGA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.828359534 (931h35m49.181144643s) [noise=true , address=185.167.204.206:4063 , piece_id=ENFSIKRYEECUMNC76PCD442FCYYN4X4ZPKFXSPLEVNBBYA7QWS3Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.829841225 (931h35m49.182626323s) [noise=true , address=185.167.204.206:4041 , piece_id=KXQ5UIZXHDIWTOTTZR3G5EGRH7I55LWNH6OKR5HB6F3MOMBN4TDQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.830076737 (931h35m49.182861836s) [noise=true , address=89.149.201.147:4009 , piece_id=XUFZXG6VXQMI64FZFML6AX2VSZFEXDVDC2JDW7HDHSZ2C6UG55FA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.831280656 (931h35m49.184065754s) [noise=true , address=185.167.204.205:4029 , piece_id=GKGZUB2TTAIT67CCUMOOTPYMTMSGWD4RHW5GAXMIXQLXXQYPDY6Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.835538818 (931h35m49.188323926s) [noise=true , address=185.167.204.205:4009 , piece_id=F2OXD55LMZBZWP3OOD47VECF6QO74ND2LGMSLCBP6XMTBYLKKIDA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.839852703 (931h35m49.192637811s) [noise=true , address=185.167.204.206:4058 , piece_id=CWCQOHWD3LCWGDIE7FG26AB67NKYT442MPVIKICIHEAJ7RB5WDWA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.841847307 (931h35m49.194632406s) [noise=true , address=81.171.14.70:4035 , piece_id=SLUDX3Y4VBI7NXJWDAK4MRFW5EJU5JRBSFCSHXRP75GOBCBQU5WQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.849204934 (931h35m49.201990032s) [noise=true , address=89.149.201.147:4014 , piece_id=DWVUVNFYMZYWRIF4QU2UM5S4JBQWM2CBDNKVUOQOZDX4AY3KCF6Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.849297689 (931h35m49.202082787s) [noise=true , address=89.149.201.147:4010 , piece_id=PAKKECZ4EI45MTDWKQ6ACFVS3LQNCJJXO5NPRGAZ2ZUATYTX6ROQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.850790530 (931h35m49.203575629s) [noise=true , address=89.149.201.147:4011 , piece_id=23CV6F4FGTKWKAWDE7AUGQRWDFZGN37BIUQPJQXUH3HQWTURHUZQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.856762598 (931h35m49.209547696s) [noise=true , address=89.149.201.147:4008 , piece_id=4VDQ3YJIO7WTIC3YV56ZAYYXE2BRTTWL2G2ZCVXSBBX57R2XCUYA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.858751770 (931h35m49.211536869s) [noise=true , address=89.149.201.147:4013 , piece_id=ZDSSVS4VXF4HBWWASN2C7G2YFF2LDX3Q3SDBMUIFRFK3B2XXSBOQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.883309048 (931h35m49.236094146s) [noise=true , address=89.149.201.147:4002 , piece_id=BBRHLQDW22HSJE2P7LPE4Y67TOIQKFBQ4VQ5GKSF4KK5UDK3E23A, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.890627422 (931h35m49.24341253s) [noise=true , address=89.149.201.147:4012 , piece_id=VNITDM4Z3CWAGWHGOFMC3LP3E2GTVMFUT2FQL3I53HDK5ANYRNMA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:45:12.644603566 (931h36m47.997388694s) [noise=true , address=81.171.14.70:4033 , piece_id=FEOAQXS524JOQ76MV3AQPLIUCSGQUZBQOG4FJ43NKMFGOPWA6YQA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: write tcp 5.161.89.252:15820->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644683927 (931h36m47.997469065s) [noise=true , address=81.171.14.70:4029 , piece_id=5PUSRNZMLVD52TK33GQ3OTWC3U5N3526V4JPJOTZU4N53J6IQMGQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 5.161.89.252:42584->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644856971 (931h36m47.9976421s) [noise=true , address=81.171.14.70:4026 , piece_id=MVAEP4WRG5CQ4QAWOMB5JI7LFXQ2XXIQUWLKGD6FGYZO6OXNAWNA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: write tcp 5.161.89.252:25768->81.171.14.70:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644943003 (931h36m47.997728101s) [noise=true , address=81.171.14.70:4042 , piece_id=E2W7OQ3WJV5WBZVCR7UT3TPNGIZAQHKWVSVDFYXE3EYXPAKUOVRQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 5.161.89.252:48912->81.171.14.70:4042: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644981655 (931h36m47.997766803s) [noise=true , address=81.171.14.70:4034 , piece_id=YADJOEALDIEY3LS5ZGQ5WP3YXWJDQ325HALNAHTQP43Q5ACABIBQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: write tcp 5.161.89.252:57700->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.645044964 (931h36m47.997830102s) [seg_pos={0 0}, upload=819867]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil>
Oct 7 09:45:12.748884760 (931h36m48.101669889s) [upload=819867]: Done uploading segments...
Oct 7 09:45:12.748905800 (931h36m48.101690928s) [upload=819867]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23)
Duration: 2.347228576s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
1.683813416s
FAIL (2025-10-07 10:25:56 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 1.683836619s
core
uplink
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [...XXX......................................................] duration:
2.329890869s
FAIL (2025-10-07 10:25:46 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 23)
======LOGS======
WFZRTA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156581014 (931h35m48.509366112s) [noise=true , address=89.149.201.147:4013 , piece_id=ZDSSVS4VXF4HBWWASN2C7G2YFF2LDX3Q3SDBMUIFRFK3B2XXSBOQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156754609 (931h35m48.509539717s) [noise=true , address=81.171.14.70:4029 , piece_id=5PUSRNZMLVD52TK33GQ3OTWC3U5N3526V4JPJOTZU4N53J6IQMGQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156760662 (931h35m48.50954576s) [noise=true , address=81.171.14.70:4035 , piece_id=SLUDX3Y4VBI7NXJWDAK4MRFW5EJU5JRBSFCSHXRP75GOBCBQU5WQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157022393 (931h35m48.509807491s) [noise=true , address=81.171.14.70:4026 , piece_id=MVAEP4WRG5CQ4QAWOMB5JI7LFXQ2XXIQUWLKGD6FGYZO6OXNAWNA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157319349 (931h35m48.510104448s) [noise=true , address=185.167.204.205:4021 , piece_id=ZABC4XM4B3GI76CQ63FC3DPFJUNKD3SW3RRGWR6WHKSID2GLOKDA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157684756 (931h35m48.510469864s) [noise=true , address=89.149.201.147:4008 , piece_id=4VDQ3YJIO7WTIC3YV56ZAYYXE2BRTTWL2G2ZCVXSBBX57R2XCUYA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.158173573 (931h35m48.510958681s) [noise=true , address=185.167.204.205:4012 , piece_id=JCTVQTWNU5X7IB2JLL5E4ANPBIJOZFGHDIUAX6SL7ZLN6XYDUWGA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.158368348 (931h35m48.511153446s) [noise=true , address=185.167.204.206:4044 , piece_id=3ZDCAY4VYLT52AJORNLAFMYYI7WA6SEVUZQ4DR625DUSTWQ4J2VQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.159021985 (931h35m48.511807073s) [noise=true , address=81.171.14.70:4034 , piece_id=YADJOEALDIEY3LS5ZGQ5WP3YXWJDQ325HALNAHTQP43Q5ACABIBQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.607848645 (931h35m48.960633743s) [upload=819867]: Next returned nil segment
Oct 7 09:44:13.607861248 (931h35m48.960646356s) [upload=819867]: Waiting for error group managing segments...
Oct 7 09:44:13.778748780 (931h35m49.131533888s) [noise=true , address=81.171.14.70:4045 , piece_id=FSR77DDZPZUOWG664OGJIHMG4QMXDLYJDFZSIDEBM2JOYT7VOWZQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.781688647 (931h35m49.134473755s) [noise=true , address=81.171.14.70:4040 , piece_id=R2QKQJ7M7L26V3UMJKGHSXTCQODRGKDWT4GXCG5MEKD56YSI7KUQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.797470124 (931h35m49.150255232s) [noise=true , address=185.167.204.206:4068 , piece_id=HRQ7RG3QCA3YRUJTKTXCZ2QXGJQQJFKBZX5PHYF4AG3XWRSTEYQQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.798945413 (931h35m49.151730521s) [noise=true , address=185.167.204.206:4066 , piece_id=MC6WNACVRGQRCLF2OHLDTLLJCKUGA3XJPBN5T4QZUHC4RBR57NSA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.799672778 (931h35m49.152457886s) [noise=true , address=185.167.204.206:4044 , piece_id=3ZDCAY4VYLT52AJORNLAFMYYI7WA6SEVUZQ4DR625DUSTWQ4J2VQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.800694025 (931h35m49.153479133s) [noise=true , address=81.171.14.70:4043 , piece_id=GXEEOBGLYCQRH3R23NOQZ2XZLPY3PTHBWFF37UBQLL4QDVWFZRTA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.800815923 (931h35m49.153601031s) [noise=true , address=185.167.204.205:4021 , piece_id=ZABC4XM4B3GI76CQ63FC3DPFJUNKD3SW3RRGWR6WHKSID2GLOKDA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.803356381 (931h35m49.15614149s) [noise=true , address=185.167.204.206:4051 , piece_id=BNG3DAFHD4FOFXZMOZVPDLGBUX4HER2RX32POUNEX26DXU6GOTMA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.819254868 (931h35m49.172039976s) [noise=true , address=185.167.204.205:4012 , piece_id=JCTVQTWNU5X7IB2JLL5E4ANPBIJOZFGHDIUAX6SL7ZLN6XYDUWGA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.828359534 (931h35m49.181144643s) [noise=true , address=185.167.204.206:4063 , piece_id=ENFSIKRYEECUMNC76PCD442FCYYN4X4ZPKFXSPLEVNBBYA7QWS3Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.829841225 (931h35m49.182626323s) [noise=true , address=185.167.204.206:4041 , piece_id=KXQ5UIZXHDIWTOTTZR3G5EGRH7I55LWNH6OKR5HB6F3MOMBN4TDQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.830076737 (931h35m49.182861836s) [noise=true , address=89.149.201.147:4009 , piece_id=XUFZXG6VXQMI64FZFML6AX2VSZFEXDVDC2JDW7HDHSZ2C6UG55FA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.831280656 (931h35m49.184065754s) [noise=true , address=185.167.204.205:4029 , piece_id=GKGZUB2TTAIT67CCUMOOTPYMTMSGWD4RHW5GAXMIXQLXXQYPDY6Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.835538818 (931h35m49.188323926s) [noise=true , address=185.167.204.205:4009 , piece_id=F2OXD55LMZBZWP3OOD47VECF6QO74ND2LGMSLCBP6XMTBYLKKIDA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.839852703 (931h35m49.192637811s) [noise=true , address=185.167.204.206:4058 , piece_id=CWCQOHWD3LCWGDIE7FG26AB67NKYT442MPVIKICIHEAJ7RB5WDWA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.841847307 (931h35m49.194632406s) [noise=true , address=81.171.14.70:4035 , piece_id=SLUDX3Y4VBI7NXJWDAK4MRFW5EJU5JRBSFCSHXRP75GOBCBQU5WQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.849204934 (931h35m49.201990032s) [noise=true , address=89.149.201.147:4014 , piece_id=DWVUVNFYMZYWRIF4QU2UM5S4JBQWM2CBDNKVUOQOZDX4AY3KCF6Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.849297689 (931h35m49.202082787s) [noise=true , address=89.149.201.147:4010 , piece_id=PAKKECZ4EI45MTDWKQ6ACFVS3LQNCJJXO5NPRGAZ2ZUATYTX6ROQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.850790530 (931h35m49.203575629s) [noise=true , address=89.149.201.147:4011 , piece_id=23CV6F4FGTKWKAWDE7AUGQRWDFZGN37BIUQPJQXUH3HQWTURHUZQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.856762598 (931h35m49.209547696s) [noise=true , address=89.149.201.147:4008 , piece_id=4VDQ3YJIO7WTIC3YV56ZAYYXE2BRTTWL2G2ZCVXSBBX57R2XCUYA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.858751770 (931h35m49.211536869s) [noise=true , address=89.149.201.147:4013 , piece_id=ZDSSVS4VXF4HBWWASN2C7G2YFF2LDX3Q3SDBMUIFRFK3B2XXSBOQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.883309048 (931h35m49.236094146s) [noise=true , address=89.149.201.147:4002 , piece_id=BBRHLQDW22HSJE2P7LPE4Y67TOIQKFBQ4VQ5GKSF4KK5UDK3E23A, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.890627422 (931h35m49.24341253s) [noise=true , address=89.149.201.147:4012 , piece_id=VNITDM4Z3CWAGWHGOFMC3LP3E2GTVMFUT2FQL3I53HDK5ANYRNMA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:45:12.644603566 (931h36m47.997388694s) [noise=true , address=81.171.14.70:4033 , piece_id=FEOAQXS524JOQ76MV3AQPLIUCSGQUZBQOG4FJ43NKMFGOPWA6YQA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: write tcp 5.161.89.252:15820->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644683927 (931h36m47.997469065s) [noise=true , address=81.171.14.70:4029 , piece_id=5PUSRNZMLVD52TK33GQ3OTWC3U5N3526V4JPJOTZU4N53J6IQMGQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 5.161.89.252:42584->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644856971 (931h36m47.9976421s) [noise=true , address=81.171.14.70:4026 , piece_id=MVAEP4WRG5CQ4QAWOMB5JI7LFXQ2XXIQUWLKGD6FGYZO6OXNAWNA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: write tcp 5.161.89.252:25768->81.171.14.70:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644943003 (931h36m47.997728101s) [noise=true , address=81.171.14.70:4042 , piece_id=E2W7OQ3WJV5WBZVCR7UT3TPNGIZAQHKWVSVDFYXE3EYXPAKUOVRQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 5.161.89.252:48912->81.171.14.70:4042: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644981655 (931h36m47.997766803s) [noise=true , address=81.171.14.70:4034 , piece_id=YADJOEALDIEY3LS5ZGQ5WP3YXWJDQ325HALNAHTQP43Q5ACABIBQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: write tcp 5.161.89.252:57700->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.645044964 (931h36m47.997830102s) [seg_pos={0 0}, upload=819867]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil>
Oct 7 09:45:12.748884760 (931h36m48.101669889s) [upload=819867]: Done uploading segments...
Oct 7 09:45:12.748905800 (931h36m48.101690928s) [upload=819867]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23)
Duration: 2.329913261s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
234.250934ms
FAIL (2025-10-07 10:25:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 7 10:12:10.229965070 (932h3m45.582750178s) [upload=820275]: Starting upload Oct 7 10:12:10.230038448 (932h3m45.582823556s) [upload=820275]: Done starting upload Oct 7 10:12:10.230096046 (932h3m45.582881154s) [upload=820275]: Uploading segments... Oct 7 10:12:10.230132875 (932h3m45.582917983s) [upload=820275]: Got next segment. Inline: true Oct 7 10:12:10.230138986 (932h3m45.582924094s) [upload=820275]: Waiting for error group managing segments... Oct 7 10:12:10.230171558 (932h3m45.582956656s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 7 10:12:10.230175415 (932h3m45.582960513s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 7 10:12:10.230177529 (932h3m45.582962628s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 7 10:13:10.202118923 (932h4m45.554904031s) [upload=820275]: Done uploading segments... Oct 7 10:13:10.202134061 (932h4m45.55491917s) [upload=820275]: Upload finished. err: metaclient: context deadline exceeded
Duration: 234.265671ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
1.56074114s
FAIL (2025-10-07 10:25:38 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 1.560766136s
core
uplink
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [....XXX.....................................................] duration:
2.210243893s
FAIL (2025-10-07 10:25:28 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 23)
======LOGS======
WFZRTA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156581014 (931h35m48.509366112s) [noise=true , address=89.149.201.147:4013 , piece_id=ZDSSVS4VXF4HBWWASN2C7G2YFF2LDX3Q3SDBMUIFRFK3B2XXSBOQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156754609 (931h35m48.509539717s) [noise=true , address=81.171.14.70:4029 , piece_id=5PUSRNZMLVD52TK33GQ3OTWC3U5N3526V4JPJOTZU4N53J6IQMGQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156760662 (931h35m48.50954576s) [noise=true , address=81.171.14.70:4035 , piece_id=SLUDX3Y4VBI7NXJWDAK4MRFW5EJU5JRBSFCSHXRP75GOBCBQU5WQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157022393 (931h35m48.509807491s) [noise=true , address=81.171.14.70:4026 , piece_id=MVAEP4WRG5CQ4QAWOMB5JI7LFXQ2XXIQUWLKGD6FGYZO6OXNAWNA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157319349 (931h35m48.510104448s) [noise=true , address=185.167.204.205:4021 , piece_id=ZABC4XM4B3GI76CQ63FC3DPFJUNKD3SW3RRGWR6WHKSID2GLOKDA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157684756 (931h35m48.510469864s) [noise=true , address=89.149.201.147:4008 , piece_id=4VDQ3YJIO7WTIC3YV56ZAYYXE2BRTTWL2G2ZCVXSBBX57R2XCUYA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.158173573 (931h35m48.510958681s) [noise=true , address=185.167.204.205:4012 , piece_id=JCTVQTWNU5X7IB2JLL5E4ANPBIJOZFGHDIUAX6SL7ZLN6XYDUWGA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.158368348 (931h35m48.511153446s) [noise=true , address=185.167.204.206:4044 , piece_id=3ZDCAY4VYLT52AJORNLAFMYYI7WA6SEVUZQ4DR625DUSTWQ4J2VQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.159021985 (931h35m48.511807073s) [noise=true , address=81.171.14.70:4034 , piece_id=YADJOEALDIEY3LS5ZGQ5WP3YXWJDQ325HALNAHTQP43Q5ACABIBQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.607848645 (931h35m48.960633743s) [upload=819867]: Next returned nil segment
Oct 7 09:44:13.607861248 (931h35m48.960646356s) [upload=819867]: Waiting for error group managing segments...
Oct 7 09:44:13.778748780 (931h35m49.131533888s) [noise=true , address=81.171.14.70:4045 , piece_id=FSR77DDZPZUOWG664OGJIHMG4QMXDLYJDFZSIDEBM2JOYT7VOWZQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.781688647 (931h35m49.134473755s) [noise=true , address=81.171.14.70:4040 , piece_id=R2QKQJ7M7L26V3UMJKGHSXTCQODRGKDWT4GXCG5MEKD56YSI7KUQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.797470124 (931h35m49.150255232s) [noise=true , address=185.167.204.206:4068 , piece_id=HRQ7RG3QCA3YRUJTKTXCZ2QXGJQQJFKBZX5PHYF4AG3XWRSTEYQQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.798945413 (931h35m49.151730521s) [noise=true , address=185.167.204.206:4066 , piece_id=MC6WNACVRGQRCLF2OHLDTLLJCKUGA3XJPBN5T4QZUHC4RBR57NSA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.799672778 (931h35m49.152457886s) [noise=true , address=185.167.204.206:4044 , piece_id=3ZDCAY4VYLT52AJORNLAFMYYI7WA6SEVUZQ4DR625DUSTWQ4J2VQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.800694025 (931h35m49.153479133s) [noise=true , address=81.171.14.70:4043 , piece_id=GXEEOBGLYCQRH3R23NOQZ2XZLPY3PTHBWFF37UBQLL4QDVWFZRTA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.800815923 (931h35m49.153601031s) [noise=true , address=185.167.204.205:4021 , piece_id=ZABC4XM4B3GI76CQ63FC3DPFJUNKD3SW3RRGWR6WHKSID2GLOKDA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.803356381 (931h35m49.15614149s) [noise=true , address=185.167.204.206:4051 , piece_id=BNG3DAFHD4FOFXZMOZVPDLGBUX4HER2RX32POUNEX26DXU6GOTMA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.819254868 (931h35m49.172039976s) [noise=true , address=185.167.204.205:4012 , piece_id=JCTVQTWNU5X7IB2JLL5E4ANPBIJOZFGHDIUAX6SL7ZLN6XYDUWGA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.828359534 (931h35m49.181144643s) [noise=true , address=185.167.204.206:4063 , piece_id=ENFSIKRYEECUMNC76PCD442FCYYN4X4ZPKFXSPLEVNBBYA7QWS3Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.829841225 (931h35m49.182626323s) [noise=true , address=185.167.204.206:4041 , piece_id=KXQ5UIZXHDIWTOTTZR3G5EGRH7I55LWNH6OKR5HB6F3MOMBN4TDQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.830076737 (931h35m49.182861836s) [noise=true , address=89.149.201.147:4009 , piece_id=XUFZXG6VXQMI64FZFML6AX2VSZFEXDVDC2JDW7HDHSZ2C6UG55FA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.831280656 (931h35m49.184065754s) [noise=true , address=185.167.204.205:4029 , piece_id=GKGZUB2TTAIT67CCUMOOTPYMTMSGWD4RHW5GAXMIXQLXXQYPDY6Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.835538818 (931h35m49.188323926s) [noise=true , address=185.167.204.205:4009 , piece_id=F2OXD55LMZBZWP3OOD47VECF6QO74ND2LGMSLCBP6XMTBYLKKIDA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.839852703 (931h35m49.192637811s) [noise=true , address=185.167.204.206:4058 , piece_id=CWCQOHWD3LCWGDIE7FG26AB67NKYT442MPVIKICIHEAJ7RB5WDWA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.841847307 (931h35m49.194632406s) [noise=true , address=81.171.14.70:4035 , piece_id=SLUDX3Y4VBI7NXJWDAK4MRFW5EJU5JRBSFCSHXRP75GOBCBQU5WQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.849204934 (931h35m49.201990032s) [noise=true , address=89.149.201.147:4014 , piece_id=DWVUVNFYMZYWRIF4QU2UM5S4JBQWM2CBDNKVUOQOZDX4AY3KCF6Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.849297689 (931h35m49.202082787s) [noise=true , address=89.149.201.147:4010 , piece_id=PAKKECZ4EI45MTDWKQ6ACFVS3LQNCJJXO5NPRGAZ2ZUATYTX6ROQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.850790530 (931h35m49.203575629s) [noise=true , address=89.149.201.147:4011 , piece_id=23CV6F4FGTKWKAWDE7AUGQRWDFZGN37BIUQPJQXUH3HQWTURHUZQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.856762598 (931h35m49.209547696s) [noise=true , address=89.149.201.147:4008 , piece_id=4VDQ3YJIO7WTIC3YV56ZAYYXE2BRTTWL2G2ZCVXSBBX57R2XCUYA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.858751770 (931h35m49.211536869s) [noise=true , address=89.149.201.147:4013 , piece_id=ZDSSVS4VXF4HBWWASN2C7G2YFF2LDX3Q3SDBMUIFRFK3B2XXSBOQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.883309048 (931h35m49.236094146s) [noise=true , address=89.149.201.147:4002 , piece_id=BBRHLQDW22HSJE2P7LPE4Y67TOIQKFBQ4VQ5GKSF4KK5UDK3E23A, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.890627422 (931h35m49.24341253s) [noise=true , address=89.149.201.147:4012 , piece_id=VNITDM4Z3CWAGWHGOFMC3LP3E2GTVMFUT2FQL3I53HDK5ANYRNMA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:45:12.644603566 (931h36m47.997388694s) [noise=true , address=81.171.14.70:4033 , piece_id=FEOAQXS524JOQ76MV3AQPLIUCSGQUZBQOG4FJ43NKMFGOPWA6YQA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: write tcp 5.161.89.252:15820->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644683927 (931h36m47.997469065s) [noise=true , address=81.171.14.70:4029 , piece_id=5PUSRNZMLVD52TK33GQ3OTWC3U5N3526V4JPJOTZU4N53J6IQMGQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 5.161.89.252:42584->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644856971 (931h36m47.9976421s) [noise=true , address=81.171.14.70:4026 , piece_id=MVAEP4WRG5CQ4QAWOMB5JI7LFXQ2XXIQUWLKGD6FGYZO6OXNAWNA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: write tcp 5.161.89.252:25768->81.171.14.70:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644943003 (931h36m47.997728101s) [noise=true , address=81.171.14.70:4042 , piece_id=E2W7OQ3WJV5WBZVCR7UT3TPNGIZAQHKWVSVDFYXE3EYXPAKUOVRQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 5.161.89.252:48912->81.171.14.70:4042: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644981655 (931h36m47.997766803s) [noise=true , address=81.171.14.70:4034 , piece_id=YADJOEALDIEY3LS5ZGQ5WP3YXWJDQ325HALNAHTQP43Q5ACABIBQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: write tcp 5.161.89.252:57700->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.645044964 (931h36m47.997830102s) [seg_pos={0 0}, upload=819867]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil>
Oct 7 09:45:12.748884760 (931h36m48.101669889s) [upload=819867]: Done uploading segments...
Oct 7 09:45:12.748905800 (931h36m48.101690928s) [upload=819867]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23)
Duration: 2.210276304s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
273.421913ms
FAIL (2025-10-07 10:25:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 7 10:12:10.229965070 (932h3m45.582750178s) [upload=820275]: Starting upload Oct 7 10:12:10.230038448 (932h3m45.582823556s) [upload=820275]: Done starting upload Oct 7 10:12:10.230096046 (932h3m45.582881154s) [upload=820275]: Uploading segments... Oct 7 10:12:10.230132875 (932h3m45.582917983s) [upload=820275]: Got next segment. Inline: true Oct 7 10:12:10.230138986 (932h3m45.582924094s) [upload=820275]: Waiting for error group managing segments... Oct 7 10:12:10.230171558 (932h3m45.582956656s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 7 10:12:10.230175415 (932h3m45.582960513s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 7 10:12:10.230177529 (932h3m45.582962628s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 7 10:13:10.202118923 (932h4m45.554904031s) [upload=820275]: Done uploading segments... Oct 7 10:13:10.202134061 (932h4m45.55491917s) [upload=820275]: Upload finished. err: metaclient: context deadline exceeded
Duration: 273.452301ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
1.628766854s
FAIL (2025-10-07 10:24:33 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 1.628806958s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
189.902855ms
FAIL (2025-10-07 10:24:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 7 10:12:10.229965070 (932h3m45.582750178s) [upload=820275]: Starting upload Oct 7 10:12:10.230038448 (932h3m45.582823556s) [upload=820275]: Done starting upload Oct 7 10:12:10.230096046 (932h3m45.582881154s) [upload=820275]: Uploading segments... Oct 7 10:12:10.230132875 (932h3m45.582917983s) [upload=820275]: Got next segment. Inline: true Oct 7 10:12:10.230138986 (932h3m45.582924094s) [upload=820275]: Waiting for error group managing segments... Oct 7 10:12:10.230171558 (932h3m45.582956656s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 7 10:12:10.230175415 (932h3m45.582960513s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 7 10:12:10.230177529 (932h3m45.582962628s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 7 10:13:10.202118923 (932h4m45.554904031s) [upload=820275]: Done uploading segments... Oct 7 10:13:10.202134061 (932h4m45.55491917s) [upload=820275]: Upload finished. err: metaclient: context deadline exceeded
Duration: 189.923685ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [.....XXX....................................................] duration:
2.658577131s
FAIL (2025-10-07 10:24:18 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 23)
======LOGS======
WFZRTA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156581014 (931h35m48.509366112s) [noise=true , address=89.149.201.147:4013 , piece_id=ZDSSVS4VXF4HBWWASN2C7G2YFF2LDX3Q3SDBMUIFRFK3B2XXSBOQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156754609 (931h35m48.509539717s) [noise=true , address=81.171.14.70:4029 , piece_id=5PUSRNZMLVD52TK33GQ3OTWC3U5N3526V4JPJOTZU4N53J6IQMGQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156760662 (931h35m48.50954576s) [noise=true , address=81.171.14.70:4035 , piece_id=SLUDX3Y4VBI7NXJWDAK4MRFW5EJU5JRBSFCSHXRP75GOBCBQU5WQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157022393 (931h35m48.509807491s) [noise=true , address=81.171.14.70:4026 , piece_id=MVAEP4WRG5CQ4QAWOMB5JI7LFXQ2XXIQUWLKGD6FGYZO6OXNAWNA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157319349 (931h35m48.510104448s) [noise=true , address=185.167.204.205:4021 , piece_id=ZABC4XM4B3GI76CQ63FC3DPFJUNKD3SW3RRGWR6WHKSID2GLOKDA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157684756 (931h35m48.510469864s) [noise=true , address=89.149.201.147:4008 , piece_id=4VDQ3YJIO7WTIC3YV56ZAYYXE2BRTTWL2G2ZCVXSBBX57R2XCUYA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.158173573 (931h35m48.510958681s) [noise=true , address=185.167.204.205:4012 , piece_id=JCTVQTWNU5X7IB2JLL5E4ANPBIJOZFGHDIUAX6SL7ZLN6XYDUWGA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.158368348 (931h35m48.511153446s) [noise=true , address=185.167.204.206:4044 , piece_id=3ZDCAY4VYLT52AJORNLAFMYYI7WA6SEVUZQ4DR625DUSTWQ4J2VQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.159021985 (931h35m48.511807073s) [noise=true , address=81.171.14.70:4034 , piece_id=YADJOEALDIEY3LS5ZGQ5WP3YXWJDQ325HALNAHTQP43Q5ACABIBQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.607848645 (931h35m48.960633743s) [upload=819867]: Next returned nil segment
Oct 7 09:44:13.607861248 (931h35m48.960646356s) [upload=819867]: Waiting for error group managing segments...
Oct 7 09:44:13.778748780 (931h35m49.131533888s) [noise=true , address=81.171.14.70:4045 , piece_id=FSR77DDZPZUOWG664OGJIHMG4QMXDLYJDFZSIDEBM2JOYT7VOWZQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.781688647 (931h35m49.134473755s) [noise=true , address=81.171.14.70:4040 , piece_id=R2QKQJ7M7L26V3UMJKGHSXTCQODRGKDWT4GXCG5MEKD56YSI7KUQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.797470124 (931h35m49.150255232s) [noise=true , address=185.167.204.206:4068 , piece_id=HRQ7RG3QCA3YRUJTKTXCZ2QXGJQQJFKBZX5PHYF4AG3XWRSTEYQQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.798945413 (931h35m49.151730521s) [noise=true , address=185.167.204.206:4066 , piece_id=MC6WNACVRGQRCLF2OHLDTLLJCKUGA3XJPBN5T4QZUHC4RBR57NSA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.799672778 (931h35m49.152457886s) [noise=true , address=185.167.204.206:4044 , piece_id=3ZDCAY4VYLT52AJORNLAFMYYI7WA6SEVUZQ4DR625DUSTWQ4J2VQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.800694025 (931h35m49.153479133s) [noise=true , address=81.171.14.70:4043 , piece_id=GXEEOBGLYCQRH3R23NOQZ2XZLPY3PTHBWFF37UBQLL4QDVWFZRTA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.800815923 (931h35m49.153601031s) [noise=true , address=185.167.204.205:4021 , piece_id=ZABC4XM4B3GI76CQ63FC3DPFJUNKD3SW3RRGWR6WHKSID2GLOKDA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.803356381 (931h35m49.15614149s) [noise=true , address=185.167.204.206:4051 , piece_id=BNG3DAFHD4FOFXZMOZVPDLGBUX4HER2RX32POUNEX26DXU6GOTMA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.819254868 (931h35m49.172039976s) [noise=true , address=185.167.204.205:4012 , piece_id=JCTVQTWNU5X7IB2JLL5E4ANPBIJOZFGHDIUAX6SL7ZLN6XYDUWGA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.828359534 (931h35m49.181144643s) [noise=true , address=185.167.204.206:4063 , piece_id=ENFSIKRYEECUMNC76PCD442FCYYN4X4ZPKFXSPLEVNBBYA7QWS3Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.829841225 (931h35m49.182626323s) [noise=true , address=185.167.204.206:4041 , piece_id=KXQ5UIZXHDIWTOTTZR3G5EGRH7I55LWNH6OKR5HB6F3MOMBN4TDQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.830076737 (931h35m49.182861836s) [noise=true , address=89.149.201.147:4009 , piece_id=XUFZXG6VXQMI64FZFML6AX2VSZFEXDVDC2JDW7HDHSZ2C6UG55FA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.831280656 (931h35m49.184065754s) [noise=true , address=185.167.204.205:4029 , piece_id=GKGZUB2TTAIT67CCUMOOTPYMTMSGWD4RHW5GAXMIXQLXXQYPDY6Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.835538818 (931h35m49.188323926s) [noise=true , address=185.167.204.205:4009 , piece_id=F2OXD55LMZBZWP3OOD47VECF6QO74ND2LGMSLCBP6XMTBYLKKIDA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.839852703 (931h35m49.192637811s) [noise=true , address=185.167.204.206:4058 , piece_id=CWCQOHWD3LCWGDIE7FG26AB67NKYT442MPVIKICIHEAJ7RB5WDWA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.841847307 (931h35m49.194632406s) [noise=true , address=81.171.14.70:4035 , piece_id=SLUDX3Y4VBI7NXJWDAK4MRFW5EJU5JRBSFCSHXRP75GOBCBQU5WQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.849204934 (931h35m49.201990032s) [noise=true , address=89.149.201.147:4014 , piece_id=DWVUVNFYMZYWRIF4QU2UM5S4JBQWM2CBDNKVUOQOZDX4AY3KCF6Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.849297689 (931h35m49.202082787s) [noise=true , address=89.149.201.147:4010 , piece_id=PAKKECZ4EI45MTDWKQ6ACFVS3LQNCJJXO5NPRGAZ2ZUATYTX6ROQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.850790530 (931h35m49.203575629s) [noise=true , address=89.149.201.147:4011 , piece_id=23CV6F4FGTKWKAWDE7AUGQRWDFZGN37BIUQPJQXUH3HQWTURHUZQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.856762598 (931h35m49.209547696s) [noise=true , address=89.149.201.147:4008 , piece_id=4VDQ3YJIO7WTIC3YV56ZAYYXE2BRTTWL2G2ZCVXSBBX57R2XCUYA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.858751770 (931h35m49.211536869s) [noise=true , address=89.149.201.147:4013 , piece_id=ZDSSVS4VXF4HBWWASN2C7G2YFF2LDX3Q3SDBMUIFRFK3B2XXSBOQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.883309048 (931h35m49.236094146s) [noise=true , address=89.149.201.147:4002 , piece_id=BBRHLQDW22HSJE2P7LPE4Y67TOIQKFBQ4VQ5GKSF4KK5UDK3E23A, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.890627422 (931h35m49.24341253s) [noise=true , address=89.149.201.147:4012 , piece_id=VNITDM4Z3CWAGWHGOFMC3LP3E2GTVMFUT2FQL3I53HDK5ANYRNMA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:45:12.644603566 (931h36m47.997388694s) [noise=true , address=81.171.14.70:4033 , piece_id=FEOAQXS524JOQ76MV3AQPLIUCSGQUZBQOG4FJ43NKMFGOPWA6YQA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: write tcp 5.161.89.252:15820->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644683927 (931h36m47.997469065s) [noise=true , address=81.171.14.70:4029 , piece_id=5PUSRNZMLVD52TK33GQ3OTWC3U5N3526V4JPJOTZU4N53J6IQMGQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 5.161.89.252:42584->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644856971 (931h36m47.9976421s) [noise=true , address=81.171.14.70:4026 , piece_id=MVAEP4WRG5CQ4QAWOMB5JI7LFXQ2XXIQUWLKGD6FGYZO6OXNAWNA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: write tcp 5.161.89.252:25768->81.171.14.70:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644943003 (931h36m47.997728101s) [noise=true , address=81.171.14.70:4042 , piece_id=E2W7OQ3WJV5WBZVCR7UT3TPNGIZAQHKWVSVDFYXE3EYXPAKUOVRQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 5.161.89.252:48912->81.171.14.70:4042: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644981655 (931h36m47.997766803s) [noise=true , address=81.171.14.70:4034 , piece_id=YADJOEALDIEY3LS5ZGQ5WP3YXWJDQ325HALNAHTQP43Q5ACABIBQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: write tcp 5.161.89.252:57700->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.645044964 (931h36m47.997830102s) [seg_pos={0 0}, upload=819867]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil>
Oct 7 09:45:12.748884760 (931h36m48.101669889s) [upload=819867]: Done uploading segments...
Oct 7 09:45:12.748905800 (931h36m48.101690928s) [upload=819867]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23)
Duration: 2.658607938s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
1.544422807s
FAIL (2025-10-07 10:24:12 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 1.544442854s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
140.758217ms
FAIL (2025-10-07 10:24:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 7 10:12:10.229965070 (932h3m45.582750178s) [upload=820275]: Starting upload Oct 7 10:12:10.230038448 (932h3m45.582823556s) [upload=820275]: Done starting upload Oct 7 10:12:10.230096046 (932h3m45.582881154s) [upload=820275]: Uploading segments... Oct 7 10:12:10.230132875 (932h3m45.582917983s) [upload=820275]: Got next segment. Inline: true Oct 7 10:12:10.230138986 (932h3m45.582924094s) [upload=820275]: Waiting for error group managing segments... Oct 7 10:12:10.230171558 (932h3m45.582956656s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 7 10:12:10.230175415 (932h3m45.582960513s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 7 10:12:10.230177529 (932h3m45.582962628s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 7 10:13:10.202118923 (932h4m45.554904031s) [upload=820275]: Done uploading segments... Oct 7 10:13:10.202134061 (932h4m45.55491917s) [upload=820275]: Upload finished. err: metaclient: context deadline exceeded
Duration: 140.777894ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
140.231026ms
FAIL (2025-10-07 10:23:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 7 10:12:10.229965070 (932h3m45.582750178s) [upload=820275]: Starting upload Oct 7 10:12:10.230038448 (932h3m45.582823556s) [upload=820275]: Done starting upload Oct 7 10:12:10.230096046 (932h3m45.582881154s) [upload=820275]: Uploading segments... Oct 7 10:12:10.230132875 (932h3m45.582917983s) [upload=820275]: Got next segment. Inline: true Oct 7 10:12:10.230138986 (932h3m45.582924094s) [upload=820275]: Waiting for error group managing segments... Oct 7 10:12:10.230171558 (932h3m45.582956656s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 7 10:12:10.230175415 (932h3m45.582960513s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 7 10:12:10.230177529 (932h3m45.582962628s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 7 10:13:10.202118923 (932h4m45.554904031s) [upload=820275]: Done uploading segments... Oct 7 10:13:10.202134061 (932h4m45.55491917s) [upload=820275]: Upload finished. err: metaclient: context deadline exceeded
Duration: 140.252407ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [......XXX...................................................] duration:
2.278502434s
FAIL (2025-10-07 10:23:21 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 23)
======LOGS======
WFZRTA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156581014 (931h35m48.509366112s) [noise=true , address=89.149.201.147:4013 , piece_id=ZDSSVS4VXF4HBWWASN2C7G2YFF2LDX3Q3SDBMUIFRFK3B2XXSBOQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156754609 (931h35m48.509539717s) [noise=true , address=81.171.14.70:4029 , piece_id=5PUSRNZMLVD52TK33GQ3OTWC3U5N3526V4JPJOTZU4N53J6IQMGQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156760662 (931h35m48.50954576s) [noise=true , address=81.171.14.70:4035 , piece_id=SLUDX3Y4VBI7NXJWDAK4MRFW5EJU5JRBSFCSHXRP75GOBCBQU5WQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157022393 (931h35m48.509807491s) [noise=true , address=81.171.14.70:4026 , piece_id=MVAEP4WRG5CQ4QAWOMB5JI7LFXQ2XXIQUWLKGD6FGYZO6OXNAWNA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157319349 (931h35m48.510104448s) [noise=true , address=185.167.204.205:4021 , piece_id=ZABC4XM4B3GI76CQ63FC3DPFJUNKD3SW3RRGWR6WHKSID2GLOKDA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157684756 (931h35m48.510469864s) [noise=true , address=89.149.201.147:4008 , piece_id=4VDQ3YJIO7WTIC3YV56ZAYYXE2BRTTWL2G2ZCVXSBBX57R2XCUYA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.158173573 (931h35m48.510958681s) [noise=true , address=185.167.204.205:4012 , piece_id=JCTVQTWNU5X7IB2JLL5E4ANPBIJOZFGHDIUAX6SL7ZLN6XYDUWGA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.158368348 (931h35m48.511153446s) [noise=true , address=185.167.204.206:4044 , piece_id=3ZDCAY4VYLT52AJORNLAFMYYI7WA6SEVUZQ4DR625DUSTWQ4J2VQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.159021985 (931h35m48.511807073s) [noise=true , address=81.171.14.70:4034 , piece_id=YADJOEALDIEY3LS5ZGQ5WP3YXWJDQ325HALNAHTQP43Q5ACABIBQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.607848645 (931h35m48.960633743s) [upload=819867]: Next returned nil segment
Oct 7 09:44:13.607861248 (931h35m48.960646356s) [upload=819867]: Waiting for error group managing segments...
Oct 7 09:44:13.778748780 (931h35m49.131533888s) [noise=true , address=81.171.14.70:4045 , piece_id=FSR77DDZPZUOWG664OGJIHMG4QMXDLYJDFZSIDEBM2JOYT7VOWZQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.781688647 (931h35m49.134473755s) [noise=true , address=81.171.14.70:4040 , piece_id=R2QKQJ7M7L26V3UMJKGHSXTCQODRGKDWT4GXCG5MEKD56YSI7KUQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.797470124 (931h35m49.150255232s) [noise=true , address=185.167.204.206:4068 , piece_id=HRQ7RG3QCA3YRUJTKTXCZ2QXGJQQJFKBZX5PHYF4AG3XWRSTEYQQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.798945413 (931h35m49.151730521s) [noise=true , address=185.167.204.206:4066 , piece_id=MC6WNACVRGQRCLF2OHLDTLLJCKUGA3XJPBN5T4QZUHC4RBR57NSA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.799672778 (931h35m49.152457886s) [noise=true , address=185.167.204.206:4044 , piece_id=3ZDCAY4VYLT52AJORNLAFMYYI7WA6SEVUZQ4DR625DUSTWQ4J2VQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.800694025 (931h35m49.153479133s) [noise=true , address=81.171.14.70:4043 , piece_id=GXEEOBGLYCQRH3R23NOQZ2XZLPY3PTHBWFF37UBQLL4QDVWFZRTA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.800815923 (931h35m49.153601031s) [noise=true , address=185.167.204.205:4021 , piece_id=ZABC4XM4B3GI76CQ63FC3DPFJUNKD3SW3RRGWR6WHKSID2GLOKDA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.803356381 (931h35m49.15614149s) [noise=true , address=185.167.204.206:4051 , piece_id=BNG3DAFHD4FOFXZMOZVPDLGBUX4HER2RX32POUNEX26DXU6GOTMA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.819254868 (931h35m49.172039976s) [noise=true , address=185.167.204.205:4012 , piece_id=JCTVQTWNU5X7IB2JLL5E4ANPBIJOZFGHDIUAX6SL7ZLN6XYDUWGA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.828359534 (931h35m49.181144643s) [noise=true , address=185.167.204.206:4063 , piece_id=ENFSIKRYEECUMNC76PCD442FCYYN4X4ZPKFXSPLEVNBBYA7QWS3Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.829841225 (931h35m49.182626323s) [noise=true , address=185.167.204.206:4041 , piece_id=KXQ5UIZXHDIWTOTTZR3G5EGRH7I55LWNH6OKR5HB6F3MOMBN4TDQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.830076737 (931h35m49.182861836s) [noise=true , address=89.149.201.147:4009 , piece_id=XUFZXG6VXQMI64FZFML6AX2VSZFEXDVDC2JDW7HDHSZ2C6UG55FA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.831280656 (931h35m49.184065754s) [noise=true , address=185.167.204.205:4029 , piece_id=GKGZUB2TTAIT67CCUMOOTPYMTMSGWD4RHW5GAXMIXQLXXQYPDY6Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.835538818 (931h35m49.188323926s) [noise=true , address=185.167.204.205:4009 , piece_id=F2OXD55LMZBZWP3OOD47VECF6QO74ND2LGMSLCBP6XMTBYLKKIDA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.839852703 (931h35m49.192637811s) [noise=true , address=185.167.204.206:4058 , piece_id=CWCQOHWD3LCWGDIE7FG26AB67NKYT442MPVIKICIHEAJ7RB5WDWA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.841847307 (931h35m49.194632406s) [noise=true , address=81.171.14.70:4035 , piece_id=SLUDX3Y4VBI7NXJWDAK4MRFW5EJU5JRBSFCSHXRP75GOBCBQU5WQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.849204934 (931h35m49.201990032s) [noise=true , address=89.149.201.147:4014 , piece_id=DWVUVNFYMZYWRIF4QU2UM5S4JBQWM2CBDNKVUOQOZDX4AY3KCF6Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.849297689 (931h35m49.202082787s) [noise=true , address=89.149.201.147:4010 , piece_id=PAKKECZ4EI45MTDWKQ6ACFVS3LQNCJJXO5NPRGAZ2ZUATYTX6ROQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.850790530 (931h35m49.203575629s) [noise=true , address=89.149.201.147:4011 , piece_id=23CV6F4FGTKWKAWDE7AUGQRWDFZGN37BIUQPJQXUH3HQWTURHUZQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.856762598 (931h35m49.209547696s) [noise=true , address=89.149.201.147:4008 , piece_id=4VDQ3YJIO7WTIC3YV56ZAYYXE2BRTTWL2G2ZCVXSBBX57R2XCUYA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.858751770 (931h35m49.211536869s) [noise=true , address=89.149.201.147:4013 , piece_id=ZDSSVS4VXF4HBWWASN2C7G2YFF2LDX3Q3SDBMUIFRFK3B2XXSBOQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.883309048 (931h35m49.236094146s) [noise=true , address=89.149.201.147:4002 , piece_id=BBRHLQDW22HSJE2P7LPE4Y67TOIQKFBQ4VQ5GKSF4KK5UDK3E23A, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.890627422 (931h35m49.24341253s) [noise=true , address=89.149.201.147:4012 , piece_id=VNITDM4Z3CWAGWHGOFMC3LP3E2GTVMFUT2FQL3I53HDK5ANYRNMA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:45:12.644603566 (931h36m47.997388694s) [noise=true , address=81.171.14.70:4033 , piece_id=FEOAQXS524JOQ76MV3AQPLIUCSGQUZBQOG4FJ43NKMFGOPWA6YQA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: write tcp 5.161.89.252:15820->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644683927 (931h36m47.997469065s) [noise=true , address=81.171.14.70:4029 , piece_id=5PUSRNZMLVD52TK33GQ3OTWC3U5N3526V4JPJOTZU4N53J6IQMGQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 5.161.89.252:42584->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644856971 (931h36m47.9976421s) [noise=true , address=81.171.14.70:4026 , piece_id=MVAEP4WRG5CQ4QAWOMB5JI7LFXQ2XXIQUWLKGD6FGYZO6OXNAWNA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: write tcp 5.161.89.252:25768->81.171.14.70:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644943003 (931h36m47.997728101s) [noise=true , address=81.171.14.70:4042 , piece_id=E2W7OQ3WJV5WBZVCR7UT3TPNGIZAQHKWVSVDFYXE3EYXPAKUOVRQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 5.161.89.252:48912->81.171.14.70:4042: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644981655 (931h36m47.997766803s) [noise=true , address=81.171.14.70:4034 , piece_id=YADJOEALDIEY3LS5ZGQ5WP3YXWJDQ325HALNAHTQP43Q5ACABIBQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: write tcp 5.161.89.252:57700->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.645044964 (931h36m47.997830102s) [seg_pos={0 0}, upload=819867]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil>
Oct 7 09:45:12.748884760 (931h36m48.101669889s) [upload=819867]: Done uploading segments...
Oct 7 09:45:12.748905800 (931h36m48.101690928s) [upload=819867]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23)
Duration: 2.278528623s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
1.699578934s
FAIL (2025-10-07 10:23:08 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 1.699592097s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
336.548803ms
FAIL (2025-10-07 10:22:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 7 10:12:10.229965070 (932h3m45.582750178s) [upload=820275]: Starting upload Oct 7 10:12:10.230038448 (932h3m45.582823556s) [upload=820275]: Done starting upload Oct 7 10:12:10.230096046 (932h3m45.582881154s) [upload=820275]: Uploading segments... Oct 7 10:12:10.230132875 (932h3m45.582917983s) [upload=820275]: Got next segment. Inline: true Oct 7 10:12:10.230138986 (932h3m45.582924094s) [upload=820275]: Waiting for error group managing segments... Oct 7 10:12:10.230171558 (932h3m45.582956656s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 7 10:12:10.230175415 (932h3m45.582960513s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 7 10:12:10.230177529 (932h3m45.582962628s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 7 10:13:10.202118923 (932h4m45.554904031s) [upload=820275]: Done uploading segments... Oct 7 10:13:10.202134061 (932h4m45.55491917s) [upload=820275]: Upload finished. err: metaclient: context deadline exceeded
Duration: 336.56855ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [.......XXX..................................................] duration:
2.240927684s
FAIL (2025-10-07 10:22:21 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 23)
======LOGS======
WFZRTA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156581014 (931h35m48.509366112s) [noise=true , address=89.149.201.147:4013 , piece_id=ZDSSVS4VXF4HBWWASN2C7G2YFF2LDX3Q3SDBMUIFRFK3B2XXSBOQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156754609 (931h35m48.509539717s) [noise=true , address=81.171.14.70:4029 , piece_id=5PUSRNZMLVD52TK33GQ3OTWC3U5N3526V4JPJOTZU4N53J6IQMGQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156760662 (931h35m48.50954576s) [noise=true , address=81.171.14.70:4035 , piece_id=SLUDX3Y4VBI7NXJWDAK4MRFW5EJU5JRBSFCSHXRP75GOBCBQU5WQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157022393 (931h35m48.509807491s) [noise=true , address=81.171.14.70:4026 , piece_id=MVAEP4WRG5CQ4QAWOMB5JI7LFXQ2XXIQUWLKGD6FGYZO6OXNAWNA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157319349 (931h35m48.510104448s) [noise=true , address=185.167.204.205:4021 , piece_id=ZABC4XM4B3GI76CQ63FC3DPFJUNKD3SW3RRGWR6WHKSID2GLOKDA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157684756 (931h35m48.510469864s) [noise=true , address=89.149.201.147:4008 , piece_id=4VDQ3YJIO7WTIC3YV56ZAYYXE2BRTTWL2G2ZCVXSBBX57R2XCUYA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.158173573 (931h35m48.510958681s) [noise=true , address=185.167.204.205:4012 , piece_id=JCTVQTWNU5X7IB2JLL5E4ANPBIJOZFGHDIUAX6SL7ZLN6XYDUWGA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.158368348 (931h35m48.511153446s) [noise=true , address=185.167.204.206:4044 , piece_id=3ZDCAY4VYLT52AJORNLAFMYYI7WA6SEVUZQ4DR625DUSTWQ4J2VQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.159021985 (931h35m48.511807073s) [noise=true , address=81.171.14.70:4034 , piece_id=YADJOEALDIEY3LS5ZGQ5WP3YXWJDQ325HALNAHTQP43Q5ACABIBQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.607848645 (931h35m48.960633743s) [upload=819867]: Next returned nil segment
Oct 7 09:44:13.607861248 (931h35m48.960646356s) [upload=819867]: Waiting for error group managing segments...
Oct 7 09:44:13.778748780 (931h35m49.131533888s) [noise=true , address=81.171.14.70:4045 , piece_id=FSR77DDZPZUOWG664OGJIHMG4QMXDLYJDFZSIDEBM2JOYT7VOWZQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.781688647 (931h35m49.134473755s) [noise=true , address=81.171.14.70:4040 , piece_id=R2QKQJ7M7L26V3UMJKGHSXTCQODRGKDWT4GXCG5MEKD56YSI7KUQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.797470124 (931h35m49.150255232s) [noise=true , address=185.167.204.206:4068 , piece_id=HRQ7RG3QCA3YRUJTKTXCZ2QXGJQQJFKBZX5PHYF4AG3XWRSTEYQQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.798945413 (931h35m49.151730521s) [noise=true , address=185.167.204.206:4066 , piece_id=MC6WNACVRGQRCLF2OHLDTLLJCKUGA3XJPBN5T4QZUHC4RBR57NSA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.799672778 (931h35m49.152457886s) [noise=true , address=185.167.204.206:4044 , piece_id=3ZDCAY4VYLT52AJORNLAFMYYI7WA6SEVUZQ4DR625DUSTWQ4J2VQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.800694025 (931h35m49.153479133s) [noise=true , address=81.171.14.70:4043 , piece_id=GXEEOBGLYCQRH3R23NOQZ2XZLPY3PTHBWFF37UBQLL4QDVWFZRTA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.800815923 (931h35m49.153601031s) [noise=true , address=185.167.204.205:4021 , piece_id=ZABC4XM4B3GI76CQ63FC3DPFJUNKD3SW3RRGWR6WHKSID2GLOKDA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.803356381 (931h35m49.15614149s) [noise=true , address=185.167.204.206:4051 , piece_id=BNG3DAFHD4FOFXZMOZVPDLGBUX4HER2RX32POUNEX26DXU6GOTMA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.819254868 (931h35m49.172039976s) [noise=true , address=185.167.204.205:4012 , piece_id=JCTVQTWNU5X7IB2JLL5E4ANPBIJOZFGHDIUAX6SL7ZLN6XYDUWGA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.828359534 (931h35m49.181144643s) [noise=true , address=185.167.204.206:4063 , piece_id=ENFSIKRYEECUMNC76PCD442FCYYN4X4ZPKFXSPLEVNBBYA7QWS3Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.829841225 (931h35m49.182626323s) [noise=true , address=185.167.204.206:4041 , piece_id=KXQ5UIZXHDIWTOTTZR3G5EGRH7I55LWNH6OKR5HB6F3MOMBN4TDQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.830076737 (931h35m49.182861836s) [noise=true , address=89.149.201.147:4009 , piece_id=XUFZXG6VXQMI64FZFML6AX2VSZFEXDVDC2JDW7HDHSZ2C6UG55FA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.831280656 (931h35m49.184065754s) [noise=true , address=185.167.204.205:4029 , piece_id=GKGZUB2TTAIT67CCUMOOTPYMTMSGWD4RHW5GAXMIXQLXXQYPDY6Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.835538818 (931h35m49.188323926s) [noise=true , address=185.167.204.205:4009 , piece_id=F2OXD55LMZBZWP3OOD47VECF6QO74ND2LGMSLCBP6XMTBYLKKIDA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.839852703 (931h35m49.192637811s) [noise=true , address=185.167.204.206:4058 , piece_id=CWCQOHWD3LCWGDIE7FG26AB67NKYT442MPVIKICIHEAJ7RB5WDWA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.841847307 (931h35m49.194632406s) [noise=true , address=81.171.14.70:4035 , piece_id=SLUDX3Y4VBI7NXJWDAK4MRFW5EJU5JRBSFCSHXRP75GOBCBQU5WQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.849204934 (931h35m49.201990032s) [noise=true , address=89.149.201.147:4014 , piece_id=DWVUVNFYMZYWRIF4QU2UM5S4JBQWM2CBDNKVUOQOZDX4AY3KCF6Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.849297689 (931h35m49.202082787s) [noise=true , address=89.149.201.147:4010 , piece_id=PAKKECZ4EI45MTDWKQ6ACFVS3LQNCJJXO5NPRGAZ2ZUATYTX6ROQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.850790530 (931h35m49.203575629s) [noise=true , address=89.149.201.147:4011 , piece_id=23CV6F4FGTKWKAWDE7AUGQRWDFZGN37BIUQPJQXUH3HQWTURHUZQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.856762598 (931h35m49.209547696s) [noise=true , address=89.149.201.147:4008 , piece_id=4VDQ3YJIO7WTIC3YV56ZAYYXE2BRTTWL2G2ZCVXSBBX57R2XCUYA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.858751770 (931h35m49.211536869s) [noise=true , address=89.149.201.147:4013 , piece_id=ZDSSVS4VXF4HBWWASN2C7G2YFF2LDX3Q3SDBMUIFRFK3B2XXSBOQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.883309048 (931h35m49.236094146s) [noise=true , address=89.149.201.147:4002 , piece_id=BBRHLQDW22HSJE2P7LPE4Y67TOIQKFBQ4VQ5GKSF4KK5UDK3E23A, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.890627422 (931h35m49.24341253s) [noise=true , address=89.149.201.147:4012 , piece_id=VNITDM4Z3CWAGWHGOFMC3LP3E2GTVMFUT2FQL3I53HDK5ANYRNMA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:45:12.644603566 (931h36m47.997388694s) [noise=true , address=81.171.14.70:4033 , piece_id=FEOAQXS524JOQ76MV3AQPLIUCSGQUZBQOG4FJ43NKMFGOPWA6YQA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: write tcp 5.161.89.252:15820->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644683927 (931h36m47.997469065s) [noise=true , address=81.171.14.70:4029 , piece_id=5PUSRNZMLVD52TK33GQ3OTWC3U5N3526V4JPJOTZU4N53J6IQMGQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 5.161.89.252:42584->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644856971 (931h36m47.9976421s) [noise=true , address=81.171.14.70:4026 , piece_id=MVAEP4WRG5CQ4QAWOMB5JI7LFXQ2XXIQUWLKGD6FGYZO6OXNAWNA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: write tcp 5.161.89.252:25768->81.171.14.70:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644943003 (931h36m47.997728101s) [noise=true , address=81.171.14.70:4042 , piece_id=E2W7OQ3WJV5WBZVCR7UT3TPNGIZAQHKWVSVDFYXE3EYXPAKUOVRQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 5.161.89.252:48912->81.171.14.70:4042: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644981655 (931h36m47.997766803s) [noise=true , address=81.171.14.70:4034 , piece_id=YADJOEALDIEY3LS5ZGQ5WP3YXWJDQ325HALNAHTQP43Q5ACABIBQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: write tcp 5.161.89.252:57700->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.645044964 (931h36m47.997830102s) [seg_pos={0 0}, upload=819867]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil>
Oct 7 09:45:12.748884760 (931h36m48.101669889s) [upload=819867]: Done uploading segments...
Oct 7 09:45:12.748905800 (931h36m48.101690928s) [upload=819867]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23)
Duration: 2.240947814s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
238.645689ms
FAIL (2025-10-07 10:22:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 7 10:12:10.229965070 (932h3m45.582750178s) [upload=820275]: Starting upload Oct 7 10:12:10.230038448 (932h3m45.582823556s) [upload=820275]: Done starting upload Oct 7 10:12:10.230096046 (932h3m45.582881154s) [upload=820275]: Uploading segments... Oct 7 10:12:10.230132875 (932h3m45.582917983s) [upload=820275]: Got next segment. Inline: true Oct 7 10:12:10.230138986 (932h3m45.582924094s) [upload=820275]: Waiting for error group managing segments... Oct 7 10:12:10.230171558 (932h3m45.582956656s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 7 10:12:10.230175415 (932h3m45.582960513s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 7 10:12:10.230177529 (932h3m45.582962628s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 7 10:13:10.202118923 (932h4m45.554904031s) [upload=820275]: Done uploading segments... Oct 7 10:13:10.202134061 (932h4m45.55491917s) [upload=820275]: Upload finished. err: metaclient: context deadline exceeded
Duration: 238.670646ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
1.650007011s
FAIL (2025-10-07 10:21:55 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 1.650031337s
core
uplink
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [........XXX.................................................] duration:
2.340963843s
FAIL (2025-10-07 10:21:31 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 23)
======LOGS======
WFZRTA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156581014 (931h35m48.509366112s) [noise=true , address=89.149.201.147:4013 , piece_id=ZDSSVS4VXF4HBWWASN2C7G2YFF2LDX3Q3SDBMUIFRFK3B2XXSBOQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156754609 (931h35m48.509539717s) [noise=true , address=81.171.14.70:4029 , piece_id=5PUSRNZMLVD52TK33GQ3OTWC3U5N3526V4JPJOTZU4N53J6IQMGQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156760662 (931h35m48.50954576s) [noise=true , address=81.171.14.70:4035 , piece_id=SLUDX3Y4VBI7NXJWDAK4MRFW5EJU5JRBSFCSHXRP75GOBCBQU5WQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157022393 (931h35m48.509807491s) [noise=true , address=81.171.14.70:4026 , piece_id=MVAEP4WRG5CQ4QAWOMB5JI7LFXQ2XXIQUWLKGD6FGYZO6OXNAWNA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157319349 (931h35m48.510104448s) [noise=true , address=185.167.204.205:4021 , piece_id=ZABC4XM4B3GI76CQ63FC3DPFJUNKD3SW3RRGWR6WHKSID2GLOKDA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157684756 (931h35m48.510469864s) [noise=true , address=89.149.201.147:4008 , piece_id=4VDQ3YJIO7WTIC3YV56ZAYYXE2BRTTWL2G2ZCVXSBBX57R2XCUYA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.158173573 (931h35m48.510958681s) [noise=true , address=185.167.204.205:4012 , piece_id=JCTVQTWNU5X7IB2JLL5E4ANPBIJOZFGHDIUAX6SL7ZLN6XYDUWGA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.158368348 (931h35m48.511153446s) [noise=true , address=185.167.204.206:4044 , piece_id=3ZDCAY4VYLT52AJORNLAFMYYI7WA6SEVUZQ4DR625DUSTWQ4J2VQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.159021985 (931h35m48.511807073s) [noise=true , address=81.171.14.70:4034 , piece_id=YADJOEALDIEY3LS5ZGQ5WP3YXWJDQ325HALNAHTQP43Q5ACABIBQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.607848645 (931h35m48.960633743s) [upload=819867]: Next returned nil segment
Oct 7 09:44:13.607861248 (931h35m48.960646356s) [upload=819867]: Waiting for error group managing segments...
Oct 7 09:44:13.778748780 (931h35m49.131533888s) [noise=true , address=81.171.14.70:4045 , piece_id=FSR77DDZPZUOWG664OGJIHMG4QMXDLYJDFZSIDEBM2JOYT7VOWZQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.781688647 (931h35m49.134473755s) [noise=true , address=81.171.14.70:4040 , piece_id=R2QKQJ7M7L26V3UMJKGHSXTCQODRGKDWT4GXCG5MEKD56YSI7KUQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.797470124 (931h35m49.150255232s) [noise=true , address=185.167.204.206:4068 , piece_id=HRQ7RG3QCA3YRUJTKTXCZ2QXGJQQJFKBZX5PHYF4AG3XWRSTEYQQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.798945413 (931h35m49.151730521s) [noise=true , address=185.167.204.206:4066 , piece_id=MC6WNACVRGQRCLF2OHLDTLLJCKUGA3XJPBN5T4QZUHC4RBR57NSA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.799672778 (931h35m49.152457886s) [noise=true , address=185.167.204.206:4044 , piece_id=3ZDCAY4VYLT52AJORNLAFMYYI7WA6SEVUZQ4DR625DUSTWQ4J2VQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.800694025 (931h35m49.153479133s) [noise=true , address=81.171.14.70:4043 , piece_id=GXEEOBGLYCQRH3R23NOQZ2XZLPY3PTHBWFF37UBQLL4QDVWFZRTA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.800815923 (931h35m49.153601031s) [noise=true , address=185.167.204.205:4021 , piece_id=ZABC4XM4B3GI76CQ63FC3DPFJUNKD3SW3RRGWR6WHKSID2GLOKDA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.803356381 (931h35m49.15614149s) [noise=true , address=185.167.204.206:4051 , piece_id=BNG3DAFHD4FOFXZMOZVPDLGBUX4HER2RX32POUNEX26DXU6GOTMA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.819254868 (931h35m49.172039976s) [noise=true , address=185.167.204.205:4012 , piece_id=JCTVQTWNU5X7IB2JLL5E4ANPBIJOZFGHDIUAX6SL7ZLN6XYDUWGA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.828359534 (931h35m49.181144643s) [noise=true , address=185.167.204.206:4063 , piece_id=ENFSIKRYEECUMNC76PCD442FCYYN4X4ZPKFXSPLEVNBBYA7QWS3Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.829841225 (931h35m49.182626323s) [noise=true , address=185.167.204.206:4041 , piece_id=KXQ5UIZXHDIWTOTTZR3G5EGRH7I55LWNH6OKR5HB6F3MOMBN4TDQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.830076737 (931h35m49.182861836s) [noise=true , address=89.149.201.147:4009 , piece_id=XUFZXG6VXQMI64FZFML6AX2VSZFEXDVDC2JDW7HDHSZ2C6UG55FA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.831280656 (931h35m49.184065754s) [noise=true , address=185.167.204.205:4029 , piece_id=GKGZUB2TTAIT67CCUMOOTPYMTMSGWD4RHW5GAXMIXQLXXQYPDY6Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.835538818 (931h35m49.188323926s) [noise=true , address=185.167.204.205:4009 , piece_id=F2OXD55LMZBZWP3OOD47VECF6QO74ND2LGMSLCBP6XMTBYLKKIDA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.839852703 (931h35m49.192637811s) [noise=true , address=185.167.204.206:4058 , piece_id=CWCQOHWD3LCWGDIE7FG26AB67NKYT442MPVIKICIHEAJ7RB5WDWA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.841847307 (931h35m49.194632406s) [noise=true , address=81.171.14.70:4035 , piece_id=SLUDX3Y4VBI7NXJWDAK4MRFW5EJU5JRBSFCSHXRP75GOBCBQU5WQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.849204934 (931h35m49.201990032s) [noise=true , address=89.149.201.147:4014 , piece_id=DWVUVNFYMZYWRIF4QU2UM5S4JBQWM2CBDNKVUOQOZDX4AY3KCF6Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.849297689 (931h35m49.202082787s) [noise=true , address=89.149.201.147:4010 , piece_id=PAKKECZ4EI45MTDWKQ6ACFVS3LQNCJJXO5NPRGAZ2ZUATYTX6ROQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.850790530 (931h35m49.203575629s) [noise=true , address=89.149.201.147:4011 , piece_id=23CV6F4FGTKWKAWDE7AUGQRWDFZGN37BIUQPJQXUH3HQWTURHUZQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.856762598 (931h35m49.209547696s) [noise=true , address=89.149.201.147:4008 , piece_id=4VDQ3YJIO7WTIC3YV56ZAYYXE2BRTTWL2G2ZCVXSBBX57R2XCUYA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.858751770 (931h35m49.211536869s) [noise=true , address=89.149.201.147:4013 , piece_id=ZDSSVS4VXF4HBWWASN2C7G2YFF2LDX3Q3SDBMUIFRFK3B2XXSBOQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.883309048 (931h35m49.236094146s) [noise=true , address=89.149.201.147:4002 , piece_id=BBRHLQDW22HSJE2P7LPE4Y67TOIQKFBQ4VQ5GKSF4KK5UDK3E23A, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.890627422 (931h35m49.24341253s) [noise=true , address=89.149.201.147:4012 , piece_id=VNITDM4Z3CWAGWHGOFMC3LP3E2GTVMFUT2FQL3I53HDK5ANYRNMA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:45:12.644603566 (931h36m47.997388694s) [noise=true , address=81.171.14.70:4033 , piece_id=FEOAQXS524JOQ76MV3AQPLIUCSGQUZBQOG4FJ43NKMFGOPWA6YQA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: write tcp 5.161.89.252:15820->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644683927 (931h36m47.997469065s) [noise=true , address=81.171.14.70:4029 , piece_id=5PUSRNZMLVD52TK33GQ3OTWC3U5N3526V4JPJOTZU4N53J6IQMGQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 5.161.89.252:42584->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644856971 (931h36m47.9976421s) [noise=true , address=81.171.14.70:4026 , piece_id=MVAEP4WRG5CQ4QAWOMB5JI7LFXQ2XXIQUWLKGD6FGYZO6OXNAWNA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: write tcp 5.161.89.252:25768->81.171.14.70:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644943003 (931h36m47.997728101s) [noise=true , address=81.171.14.70:4042 , piece_id=E2W7OQ3WJV5WBZVCR7UT3TPNGIZAQHKWVSVDFYXE3EYXPAKUOVRQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 5.161.89.252:48912->81.171.14.70:4042: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644981655 (931h36m47.997766803s) [noise=true , address=81.171.14.70:4034 , piece_id=YADJOEALDIEY3LS5ZGQ5WP3YXWJDQ325HALNAHTQP43Q5ACABIBQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: write tcp 5.161.89.252:57700->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.645044964 (931h36m47.997830102s) [seg_pos={0 0}, upload=819867]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil>
Oct 7 09:45:12.748884760 (931h36m48.101669889s) [upload=819867]: Done uploading segments...
Oct 7 09:45:12.748905800 (931h36m48.101690928s) [upload=819867]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23)
Duration: 2.341017534s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
1.692894097s
FAIL (2025-10-07 10:21:21 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 1.692923922s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
235.525776ms
FAIL (2025-10-07 10:21:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 7 10:12:10.229965070 (932h3m45.582750178s) [upload=820275]: Starting upload Oct 7 10:12:10.230038448 (932h3m45.582823556s) [upload=820275]: Done starting upload Oct 7 10:12:10.230096046 (932h3m45.582881154s) [upload=820275]: Uploading segments... Oct 7 10:12:10.230132875 (932h3m45.582917983s) [upload=820275]: Got next segment. Inline: true Oct 7 10:12:10.230138986 (932h3m45.582924094s) [upload=820275]: Waiting for error group managing segments... Oct 7 10:12:10.230171558 (932h3m45.582956656s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 7 10:12:10.230175415 (932h3m45.582960513s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 7 10:12:10.230177529 (932h3m45.582962628s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 7 10:13:10.202118923 (932h4m45.554904031s) [upload=820275]: Done uploading segments... Oct 7 10:13:10.202134061 (932h4m45.55491917s) [upload=820275]: Upload finished. err: metaclient: context deadline exceeded
Duration: 235.5433ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
1.833923685s
FAIL (2025-10-07 10:21:04 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 1.833944013s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
217.415337ms
FAIL (2025-10-07 10:20:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 7 10:12:10.229965070 (932h3m45.582750178s) [upload=820275]: Starting upload Oct 7 10:12:10.230038448 (932h3m45.582823556s) [upload=820275]: Done starting upload Oct 7 10:12:10.230096046 (932h3m45.582881154s) [upload=820275]: Uploading segments... Oct 7 10:12:10.230132875 (932h3m45.582917983s) [upload=820275]: Got next segment. Inline: true Oct 7 10:12:10.230138986 (932h3m45.582924094s) [upload=820275]: Waiting for error group managing segments... Oct 7 10:12:10.230171558 (932h3m45.582956656s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 7 10:12:10.230175415 (932h3m45.582960513s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 7 10:12:10.230177529 (932h3m45.582962628s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 7 10:13:10.202118923 (932h4m45.554904031s) [upload=820275]: Done uploading segments... Oct 7 10:13:10.202134061 (932h4m45.55491917s) [upload=820275]: Upload finished. err: metaclient: context deadline exceeded
Duration: 217.433892ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
1.726127517s
FAIL (2025-10-07 10:20:32 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 1.726152033s
core
uplink
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [.........XXX................................................] duration:
2.238103436s
FAIL (2025-10-07 10:20:24 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 23)
======LOGS======
WFZRTA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156581014 (931h35m48.509366112s) [noise=true , address=89.149.201.147:4013 , piece_id=ZDSSVS4VXF4HBWWASN2C7G2YFF2LDX3Q3SDBMUIFRFK3B2XXSBOQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156754609 (931h35m48.509539717s) [noise=true , address=81.171.14.70:4029 , piece_id=5PUSRNZMLVD52TK33GQ3OTWC3U5N3526V4JPJOTZU4N53J6IQMGQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156760662 (931h35m48.50954576s) [noise=true , address=81.171.14.70:4035 , piece_id=SLUDX3Y4VBI7NXJWDAK4MRFW5EJU5JRBSFCSHXRP75GOBCBQU5WQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157022393 (931h35m48.509807491s) [noise=true , address=81.171.14.70:4026 , piece_id=MVAEP4WRG5CQ4QAWOMB5JI7LFXQ2XXIQUWLKGD6FGYZO6OXNAWNA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157319349 (931h35m48.510104448s) [noise=true , address=185.167.204.205:4021 , piece_id=ZABC4XM4B3GI76CQ63FC3DPFJUNKD3SW3RRGWR6WHKSID2GLOKDA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157684756 (931h35m48.510469864s) [noise=true , address=89.149.201.147:4008 , piece_id=4VDQ3YJIO7WTIC3YV56ZAYYXE2BRTTWL2G2ZCVXSBBX57R2XCUYA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.158173573 (931h35m48.510958681s) [noise=true , address=185.167.204.205:4012 , piece_id=JCTVQTWNU5X7IB2JLL5E4ANPBIJOZFGHDIUAX6SL7ZLN6XYDUWGA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.158368348 (931h35m48.511153446s) [noise=true , address=185.167.204.206:4044 , piece_id=3ZDCAY4VYLT52AJORNLAFMYYI7WA6SEVUZQ4DR625DUSTWQ4J2VQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.159021985 (931h35m48.511807073s) [noise=true , address=81.171.14.70:4034 , piece_id=YADJOEALDIEY3LS5ZGQ5WP3YXWJDQ325HALNAHTQP43Q5ACABIBQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.607848645 (931h35m48.960633743s) [upload=819867]: Next returned nil segment
Oct 7 09:44:13.607861248 (931h35m48.960646356s) [upload=819867]: Waiting for error group managing segments...
Oct 7 09:44:13.778748780 (931h35m49.131533888s) [noise=true , address=81.171.14.70:4045 , piece_id=FSR77DDZPZUOWG664OGJIHMG4QMXDLYJDFZSIDEBM2JOYT7VOWZQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.781688647 (931h35m49.134473755s) [noise=true , address=81.171.14.70:4040 , piece_id=R2QKQJ7M7L26V3UMJKGHSXTCQODRGKDWT4GXCG5MEKD56YSI7KUQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.797470124 (931h35m49.150255232s) [noise=true , address=185.167.204.206:4068 , piece_id=HRQ7RG3QCA3YRUJTKTXCZ2QXGJQQJFKBZX5PHYF4AG3XWRSTEYQQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.798945413 (931h35m49.151730521s) [noise=true , address=185.167.204.206:4066 , piece_id=MC6WNACVRGQRCLF2OHLDTLLJCKUGA3XJPBN5T4QZUHC4RBR57NSA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.799672778 (931h35m49.152457886s) [noise=true , address=185.167.204.206:4044 , piece_id=3ZDCAY4VYLT52AJORNLAFMYYI7WA6SEVUZQ4DR625DUSTWQ4J2VQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.800694025 (931h35m49.153479133s) [noise=true , address=81.171.14.70:4043 , piece_id=GXEEOBGLYCQRH3R23NOQZ2XZLPY3PTHBWFF37UBQLL4QDVWFZRTA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.800815923 (931h35m49.153601031s) [noise=true , address=185.167.204.205:4021 , piece_id=ZABC4XM4B3GI76CQ63FC3DPFJUNKD3SW3RRGWR6WHKSID2GLOKDA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.803356381 (931h35m49.15614149s) [noise=true , address=185.167.204.206:4051 , piece_id=BNG3DAFHD4FOFXZMOZVPDLGBUX4HER2RX32POUNEX26DXU6GOTMA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.819254868 (931h35m49.172039976s) [noise=true , address=185.167.204.205:4012 , piece_id=JCTVQTWNU5X7IB2JLL5E4ANPBIJOZFGHDIUAX6SL7ZLN6XYDUWGA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.828359534 (931h35m49.181144643s) [noise=true , address=185.167.204.206:4063 , piece_id=ENFSIKRYEECUMNC76PCD442FCYYN4X4ZPKFXSPLEVNBBYA7QWS3Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.829841225 (931h35m49.182626323s) [noise=true , address=185.167.204.206:4041 , piece_id=KXQ5UIZXHDIWTOTTZR3G5EGRH7I55LWNH6OKR5HB6F3MOMBN4TDQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.830076737 (931h35m49.182861836s) [noise=true , address=89.149.201.147:4009 , piece_id=XUFZXG6VXQMI64FZFML6AX2VSZFEXDVDC2JDW7HDHSZ2C6UG55FA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.831280656 (931h35m49.184065754s) [noise=true , address=185.167.204.205:4029 , piece_id=GKGZUB2TTAIT67CCUMOOTPYMTMSGWD4RHW5GAXMIXQLXXQYPDY6Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.835538818 (931h35m49.188323926s) [noise=true , address=185.167.204.205:4009 , piece_id=F2OXD55LMZBZWP3OOD47VECF6QO74ND2LGMSLCBP6XMTBYLKKIDA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.839852703 (931h35m49.192637811s) [noise=true , address=185.167.204.206:4058 , piece_id=CWCQOHWD3LCWGDIE7FG26AB67NKYT442MPVIKICIHEAJ7RB5WDWA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.841847307 (931h35m49.194632406s) [noise=true , address=81.171.14.70:4035 , piece_id=SLUDX3Y4VBI7NXJWDAK4MRFW5EJU5JRBSFCSHXRP75GOBCBQU5WQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.849204934 (931h35m49.201990032s) [noise=true , address=89.149.201.147:4014 , piece_id=DWVUVNFYMZYWRIF4QU2UM5S4JBQWM2CBDNKVUOQOZDX4AY3KCF6Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.849297689 (931h35m49.202082787s) [noise=true , address=89.149.201.147:4010 , piece_id=PAKKECZ4EI45MTDWKQ6ACFVS3LQNCJJXO5NPRGAZ2ZUATYTX6ROQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.850790530 (931h35m49.203575629s) [noise=true , address=89.149.201.147:4011 , piece_id=23CV6F4FGTKWKAWDE7AUGQRWDFZGN37BIUQPJQXUH3HQWTURHUZQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.856762598 (931h35m49.209547696s) [noise=true , address=89.149.201.147:4008 , piece_id=4VDQ3YJIO7WTIC3YV56ZAYYXE2BRTTWL2G2ZCVXSBBX57R2XCUYA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.858751770 (931h35m49.211536869s) [noise=true , address=89.149.201.147:4013 , piece_id=ZDSSVS4VXF4HBWWASN2C7G2YFF2LDX3Q3SDBMUIFRFK3B2XXSBOQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.883309048 (931h35m49.236094146s) [noise=true , address=89.149.201.147:4002 , piece_id=BBRHLQDW22HSJE2P7LPE4Y67TOIQKFBQ4VQ5GKSF4KK5UDK3E23A, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.890627422 (931h35m49.24341253s) [noise=true , address=89.149.201.147:4012 , piece_id=VNITDM4Z3CWAGWHGOFMC3LP3E2GTVMFUT2FQL3I53HDK5ANYRNMA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:45:12.644603566 (931h36m47.997388694s) [noise=true , address=81.171.14.70:4033 , piece_id=FEOAQXS524JOQ76MV3AQPLIUCSGQUZBQOG4FJ43NKMFGOPWA6YQA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: write tcp 5.161.89.252:15820->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644683927 (931h36m47.997469065s) [noise=true , address=81.171.14.70:4029 , piece_id=5PUSRNZMLVD52TK33GQ3OTWC3U5N3526V4JPJOTZU4N53J6IQMGQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 5.161.89.252:42584->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644856971 (931h36m47.9976421s) [noise=true , address=81.171.14.70:4026 , piece_id=MVAEP4WRG5CQ4QAWOMB5JI7LFXQ2XXIQUWLKGD6FGYZO6OXNAWNA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: write tcp 5.161.89.252:25768->81.171.14.70:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644943003 (931h36m47.997728101s) [noise=true , address=81.171.14.70:4042 , piece_id=E2W7OQ3WJV5WBZVCR7UT3TPNGIZAQHKWVSVDFYXE3EYXPAKUOVRQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 5.161.89.252:48912->81.171.14.70:4042: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644981655 (931h36m47.997766803s) [noise=true , address=81.171.14.70:4034 , piece_id=YADJOEALDIEY3LS5ZGQ5WP3YXWJDQ325HALNAHTQP43Q5ACABIBQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: write tcp 5.161.89.252:57700->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.645044964 (931h36m47.997830102s) [seg_pos={0 0}, upload=819867]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil>
Oct 7 09:45:12.748884760 (931h36m48.101669889s) [upload=819867]: Done uploading segments...
Oct 7 09:45:12.748905800 (931h36m48.101690928s) [upload=819867]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23)
Duration: 2.238129634s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [..........XXX...............................................] duration:
2.210949165s
FAIL (2025-10-07 10:20:06 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 23)
======LOGS======
WFZRTA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156581014 (931h35m48.509366112s) [noise=true , address=89.149.201.147:4013 , piece_id=ZDSSVS4VXF4HBWWASN2C7G2YFF2LDX3Q3SDBMUIFRFK3B2XXSBOQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156754609 (931h35m48.509539717s) [noise=true , address=81.171.14.70:4029 , piece_id=5PUSRNZMLVD52TK33GQ3OTWC3U5N3526V4JPJOTZU4N53J6IQMGQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156760662 (931h35m48.50954576s) [noise=true , address=81.171.14.70:4035 , piece_id=SLUDX3Y4VBI7NXJWDAK4MRFW5EJU5JRBSFCSHXRP75GOBCBQU5WQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157022393 (931h35m48.509807491s) [noise=true , address=81.171.14.70:4026 , piece_id=MVAEP4WRG5CQ4QAWOMB5JI7LFXQ2XXIQUWLKGD6FGYZO6OXNAWNA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157319349 (931h35m48.510104448s) [noise=true , address=185.167.204.205:4021 , piece_id=ZABC4XM4B3GI76CQ63FC3DPFJUNKD3SW3RRGWR6WHKSID2GLOKDA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157684756 (931h35m48.510469864s) [noise=true , address=89.149.201.147:4008 , piece_id=4VDQ3YJIO7WTIC3YV56ZAYYXE2BRTTWL2G2ZCVXSBBX57R2XCUYA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.158173573 (931h35m48.510958681s) [noise=true , address=185.167.204.205:4012 , piece_id=JCTVQTWNU5X7IB2JLL5E4ANPBIJOZFGHDIUAX6SL7ZLN6XYDUWGA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.158368348 (931h35m48.511153446s) [noise=true , address=185.167.204.206:4044 , piece_id=3ZDCAY4VYLT52AJORNLAFMYYI7WA6SEVUZQ4DR625DUSTWQ4J2VQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.159021985 (931h35m48.511807073s) [noise=true , address=81.171.14.70:4034 , piece_id=YADJOEALDIEY3LS5ZGQ5WP3YXWJDQ325HALNAHTQP43Q5ACABIBQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.607848645 (931h35m48.960633743s) [upload=819867]: Next returned nil segment
Oct 7 09:44:13.607861248 (931h35m48.960646356s) [upload=819867]: Waiting for error group managing segments...
Oct 7 09:44:13.778748780 (931h35m49.131533888s) [noise=true , address=81.171.14.70:4045 , piece_id=FSR77DDZPZUOWG664OGJIHMG4QMXDLYJDFZSIDEBM2JOYT7VOWZQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.781688647 (931h35m49.134473755s) [noise=true , address=81.171.14.70:4040 , piece_id=R2QKQJ7M7L26V3UMJKGHSXTCQODRGKDWT4GXCG5MEKD56YSI7KUQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.797470124 (931h35m49.150255232s) [noise=true , address=185.167.204.206:4068 , piece_id=HRQ7RG3QCA3YRUJTKTXCZ2QXGJQQJFKBZX5PHYF4AG3XWRSTEYQQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.798945413 (931h35m49.151730521s) [noise=true , address=185.167.204.206:4066 , piece_id=MC6WNACVRGQRCLF2OHLDTLLJCKUGA3XJPBN5T4QZUHC4RBR57NSA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.799672778 (931h35m49.152457886s) [noise=true , address=185.167.204.206:4044 , piece_id=3ZDCAY4VYLT52AJORNLAFMYYI7WA6SEVUZQ4DR625DUSTWQ4J2VQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.800694025 (931h35m49.153479133s) [noise=true , address=81.171.14.70:4043 , piece_id=GXEEOBGLYCQRH3R23NOQZ2XZLPY3PTHBWFF37UBQLL4QDVWFZRTA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.800815923 (931h35m49.153601031s) [noise=true , address=185.167.204.205:4021 , piece_id=ZABC4XM4B3GI76CQ63FC3DPFJUNKD3SW3RRGWR6WHKSID2GLOKDA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.803356381 (931h35m49.15614149s) [noise=true , address=185.167.204.206:4051 , piece_id=BNG3DAFHD4FOFXZMOZVPDLGBUX4HER2RX32POUNEX26DXU6GOTMA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.819254868 (931h35m49.172039976s) [noise=true , address=185.167.204.205:4012 , piece_id=JCTVQTWNU5X7IB2JLL5E4ANPBIJOZFGHDIUAX6SL7ZLN6XYDUWGA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.828359534 (931h35m49.181144643s) [noise=true , address=185.167.204.206:4063 , piece_id=ENFSIKRYEECUMNC76PCD442FCYYN4X4ZPKFXSPLEVNBBYA7QWS3Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.829841225 (931h35m49.182626323s) [noise=true , address=185.167.204.206:4041 , piece_id=KXQ5UIZXHDIWTOTTZR3G5EGRH7I55LWNH6OKR5HB6F3MOMBN4TDQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.830076737 (931h35m49.182861836s) [noise=true , address=89.149.201.147:4009 , piece_id=XUFZXG6VXQMI64FZFML6AX2VSZFEXDVDC2JDW7HDHSZ2C6UG55FA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.831280656 (931h35m49.184065754s) [noise=true , address=185.167.204.205:4029 , piece_id=GKGZUB2TTAIT67CCUMOOTPYMTMSGWD4RHW5GAXMIXQLXXQYPDY6Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.835538818 (931h35m49.188323926s) [noise=true , address=185.167.204.205:4009 , piece_id=F2OXD55LMZBZWP3OOD47VECF6QO74ND2LGMSLCBP6XMTBYLKKIDA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.839852703 (931h35m49.192637811s) [noise=true , address=185.167.204.206:4058 , piece_id=CWCQOHWD3LCWGDIE7FG26AB67NKYT442MPVIKICIHEAJ7RB5WDWA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.841847307 (931h35m49.194632406s) [noise=true , address=81.171.14.70:4035 , piece_id=SLUDX3Y4VBI7NXJWDAK4MRFW5EJU5JRBSFCSHXRP75GOBCBQU5WQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.849204934 (931h35m49.201990032s) [noise=true , address=89.149.201.147:4014 , piece_id=DWVUVNFYMZYWRIF4QU2UM5S4JBQWM2CBDNKVUOQOZDX4AY3KCF6Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.849297689 (931h35m49.202082787s) [noise=true , address=89.149.201.147:4010 , piece_id=PAKKECZ4EI45MTDWKQ6ACFVS3LQNCJJXO5NPRGAZ2ZUATYTX6ROQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.850790530 (931h35m49.203575629s) [noise=true , address=89.149.201.147:4011 , piece_id=23CV6F4FGTKWKAWDE7AUGQRWDFZGN37BIUQPJQXUH3HQWTURHUZQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.856762598 (931h35m49.209547696s) [noise=true , address=89.149.201.147:4008 , piece_id=4VDQ3YJIO7WTIC3YV56ZAYYXE2BRTTWL2G2ZCVXSBBX57R2XCUYA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.858751770 (931h35m49.211536869s) [noise=true , address=89.149.201.147:4013 , piece_id=ZDSSVS4VXF4HBWWASN2C7G2YFF2LDX3Q3SDBMUIFRFK3B2XXSBOQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.883309048 (931h35m49.236094146s) [noise=true , address=89.149.201.147:4002 , piece_id=BBRHLQDW22HSJE2P7LPE4Y67TOIQKFBQ4VQ5GKSF4KK5UDK3E23A, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.890627422 (931h35m49.24341253s) [noise=true , address=89.149.201.147:4012 , piece_id=VNITDM4Z3CWAGWHGOFMC3LP3E2GTVMFUT2FQL3I53HDK5ANYRNMA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:45:12.644603566 (931h36m47.997388694s) [noise=true , address=81.171.14.70:4033 , piece_id=FEOAQXS524JOQ76MV3AQPLIUCSGQUZBQOG4FJ43NKMFGOPWA6YQA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: write tcp 5.161.89.252:15820->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644683927 (931h36m47.997469065s) [noise=true , address=81.171.14.70:4029 , piece_id=5PUSRNZMLVD52TK33GQ3OTWC3U5N3526V4JPJOTZU4N53J6IQMGQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 5.161.89.252:42584->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644856971 (931h36m47.9976421s) [noise=true , address=81.171.14.70:4026 , piece_id=MVAEP4WRG5CQ4QAWOMB5JI7LFXQ2XXIQUWLKGD6FGYZO6OXNAWNA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: write tcp 5.161.89.252:25768->81.171.14.70:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644943003 (931h36m47.997728101s) [noise=true , address=81.171.14.70:4042 , piece_id=E2W7OQ3WJV5WBZVCR7UT3TPNGIZAQHKWVSVDFYXE3EYXPAKUOVRQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 5.161.89.252:48912->81.171.14.70:4042: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644981655 (931h36m47.997766803s) [noise=true , address=81.171.14.70:4034 , piece_id=YADJOEALDIEY3LS5ZGQ5WP3YXWJDQ325HALNAHTQP43Q5ACABIBQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: write tcp 5.161.89.252:57700->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.645044964 (931h36m47.997830102s) [seg_pos={0 0}, upload=819867]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil>
Oct 7 09:45:12.748884760 (931h36m48.101669889s) [upload=819867]: Done uploading segments...
Oct 7 09:45:12.748905800 (931h36m48.101690928s) [upload=819867]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23)
Duration: 2.210970236s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
138.855045ms
FAIL (2025-10-07 10:19:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 7 10:12:10.229965070 (932h3m45.582750178s) [upload=820275]: Starting upload Oct 7 10:12:10.230038448 (932h3m45.582823556s) [upload=820275]: Done starting upload Oct 7 10:12:10.230096046 (932h3m45.582881154s) [upload=820275]: Uploading segments... Oct 7 10:12:10.230132875 (932h3m45.582917983s) [upload=820275]: Got next segment. Inline: true Oct 7 10:12:10.230138986 (932h3m45.582924094s) [upload=820275]: Waiting for error group managing segments... Oct 7 10:12:10.230171558 (932h3m45.582956656s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 7 10:12:10.230175415 (932h3m45.582960513s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 7 10:12:10.230177529 (932h3m45.582962628s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 7 10:13:10.202118923 (932h4m45.554904031s) [upload=820275]: Done uploading segments... Oct 7 10:13:10.202134061 (932h4m45.55491917s) [upload=820275]: Upload finished. err: metaclient: context deadline exceeded
Duration: 138.880514ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
1.631737837s
FAIL (2025-10-07 10:19:51 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 1.631753537s
core
uplink
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [...........XXX..............................................] duration:
2.420918081s
FAIL (2025-10-07 10:19:21 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 23)
======LOGS======
WFZRTA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156581014 (931h35m48.509366112s) [noise=true , address=89.149.201.147:4013 , piece_id=ZDSSVS4VXF4HBWWASN2C7G2YFF2LDX3Q3SDBMUIFRFK3B2XXSBOQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156754609 (931h35m48.509539717s) [noise=true , address=81.171.14.70:4029 , piece_id=5PUSRNZMLVD52TK33GQ3OTWC3U5N3526V4JPJOTZU4N53J6IQMGQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156760662 (931h35m48.50954576s) [noise=true , address=81.171.14.70:4035 , piece_id=SLUDX3Y4VBI7NXJWDAK4MRFW5EJU5JRBSFCSHXRP75GOBCBQU5WQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157022393 (931h35m48.509807491s) [noise=true , address=81.171.14.70:4026 , piece_id=MVAEP4WRG5CQ4QAWOMB5JI7LFXQ2XXIQUWLKGD6FGYZO6OXNAWNA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157319349 (931h35m48.510104448s) [noise=true , address=185.167.204.205:4021 , piece_id=ZABC4XM4B3GI76CQ63FC3DPFJUNKD3SW3RRGWR6WHKSID2GLOKDA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157684756 (931h35m48.510469864s) [noise=true , address=89.149.201.147:4008 , piece_id=4VDQ3YJIO7WTIC3YV56ZAYYXE2BRTTWL2G2ZCVXSBBX57R2XCUYA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.158173573 (931h35m48.510958681s) [noise=true , address=185.167.204.205:4012 , piece_id=JCTVQTWNU5X7IB2JLL5E4ANPBIJOZFGHDIUAX6SL7ZLN6XYDUWGA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.158368348 (931h35m48.511153446s) [noise=true , address=185.167.204.206:4044 , piece_id=3ZDCAY4VYLT52AJORNLAFMYYI7WA6SEVUZQ4DR625DUSTWQ4J2VQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.159021985 (931h35m48.511807073s) [noise=true , address=81.171.14.70:4034 , piece_id=YADJOEALDIEY3LS5ZGQ5WP3YXWJDQ325HALNAHTQP43Q5ACABIBQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.607848645 (931h35m48.960633743s) [upload=819867]: Next returned nil segment
Oct 7 09:44:13.607861248 (931h35m48.960646356s) [upload=819867]: Waiting for error group managing segments...
Oct 7 09:44:13.778748780 (931h35m49.131533888s) [noise=true , address=81.171.14.70:4045 , piece_id=FSR77DDZPZUOWG664OGJIHMG4QMXDLYJDFZSIDEBM2JOYT7VOWZQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.781688647 (931h35m49.134473755s) [noise=true , address=81.171.14.70:4040 , piece_id=R2QKQJ7M7L26V3UMJKGHSXTCQODRGKDWT4GXCG5MEKD56YSI7KUQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.797470124 (931h35m49.150255232s) [noise=true , address=185.167.204.206:4068 , piece_id=HRQ7RG3QCA3YRUJTKTXCZ2QXGJQQJFKBZX5PHYF4AG3XWRSTEYQQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.798945413 (931h35m49.151730521s) [noise=true , address=185.167.204.206:4066 , piece_id=MC6WNACVRGQRCLF2OHLDTLLJCKUGA3XJPBN5T4QZUHC4RBR57NSA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.799672778 (931h35m49.152457886s) [noise=true , address=185.167.204.206:4044 , piece_id=3ZDCAY4VYLT52AJORNLAFMYYI7WA6SEVUZQ4DR625DUSTWQ4J2VQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.800694025 (931h35m49.153479133s) [noise=true , address=81.171.14.70:4043 , piece_id=GXEEOBGLYCQRH3R23NOQZ2XZLPY3PTHBWFF37UBQLL4QDVWFZRTA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.800815923 (931h35m49.153601031s) [noise=true , address=185.167.204.205:4021 , piece_id=ZABC4XM4B3GI76CQ63FC3DPFJUNKD3SW3RRGWR6WHKSID2GLOKDA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.803356381 (931h35m49.15614149s) [noise=true , address=185.167.204.206:4051 , piece_id=BNG3DAFHD4FOFXZMOZVPDLGBUX4HER2RX32POUNEX26DXU6GOTMA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.819254868 (931h35m49.172039976s) [noise=true , address=185.167.204.205:4012 , piece_id=JCTVQTWNU5X7IB2JLL5E4ANPBIJOZFGHDIUAX6SL7ZLN6XYDUWGA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.828359534 (931h35m49.181144643s) [noise=true , address=185.167.204.206:4063 , piece_id=ENFSIKRYEECUMNC76PCD442FCYYN4X4ZPKFXSPLEVNBBYA7QWS3Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.829841225 (931h35m49.182626323s) [noise=true , address=185.167.204.206:4041 , piece_id=KXQ5UIZXHDIWTOTTZR3G5EGRH7I55LWNH6OKR5HB6F3MOMBN4TDQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.830076737 (931h35m49.182861836s) [noise=true , address=89.149.201.147:4009 , piece_id=XUFZXG6VXQMI64FZFML6AX2VSZFEXDVDC2JDW7HDHSZ2C6UG55FA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.831280656 (931h35m49.184065754s) [noise=true , address=185.167.204.205:4029 , piece_id=GKGZUB2TTAIT67CCUMOOTPYMTMSGWD4RHW5GAXMIXQLXXQYPDY6Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.835538818 (931h35m49.188323926s) [noise=true , address=185.167.204.205:4009 , piece_id=F2OXD55LMZBZWP3OOD47VECF6QO74ND2LGMSLCBP6XMTBYLKKIDA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.839852703 (931h35m49.192637811s) [noise=true , address=185.167.204.206:4058 , piece_id=CWCQOHWD3LCWGDIE7FG26AB67NKYT442MPVIKICIHEAJ7RB5WDWA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.841847307 (931h35m49.194632406s) [noise=true , address=81.171.14.70:4035 , piece_id=SLUDX3Y4VBI7NXJWDAK4MRFW5EJU5JRBSFCSHXRP75GOBCBQU5WQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.849204934 (931h35m49.201990032s) [noise=true , address=89.149.201.147:4014 , piece_id=DWVUVNFYMZYWRIF4QU2UM5S4JBQWM2CBDNKVUOQOZDX4AY3KCF6Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.849297689 (931h35m49.202082787s) [noise=true , address=89.149.201.147:4010 , piece_id=PAKKECZ4EI45MTDWKQ6ACFVS3LQNCJJXO5NPRGAZ2ZUATYTX6ROQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.850790530 (931h35m49.203575629s) [noise=true , address=89.149.201.147:4011 , piece_id=23CV6F4FGTKWKAWDE7AUGQRWDFZGN37BIUQPJQXUH3HQWTURHUZQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.856762598 (931h35m49.209547696s) [noise=true , address=89.149.201.147:4008 , piece_id=4VDQ3YJIO7WTIC3YV56ZAYYXE2BRTTWL2G2ZCVXSBBX57R2XCUYA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.858751770 (931h35m49.211536869s) [noise=true , address=89.149.201.147:4013 , piece_id=ZDSSVS4VXF4HBWWASN2C7G2YFF2LDX3Q3SDBMUIFRFK3B2XXSBOQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.883309048 (931h35m49.236094146s) [noise=true , address=89.149.201.147:4002 , piece_id=BBRHLQDW22HSJE2P7LPE4Y67TOIQKFBQ4VQ5GKSF4KK5UDK3E23A, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.890627422 (931h35m49.24341253s) [noise=true , address=89.149.201.147:4012 , piece_id=VNITDM4Z3CWAGWHGOFMC3LP3E2GTVMFUT2FQL3I53HDK5ANYRNMA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:45:12.644603566 (931h36m47.997388694s) [noise=true , address=81.171.14.70:4033 , piece_id=FEOAQXS524JOQ76MV3AQPLIUCSGQUZBQOG4FJ43NKMFGOPWA6YQA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: write tcp 5.161.89.252:15820->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644683927 (931h36m47.997469065s) [noise=true , address=81.171.14.70:4029 , piece_id=5PUSRNZMLVD52TK33GQ3OTWC3U5N3526V4JPJOTZU4N53J6IQMGQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 5.161.89.252:42584->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644856971 (931h36m47.9976421s) [noise=true , address=81.171.14.70:4026 , piece_id=MVAEP4WRG5CQ4QAWOMB5JI7LFXQ2XXIQUWLKGD6FGYZO6OXNAWNA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: write tcp 5.161.89.252:25768->81.171.14.70:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644943003 (931h36m47.997728101s) [noise=true , address=81.171.14.70:4042 , piece_id=E2W7OQ3WJV5WBZVCR7UT3TPNGIZAQHKWVSVDFYXE3EYXPAKUOVRQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 5.161.89.252:48912->81.171.14.70:4042: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644981655 (931h36m47.997766803s) [noise=true , address=81.171.14.70:4034 , piece_id=YADJOEALDIEY3LS5ZGQ5WP3YXWJDQ325HALNAHTQP43Q5ACABIBQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: write tcp 5.161.89.252:57700->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.645044964 (931h36m47.997830102s) [seg_pos={0 0}, upload=819867]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil>
Oct 7 09:45:12.748884760 (931h36m48.101669889s) [upload=819867]: Done uploading segments...
Oct 7 09:45:12.748905800 (931h36m48.101690928s) [upload=819867]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23)
Duration: 2.420930505s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
299.688857ms
FAIL (2025-10-07 10:19:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 7 10:12:10.229965070 (932h3m45.582750178s) [upload=820275]: Starting upload Oct 7 10:12:10.230038448 (932h3m45.582823556s) [upload=820275]: Done starting upload Oct 7 10:12:10.230096046 (932h3m45.582881154s) [upload=820275]: Uploading segments... Oct 7 10:12:10.230132875 (932h3m45.582917983s) [upload=820275]: Got next segment. Inline: true Oct 7 10:12:10.230138986 (932h3m45.582924094s) [upload=820275]: Waiting for error group managing segments... Oct 7 10:12:10.230171558 (932h3m45.582956656s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 7 10:12:10.230175415 (932h3m45.582960513s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 7 10:12:10.230177529 (932h3m45.582962628s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 7 10:13:10.202118923 (932h4m45.554904031s) [upload=820275]: Done uploading segments... Oct 7 10:13:10.202134061 (932h4m45.55491917s) [upload=820275]: Upload finished. err: metaclient: context deadline exceeded
Duration: 299.708505ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
1.807210712s
FAIL (2025-10-07 10:18:45 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 1.807227633s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
319.782327ms
FAIL (2025-10-07 10:18:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 7 10:12:10.229965070 (932h3m45.582750178s) [upload=820275]: Starting upload Oct 7 10:12:10.230038448 (932h3m45.582823556s) [upload=820275]: Done starting upload Oct 7 10:12:10.230096046 (932h3m45.582881154s) [upload=820275]: Uploading segments... Oct 7 10:12:10.230132875 (932h3m45.582917983s) [upload=820275]: Got next segment. Inline: true Oct 7 10:12:10.230138986 (932h3m45.582924094s) [upload=820275]: Waiting for error group managing segments... Oct 7 10:12:10.230171558 (932h3m45.582956656s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 7 10:12:10.230175415 (932h3m45.582960513s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 7 10:12:10.230177529 (932h3m45.582962628s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 7 10:13:10.202118923 (932h4m45.554904031s) [upload=820275]: Done uploading segments... Oct 7 10:13:10.202134061 (932h4m45.55491917s) [upload=820275]: Upload finished. err: metaclient: context deadline exceeded
Duration: 319.804168ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [............XXX.............................................] duration:
2.281579847s
FAIL (2025-10-07 10:18:20 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 23)
======LOGS======
WFZRTA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156581014 (931h35m48.509366112s) [noise=true , address=89.149.201.147:4013 , piece_id=ZDSSVS4VXF4HBWWASN2C7G2YFF2LDX3Q3SDBMUIFRFK3B2XXSBOQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156754609 (931h35m48.509539717s) [noise=true , address=81.171.14.70:4029 , piece_id=5PUSRNZMLVD52TK33GQ3OTWC3U5N3526V4JPJOTZU4N53J6IQMGQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156760662 (931h35m48.50954576s) [noise=true , address=81.171.14.70:4035 , piece_id=SLUDX3Y4VBI7NXJWDAK4MRFW5EJU5JRBSFCSHXRP75GOBCBQU5WQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157022393 (931h35m48.509807491s) [noise=true , address=81.171.14.70:4026 , piece_id=MVAEP4WRG5CQ4QAWOMB5JI7LFXQ2XXIQUWLKGD6FGYZO6OXNAWNA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157319349 (931h35m48.510104448s) [noise=true , address=185.167.204.205:4021 , piece_id=ZABC4XM4B3GI76CQ63FC3DPFJUNKD3SW3RRGWR6WHKSID2GLOKDA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157684756 (931h35m48.510469864s) [noise=true , address=89.149.201.147:4008 , piece_id=4VDQ3YJIO7WTIC3YV56ZAYYXE2BRTTWL2G2ZCVXSBBX57R2XCUYA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.158173573 (931h35m48.510958681s) [noise=true , address=185.167.204.205:4012 , piece_id=JCTVQTWNU5X7IB2JLL5E4ANPBIJOZFGHDIUAX6SL7ZLN6XYDUWGA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.158368348 (931h35m48.511153446s) [noise=true , address=185.167.204.206:4044 , piece_id=3ZDCAY4VYLT52AJORNLAFMYYI7WA6SEVUZQ4DR625DUSTWQ4J2VQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.159021985 (931h35m48.511807073s) [noise=true , address=81.171.14.70:4034 , piece_id=YADJOEALDIEY3LS5ZGQ5WP3YXWJDQ325HALNAHTQP43Q5ACABIBQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.607848645 (931h35m48.960633743s) [upload=819867]: Next returned nil segment
Oct 7 09:44:13.607861248 (931h35m48.960646356s) [upload=819867]: Waiting for error group managing segments...
Oct 7 09:44:13.778748780 (931h35m49.131533888s) [noise=true , address=81.171.14.70:4045 , piece_id=FSR77DDZPZUOWG664OGJIHMG4QMXDLYJDFZSIDEBM2JOYT7VOWZQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.781688647 (931h35m49.134473755s) [noise=true , address=81.171.14.70:4040 , piece_id=R2QKQJ7M7L26V3UMJKGHSXTCQODRGKDWT4GXCG5MEKD56YSI7KUQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.797470124 (931h35m49.150255232s) [noise=true , address=185.167.204.206:4068 , piece_id=HRQ7RG3QCA3YRUJTKTXCZ2QXGJQQJFKBZX5PHYF4AG3XWRSTEYQQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.798945413 (931h35m49.151730521s) [noise=true , address=185.167.204.206:4066 , piece_id=MC6WNACVRGQRCLF2OHLDTLLJCKUGA3XJPBN5T4QZUHC4RBR57NSA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.799672778 (931h35m49.152457886s) [noise=true , address=185.167.204.206:4044 , piece_id=3ZDCAY4VYLT52AJORNLAFMYYI7WA6SEVUZQ4DR625DUSTWQ4J2VQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.800694025 (931h35m49.153479133s) [noise=true , address=81.171.14.70:4043 , piece_id=GXEEOBGLYCQRH3R23NOQZ2XZLPY3PTHBWFF37UBQLL4QDVWFZRTA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.800815923 (931h35m49.153601031s) [noise=true , address=185.167.204.205:4021 , piece_id=ZABC4XM4B3GI76CQ63FC3DPFJUNKD3SW3RRGWR6WHKSID2GLOKDA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.803356381 (931h35m49.15614149s) [noise=true , address=185.167.204.206:4051 , piece_id=BNG3DAFHD4FOFXZMOZVPDLGBUX4HER2RX32POUNEX26DXU6GOTMA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.819254868 (931h35m49.172039976s) [noise=true , address=185.167.204.205:4012 , piece_id=JCTVQTWNU5X7IB2JLL5E4ANPBIJOZFGHDIUAX6SL7ZLN6XYDUWGA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.828359534 (931h35m49.181144643s) [noise=true , address=185.167.204.206:4063 , piece_id=ENFSIKRYEECUMNC76PCD442FCYYN4X4ZPKFXSPLEVNBBYA7QWS3Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.829841225 (931h35m49.182626323s) [noise=true , address=185.167.204.206:4041 , piece_id=KXQ5UIZXHDIWTOTTZR3G5EGRH7I55LWNH6OKR5HB6F3MOMBN4TDQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.830076737 (931h35m49.182861836s) [noise=true , address=89.149.201.147:4009 , piece_id=XUFZXG6VXQMI64FZFML6AX2VSZFEXDVDC2JDW7HDHSZ2C6UG55FA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.831280656 (931h35m49.184065754s) [noise=true , address=185.167.204.205:4029 , piece_id=GKGZUB2TTAIT67CCUMOOTPYMTMSGWD4RHW5GAXMIXQLXXQYPDY6Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.835538818 (931h35m49.188323926s) [noise=true , address=185.167.204.205:4009 , piece_id=F2OXD55LMZBZWP3OOD47VECF6QO74ND2LGMSLCBP6XMTBYLKKIDA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.839852703 (931h35m49.192637811s) [noise=true , address=185.167.204.206:4058 , piece_id=CWCQOHWD3LCWGDIE7FG26AB67NKYT442MPVIKICIHEAJ7RB5WDWA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.841847307 (931h35m49.194632406s) [noise=true , address=81.171.14.70:4035 , piece_id=SLUDX3Y4VBI7NXJWDAK4MRFW5EJU5JRBSFCSHXRP75GOBCBQU5WQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.849204934 (931h35m49.201990032s) [noise=true , address=89.149.201.147:4014 , piece_id=DWVUVNFYMZYWRIF4QU2UM5S4JBQWM2CBDNKVUOQOZDX4AY3KCF6Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.849297689 (931h35m49.202082787s) [noise=true , address=89.149.201.147:4010 , piece_id=PAKKECZ4EI45MTDWKQ6ACFVS3LQNCJJXO5NPRGAZ2ZUATYTX6ROQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.850790530 (931h35m49.203575629s) [noise=true , address=89.149.201.147:4011 , piece_id=23CV6F4FGTKWKAWDE7AUGQRWDFZGN37BIUQPJQXUH3HQWTURHUZQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.856762598 (931h35m49.209547696s) [noise=true , address=89.149.201.147:4008 , piece_id=4VDQ3YJIO7WTIC3YV56ZAYYXE2BRTTWL2G2ZCVXSBBX57R2XCUYA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.858751770 (931h35m49.211536869s) [noise=true , address=89.149.201.147:4013 , piece_id=ZDSSVS4VXF4HBWWASN2C7G2YFF2LDX3Q3SDBMUIFRFK3B2XXSBOQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.883309048 (931h35m49.236094146s) [noise=true , address=89.149.201.147:4002 , piece_id=BBRHLQDW22HSJE2P7LPE4Y67TOIQKFBQ4VQ5GKSF4KK5UDK3E23A, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.890627422 (931h35m49.24341253s) [noise=true , address=89.149.201.147:4012 , piece_id=VNITDM4Z3CWAGWHGOFMC3LP3E2GTVMFUT2FQL3I53HDK5ANYRNMA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:45:12.644603566 (931h36m47.997388694s) [noise=true , address=81.171.14.70:4033 , piece_id=FEOAQXS524JOQ76MV3AQPLIUCSGQUZBQOG4FJ43NKMFGOPWA6YQA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: write tcp 5.161.89.252:15820->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644683927 (931h36m47.997469065s) [noise=true , address=81.171.14.70:4029 , piece_id=5PUSRNZMLVD52TK33GQ3OTWC3U5N3526V4JPJOTZU4N53J6IQMGQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 5.161.89.252:42584->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644856971 (931h36m47.9976421s) [noise=true , address=81.171.14.70:4026 , piece_id=MVAEP4WRG5CQ4QAWOMB5JI7LFXQ2XXIQUWLKGD6FGYZO6OXNAWNA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: write tcp 5.161.89.252:25768->81.171.14.70:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644943003 (931h36m47.997728101s) [noise=true , address=81.171.14.70:4042 , piece_id=E2W7OQ3WJV5WBZVCR7UT3TPNGIZAQHKWVSVDFYXE3EYXPAKUOVRQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 5.161.89.252:48912->81.171.14.70:4042: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644981655 (931h36m47.997766803s) [noise=true , address=81.171.14.70:4034 , piece_id=YADJOEALDIEY3LS5ZGQ5WP3YXWJDQ325HALNAHTQP43Q5ACABIBQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: write tcp 5.161.89.252:57700->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.645044964 (931h36m47.997830102s) [seg_pos={0 0}, upload=819867]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil>
Oct 7 09:45:12.748884760 (931h36m48.101669889s) [upload=819867]: Done uploading segments...
Oct 7 09:45:12.748905800 (931h36m48.101690928s) [upload=819867]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23)
Duration: 2.28161303s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
1.840933488s
FAIL (2025-10-07 10:17:47 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 1.840954597s
core
uplink
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [.............XXX............................................] duration:
2.682240014s
FAIL (2025-10-07 10:17:46 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 23)
======LOGS======
WFZRTA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156581014 (931h35m48.509366112s) [noise=true , address=89.149.201.147:4013 , piece_id=ZDSSVS4VXF4HBWWASN2C7G2YFF2LDX3Q3SDBMUIFRFK3B2XXSBOQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156754609 (931h35m48.509539717s) [noise=true , address=81.171.14.70:4029 , piece_id=5PUSRNZMLVD52TK33GQ3OTWC3U5N3526V4JPJOTZU4N53J6IQMGQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156760662 (931h35m48.50954576s) [noise=true , address=81.171.14.70:4035 , piece_id=SLUDX3Y4VBI7NXJWDAK4MRFW5EJU5JRBSFCSHXRP75GOBCBQU5WQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157022393 (931h35m48.509807491s) [noise=true , address=81.171.14.70:4026 , piece_id=MVAEP4WRG5CQ4QAWOMB5JI7LFXQ2XXIQUWLKGD6FGYZO6OXNAWNA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157319349 (931h35m48.510104448s) [noise=true , address=185.167.204.205:4021 , piece_id=ZABC4XM4B3GI76CQ63FC3DPFJUNKD3SW3RRGWR6WHKSID2GLOKDA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157684756 (931h35m48.510469864s) [noise=true , address=89.149.201.147:4008 , piece_id=4VDQ3YJIO7WTIC3YV56ZAYYXE2BRTTWL2G2ZCVXSBBX57R2XCUYA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.158173573 (931h35m48.510958681s) [noise=true , address=185.167.204.205:4012 , piece_id=JCTVQTWNU5X7IB2JLL5E4ANPBIJOZFGHDIUAX6SL7ZLN6XYDUWGA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.158368348 (931h35m48.511153446s) [noise=true , address=185.167.204.206:4044 , piece_id=3ZDCAY4VYLT52AJORNLAFMYYI7WA6SEVUZQ4DR625DUSTWQ4J2VQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.159021985 (931h35m48.511807073s) [noise=true , address=81.171.14.70:4034 , piece_id=YADJOEALDIEY3LS5ZGQ5WP3YXWJDQ325HALNAHTQP43Q5ACABIBQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.607848645 (931h35m48.960633743s) [upload=819867]: Next returned nil segment
Oct 7 09:44:13.607861248 (931h35m48.960646356s) [upload=819867]: Waiting for error group managing segments...
Oct 7 09:44:13.778748780 (931h35m49.131533888s) [noise=true , address=81.171.14.70:4045 , piece_id=FSR77DDZPZUOWG664OGJIHMG4QMXDLYJDFZSIDEBM2JOYT7VOWZQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.781688647 (931h35m49.134473755s) [noise=true , address=81.171.14.70:4040 , piece_id=R2QKQJ7M7L26V3UMJKGHSXTCQODRGKDWT4GXCG5MEKD56YSI7KUQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.797470124 (931h35m49.150255232s) [noise=true , address=185.167.204.206:4068 , piece_id=HRQ7RG3QCA3YRUJTKTXCZ2QXGJQQJFKBZX5PHYF4AG3XWRSTEYQQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.798945413 (931h35m49.151730521s) [noise=true , address=185.167.204.206:4066 , piece_id=MC6WNACVRGQRCLF2OHLDTLLJCKUGA3XJPBN5T4QZUHC4RBR57NSA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.799672778 (931h35m49.152457886s) [noise=true , address=185.167.204.206:4044 , piece_id=3ZDCAY4VYLT52AJORNLAFMYYI7WA6SEVUZQ4DR625DUSTWQ4J2VQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.800694025 (931h35m49.153479133s) [noise=true , address=81.171.14.70:4043 , piece_id=GXEEOBGLYCQRH3R23NOQZ2XZLPY3PTHBWFF37UBQLL4QDVWFZRTA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.800815923 (931h35m49.153601031s) [noise=true , address=185.167.204.205:4021 , piece_id=ZABC4XM4B3GI76CQ63FC3DPFJUNKD3SW3RRGWR6WHKSID2GLOKDA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.803356381 (931h35m49.15614149s) [noise=true , address=185.167.204.206:4051 , piece_id=BNG3DAFHD4FOFXZMOZVPDLGBUX4HER2RX32POUNEX26DXU6GOTMA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.819254868 (931h35m49.172039976s) [noise=true , address=185.167.204.205:4012 , piece_id=JCTVQTWNU5X7IB2JLL5E4ANPBIJOZFGHDIUAX6SL7ZLN6XYDUWGA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.828359534 (931h35m49.181144643s) [noise=true , address=185.167.204.206:4063 , piece_id=ENFSIKRYEECUMNC76PCD442FCYYN4X4ZPKFXSPLEVNBBYA7QWS3Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.829841225 (931h35m49.182626323s) [noise=true , address=185.167.204.206:4041 , piece_id=KXQ5UIZXHDIWTOTTZR3G5EGRH7I55LWNH6OKR5HB6F3MOMBN4TDQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.830076737 (931h35m49.182861836s) [noise=true , address=89.149.201.147:4009 , piece_id=XUFZXG6VXQMI64FZFML6AX2VSZFEXDVDC2JDW7HDHSZ2C6UG55FA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.831280656 (931h35m49.184065754s) [noise=true , address=185.167.204.205:4029 , piece_id=GKGZUB2TTAIT67CCUMOOTPYMTMSGWD4RHW5GAXMIXQLXXQYPDY6Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.835538818 (931h35m49.188323926s) [noise=true , address=185.167.204.205:4009 , piece_id=F2OXD55LMZBZWP3OOD47VECF6QO74ND2LGMSLCBP6XMTBYLKKIDA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.839852703 (931h35m49.192637811s) [noise=true , address=185.167.204.206:4058 , piece_id=CWCQOHWD3LCWGDIE7FG26AB67NKYT442MPVIKICIHEAJ7RB5WDWA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.841847307 (931h35m49.194632406s) [noise=true , address=81.171.14.70:4035 , piece_id=SLUDX3Y4VBI7NXJWDAK4MRFW5EJU5JRBSFCSHXRP75GOBCBQU5WQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.849204934 (931h35m49.201990032s) [noise=true , address=89.149.201.147:4014 , piece_id=DWVUVNFYMZYWRIF4QU2UM5S4JBQWM2CBDNKVUOQOZDX4AY3KCF6Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.849297689 (931h35m49.202082787s) [noise=true , address=89.149.201.147:4010 , piece_id=PAKKECZ4EI45MTDWKQ6ACFVS3LQNCJJXO5NPRGAZ2ZUATYTX6ROQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.850790530 (931h35m49.203575629s) [noise=true , address=89.149.201.147:4011 , piece_id=23CV6F4FGTKWKAWDE7AUGQRWDFZGN37BIUQPJQXUH3HQWTURHUZQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.856762598 (931h35m49.209547696s) [noise=true , address=89.149.201.147:4008 , piece_id=4VDQ3YJIO7WTIC3YV56ZAYYXE2BRTTWL2G2ZCVXSBBX57R2XCUYA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.858751770 (931h35m49.211536869s) [noise=true , address=89.149.201.147:4013 , piece_id=ZDSSVS4VXF4HBWWASN2C7G2YFF2LDX3Q3SDBMUIFRFK3B2XXSBOQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.883309048 (931h35m49.236094146s) [noise=true , address=89.149.201.147:4002 , piece_id=BBRHLQDW22HSJE2P7LPE4Y67TOIQKFBQ4VQ5GKSF4KK5UDK3E23A, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.890627422 (931h35m49.24341253s) [noise=true , address=89.149.201.147:4012 , piece_id=VNITDM4Z3CWAGWHGOFMC3LP3E2GTVMFUT2FQL3I53HDK5ANYRNMA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:45:12.644603566 (931h36m47.997388694s) [noise=true , address=81.171.14.70:4033 , piece_id=FEOAQXS524JOQ76MV3AQPLIUCSGQUZBQOG4FJ43NKMFGOPWA6YQA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: write tcp 5.161.89.252:15820->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644683927 (931h36m47.997469065s) [noise=true , address=81.171.14.70:4029 , piece_id=5PUSRNZMLVD52TK33GQ3OTWC3U5N3526V4JPJOTZU4N53J6IQMGQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 5.161.89.252:42584->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644856971 (931h36m47.9976421s) [noise=true , address=81.171.14.70:4026 , piece_id=MVAEP4WRG5CQ4QAWOMB5JI7LFXQ2XXIQUWLKGD6FGYZO6OXNAWNA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: write tcp 5.161.89.252:25768->81.171.14.70:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644943003 (931h36m47.997728101s) [noise=true , address=81.171.14.70:4042 , piece_id=E2W7OQ3WJV5WBZVCR7UT3TPNGIZAQHKWVSVDFYXE3EYXPAKUOVRQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 5.161.89.252:48912->81.171.14.70:4042: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644981655 (931h36m47.997766803s) [noise=true , address=81.171.14.70:4034 , piece_id=YADJOEALDIEY3LS5ZGQ5WP3YXWJDQ325HALNAHTQP43Q5ACABIBQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: write tcp 5.161.89.252:57700->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.645044964 (931h36m47.997830102s) [seg_pos={0 0}, upload=819867]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil>
Oct 7 09:45:12.748884760 (931h36m48.101669889s) [upload=819867]: Done uploading segments...
Oct 7 09:45:12.748905800 (931h36m48.101690928s) [upload=819867]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23)
Duration: 2.682267445s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
260.428247ms
FAIL (2025-10-07 10:17:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 7 10:12:10.229965070 (932h3m45.582750178s) [upload=820275]: Starting upload Oct 7 10:12:10.230038448 (932h3m45.582823556s) [upload=820275]: Done starting upload Oct 7 10:12:10.230096046 (932h3m45.582881154s) [upload=820275]: Uploading segments... Oct 7 10:12:10.230132875 (932h3m45.582917983s) [upload=820275]: Got next segment. Inline: true Oct 7 10:12:10.230138986 (932h3m45.582924094s) [upload=820275]: Waiting for error group managing segments... Oct 7 10:12:10.230171558 (932h3m45.582956656s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Oct 7 10:12:10.230175415 (932h3m45.582960513s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Oct 7 10:12:10.230177529 (932h3m45.582962628s) [upload=820275]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Oct 7 10:13:10.202118923 (932h4m45.554904031s) [upload=820275]: Done uploading segments... Oct 7 10:13:10.202134061 (932h4m45.55491917s) [upload=820275]: Upload finished. err: metaclient: context deadline exceeded
Duration: 260.452383ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
1.613029176s
FAIL (2025-10-07 10:16:53 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 1.613053222s
core
uplink
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [..............XXX...........................................] duration:
2.273222141s
FAIL (2025-10-07 10:16:51 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 23)
======LOGS======
WFZRTA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156581014 (931h35m48.509366112s) [noise=true , address=89.149.201.147:4013 , piece_id=ZDSSVS4VXF4HBWWASN2C7G2YFF2LDX3Q3SDBMUIFRFK3B2XXSBOQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156754609 (931h35m48.509539717s) [noise=true , address=81.171.14.70:4029 , piece_id=5PUSRNZMLVD52TK33GQ3OTWC3U5N3526V4JPJOTZU4N53J6IQMGQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.156760662 (931h35m48.50954576s) [noise=true , address=81.171.14.70:4035 , piece_id=SLUDX3Y4VBI7NXJWDAK4MRFW5EJU5JRBSFCSHXRP75GOBCBQU5WQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157022393 (931h35m48.509807491s) [noise=true , address=81.171.14.70:4026 , piece_id=MVAEP4WRG5CQ4QAWOMB5JI7LFXQ2XXIQUWLKGD6FGYZO6OXNAWNA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157319349 (931h35m48.510104448s) [noise=true , address=185.167.204.205:4021 , piece_id=ZABC4XM4B3GI76CQ63FC3DPFJUNKD3SW3RRGWR6WHKSID2GLOKDA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.157684756 (931h35m48.510469864s) [noise=true , address=89.149.201.147:4008 , piece_id=4VDQ3YJIO7WTIC3YV56ZAYYXE2BRTTWL2G2ZCVXSBBX57R2XCUYA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.158173573 (931h35m48.510958681s) [noise=true , address=185.167.204.205:4012 , piece_id=JCTVQTWNU5X7IB2JLL5E4ANPBIJOZFGHDIUAX6SL7ZLN6XYDUWGA, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.158368348 (931h35m48.511153446s) [noise=true , address=185.167.204.206:4044 , piece_id=3ZDCAY4VYLT52AJORNLAFMYYI7WA6SEVUZQ4DR625DUSTWQ4J2VQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.159021985 (931h35m48.511807073s) [noise=true , address=81.171.14.70:4034 , piece_id=YADJOEALDIEY3LS5ZGQ5WP3YXWJDQ325HALNAHTQP43Q5ACABIBQ, seg_pos={0 0}, upload=819867]: Uploading piece...
Oct 7 09:44:13.607848645 (931h35m48.960633743s) [upload=819867]: Next returned nil segment
Oct 7 09:44:13.607861248 (931h35m48.960646356s) [upload=819867]: Waiting for error group managing segments...
Oct 7 09:44:13.778748780 (931h35m49.131533888s) [noise=true , address=81.171.14.70:4045 , piece_id=FSR77DDZPZUOWG664OGJIHMG4QMXDLYJDFZSIDEBM2JOYT7VOWZQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.781688647 (931h35m49.134473755s) [noise=true , address=81.171.14.70:4040 , piece_id=R2QKQJ7M7L26V3UMJKGHSXTCQODRGKDWT4GXCG5MEKD56YSI7KUQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.797470124 (931h35m49.150255232s) [noise=true , address=185.167.204.206:4068 , piece_id=HRQ7RG3QCA3YRUJTKTXCZ2QXGJQQJFKBZX5PHYF4AG3XWRSTEYQQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.798945413 (931h35m49.151730521s) [noise=true , address=185.167.204.206:4066 , piece_id=MC6WNACVRGQRCLF2OHLDTLLJCKUGA3XJPBN5T4QZUHC4RBR57NSA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.799672778 (931h35m49.152457886s) [noise=true , address=185.167.204.206:4044 , piece_id=3ZDCAY4VYLT52AJORNLAFMYYI7WA6SEVUZQ4DR625DUSTWQ4J2VQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.800694025 (931h35m49.153479133s) [noise=true , address=81.171.14.70:4043 , piece_id=GXEEOBGLYCQRH3R23NOQZ2XZLPY3PTHBWFF37UBQLL4QDVWFZRTA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.800815923 (931h35m49.153601031s) [noise=true , address=185.167.204.205:4021 , piece_id=ZABC4XM4B3GI76CQ63FC3DPFJUNKD3SW3RRGWR6WHKSID2GLOKDA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.803356381 (931h35m49.15614149s) [noise=true , address=185.167.204.206:4051 , piece_id=BNG3DAFHD4FOFXZMOZVPDLGBUX4HER2RX32POUNEX26DXU6GOTMA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.819254868 (931h35m49.172039976s) [noise=true , address=185.167.204.205:4012 , piece_id=JCTVQTWNU5X7IB2JLL5E4ANPBIJOZFGHDIUAX6SL7ZLN6XYDUWGA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.828359534 (931h35m49.181144643s) [noise=true , address=185.167.204.206:4063 , piece_id=ENFSIKRYEECUMNC76PCD442FCYYN4X4ZPKFXSPLEVNBBYA7QWS3Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.829841225 (931h35m49.182626323s) [noise=true , address=185.167.204.206:4041 , piece_id=KXQ5UIZXHDIWTOTTZR3G5EGRH7I55LWNH6OKR5HB6F3MOMBN4TDQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.830076737 (931h35m49.182861836s) [noise=true , address=89.149.201.147:4009 , piece_id=XUFZXG6VXQMI64FZFML6AX2VSZFEXDVDC2JDW7HDHSZ2C6UG55FA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.831280656 (931h35m49.184065754s) [noise=true , address=185.167.204.205:4029 , piece_id=GKGZUB2TTAIT67CCUMOOTPYMTMSGWD4RHW5GAXMIXQLXXQYPDY6Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.835538818 (931h35m49.188323926s) [noise=true , address=185.167.204.205:4009 , piece_id=F2OXD55LMZBZWP3OOD47VECF6QO74ND2LGMSLCBP6XMTBYLKKIDA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.839852703 (931h35m49.192637811s) [noise=true , address=185.167.204.206:4058 , piece_id=CWCQOHWD3LCWGDIE7FG26AB67NKYT442MPVIKICIHEAJ7RB5WDWA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.841847307 (931h35m49.194632406s) [noise=true , address=81.171.14.70:4035 , piece_id=SLUDX3Y4VBI7NXJWDAK4MRFW5EJU5JRBSFCSHXRP75GOBCBQU5WQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.849204934 (931h35m49.201990032s) [noise=true , address=89.149.201.147:4014 , piece_id=DWVUVNFYMZYWRIF4QU2UM5S4JBQWM2CBDNKVUOQOZDX4AY3KCF6Q, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.849297689 (931h35m49.202082787s) [noise=true , address=89.149.201.147:4010 , piece_id=PAKKECZ4EI45MTDWKQ6ACFVS3LQNCJJXO5NPRGAZ2ZUATYTX6ROQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.850790530 (931h35m49.203575629s) [noise=true , address=89.149.201.147:4011 , piece_id=23CV6F4FGTKWKAWDE7AUGQRWDFZGN37BIUQPJQXUH3HQWTURHUZQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.856762598 (931h35m49.209547696s) [noise=true , address=89.149.201.147:4008 , piece_id=4VDQ3YJIO7WTIC3YV56ZAYYXE2BRTTWL2G2ZCVXSBBX57R2XCUYA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.858751770 (931h35m49.211536869s) [noise=true , address=89.149.201.147:4013 , piece_id=ZDSSVS4VXF4HBWWASN2C7G2YFF2LDX3Q3SDBMUIFRFK3B2XXSBOQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.883309048 (931h35m49.236094146s) [noise=true , address=89.149.201.147:4002 , piece_id=BBRHLQDW22HSJE2P7LPE4Y67TOIQKFBQ4VQ5GKSF4KK5UDK3E23A, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:44:13.890627422 (931h35m49.24341253s) [noise=true , address=89.149.201.147:4012 , piece_id=VNITDM4Z3CWAGWHGOFMC3LP3E2GTVMFUT2FQL3I53HDK5ANYRNMA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: <nil>
Oct 7 09:45:12.644603566 (931h36m47.997388694s) [noise=true , address=81.171.14.70:4033 , piece_id=FEOAQXS524JOQ76MV3AQPLIUCSGQUZBQOG4FJ43NKMFGOPWA6YQA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: write tcp 5.161.89.252:15820->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644683927 (931h36m47.997469065s) [noise=true , address=81.171.14.70:4029 , piece_id=5PUSRNZMLVD52TK33GQ3OTWC3U5N3526V4JPJOTZU4N53J6IQMGQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 5.161.89.252:42584->81.171.14.70:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644856971 (931h36m47.9976421s) [noise=true , address=81.171.14.70:4026 , piece_id=MVAEP4WRG5CQ4QAWOMB5JI7LFXQ2XXIQUWLKGD6FGYZO6OXNAWNA, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12RTn3BuxasVSPYmjqgyhqKn1t6fAtq9EBtUufXqcLq48My9g2b, address:81.171.14.70:4026): protocol: write tcp 5.161.89.252:25768->81.171.14.70:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644943003 (931h36m47.997728101s) [noise=true , address=81.171.14.70:4042 , piece_id=E2W7OQ3WJV5WBZVCR7UT3TPNGIZAQHKWVSVDFYXE3EYXPAKUOVRQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: write tcp 5.161.89.252:48912->81.171.14.70:4042: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.644981655 (931h36m47.997766803s) [noise=true , address=81.171.14.70:4034 , piece_id=YADJOEALDIEY3LS5ZGQ5WP3YXWJDQ325HALNAHTQP43Q5ACABIBQ, seg_pos={0 0}, upload=819867]: Done uploading piece. err: ecclient: upload failed (node:12jcAHt22bETT27CCXJ8ZaaYxxoKBonBYsFcoq6A34DVVjvhQAN, address:81.171.14.70:4034): protocol: write tcp 5.161.89.252:57700->81.171.14.70:4034: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Oct 7 09:45:12.645044964 (931h36m47.997830102s) [seg_pos={0 0}, upload=819867]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil>
Oct 7 09:45:12.748884760 (931h36m48.101669889s) [upload=819867]: Done uploading segments...
Oct 7 09:45:12.748905800 (931h36m48.101690928s) [upload=819867]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23)
Duration: 2.273241247s
core
uplink
eu-select-1
eu1-placement-15
|