Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
1.709136817s trace:
https://jaeger.dev.storj.io/trace/576e3c37403ea2f0
FAIL (2025-12-10 06:03:59 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 53)
Duration: 1.709155491s
core
uplink
us1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
4.415788354s trace:
https://jaeger.dev.storj.io/trace/90b6829c07b062b
FAIL (2025-12-10 06:03:44 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 50)
Duration: 4.415801068s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
2.686926842s trace:
https://jaeger.dev.storj.io/trace/78954e68dc28a6f0
FAIL (2025-12-10 06:03:18 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
32FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483286769 (110h6m40.180855105s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483441889 (110h6m40.181010225s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484188893 (110h6m40.18175724s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484360284 (110h6m40.18192862s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484899961 (110h6m40.182468308s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485473173 (110h6m40.183041519s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485588187 (110h6m40.183156534s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486286061 (110h6m40.183854397s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486614144 (110h6m40.18418248s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486972244 (110h6m40.184540579s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.487764232 (110h6m40.185332569s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.488611475 (110h6m40.186179862s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:56.532754683 (110h6m44.230323019s) [upload=96631]: Next returned nil segment
Dec 10 05:35:56.532767777 (110h6m44.230336114s) [upload=96631]: Waiting for error group managing segments...
Dec 10 05:36:03.072814336 (110h6m50.770382652s) [noise=true , address=81.171.14.70:4033 , piece_id=A7M7632FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:10.426278146 (110h6m58.123846453s) [noise=true , address=185.167.204.205:4003 , piece_id=C6QVIOWAWPAFTTEGTU67E5S2G3F2YNEMN7ZOYJHO7V5DZTJNHBHA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:13.352409435 (110h7m1.049977751s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:15.264994828 (110h7m2.962563144s) [noise=true , address=89.149.201.147:4014 , piece_id=FUWY5JUHVSRU2T7F6FRLNXPHHG7BDCNRXDCYAO26VEURJLYVAURQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:17.549961624 (110h7m5.24752993s) [noise=true , address=81.171.14.70:4031 , piece_id=3OKFG434PBYJ3SPU6KMJ42JH2ASMSDYLC3SCHPVYLJMH5ONMRBJQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:19.306486817 (110h7m7.004055133s) [noise=true , address=185.167.204.205:4027 , piece_id=6NJYN7KJKTEVYCSNQA6HQGU33NCRYDQ46FJFSG6BIQU4LZLEJNJA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.162049031 (110h7m10.859617337s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.737363060 (110h7m11.434931366s) [noise=true , address=185.167.204.205:4032 , piece_id=ZSZ2K73DHDZYFLWQRMDRBE7HVHDEXWA7K4EUNPGIVXFAHCVUKTLA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.786449800 (110h7m11.484018106s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.060159042 (110h7m11.757727358s) [noise=true , address=185.167.204.206:4038 , piece_id=CBND4CAULWE26NIGWFT7DSTQ4WJ4UOGPGPTY2O3TC53QLH3E7RPQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.094361490 (110h7m11.791929795s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.798040935 (110h7m12.495609251s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.378916283 (110h7m13.076484589s) [noise=true , address=89.149.201.147:4021 , piece_id=BEYZFIFW3J5SRMA3TGXM2TL6E6G7NP4Y4ZY7ZG4B7HBZMRW524IA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.827775932 (110h7m13.525344269s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.877397152 (110h7m13.574965468s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.944028435 (110h7m13.641596771s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:26.560902894 (110h7m14.2584712s) [noise=true , address=89.149.201.147:4016 , piece_id=AG43SI5LEABCPKL7BAK2K7OJ4TVXYUIPUS7TVYC5NUQNUQQB5NOA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.812203200 (110h7m15.509771516s) [noise=true , address=89.149.201.147:4023 , piece_id=BI6SXMTHJ5KYB3556G4U6UYG5HRNK5EH64LNT42V3AFNARG5O7LA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.867169354 (110h7m15.56473767s) [noise=true , address=89.149.201.147:4006 , piece_id=UEKDVE6NDKI4NV7HD4AKUH4HNYVRF3C7SPIN26KDK5NX6J4NBQ5Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:29.445827111 (110h7m17.143395446s) [noise=true , address=185.167.204.205:4008 , piece_id=PZIHSKHE4CALB2V3LHWAX5X6BMMQMSMFWM47MIGVH64G2ZLPMRTQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:32.512177560 (110h7m20.209745866s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:35.825912333 (110h7m23.523480649s) [noise=true , address=81.171.14.70:4027 , piece_id=X46BF2SMXFGBFRWBG3TN45CSU2V66GVOXQAHTR42H2QVOTRA36OA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.223889733 (110h7m28.92145804s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.243892176 (110h7m28.941460483s) [noise=true , address=185.167.204.205:4031 , piece_id=EQZNQZ4BMWYSUX5IKBL2MMX5DPQN5XI4QUIKFR6LWIZI6FLFGJLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:43.488315198 (110h7m31.185883505s) [noise=true , address=81.171.14.70:4040 , piece_id=WGBE4UIBTC7XEAT2QNJIZBTLSEGQH5HT6KSEC3ML6Y5Z7OI4YMVA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:51.974826346 (110h7m39.672394662s) [noise=true , address=89.149.201.147:4017 , piece_id=ESM6BDBHOTQQUZECBEYOFXEZNMPXIGZZYUS7Y6EXFWBZ4WVFTFUA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974841284 (110h7m39.672409589s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection
Dec 10 05:36:51.974903630 (110h7m39.672471946s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974922165 (110h7m39.672490481s) [seg_pos={0 0}, upload=96631]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Dec 10 05:36:52.071976396 (110h7m39.769544712s) [upload=96631]: Done uploading segments...
Dec 10 05:36:52.072005610 (110h7m39.769573927s) [upload=96631]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.686943483s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
1.78040954s trace:
https://jaeger.dev.storj.io/trace/576e3c37403ea2f0
FAIL (2025-12-10 06:03:07 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 53)
Duration: 1.780431902s
core
uplink
us1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
4.381043793s trace:
https://jaeger.dev.storj.io/trace/90b6829c07b062b
FAIL (2025-12-10 06:02:49 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 50)
Duration: 4.381064682s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
1.78747529s trace:
https://jaeger.dev.storj.io/trace/576e3c37403ea2f0
FAIL (2025-12-10 06:02:30 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 53)
Duration: 1.787496559s
core
uplink
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
2.645145707s trace:
https://jaeger.dev.storj.io/trace/78954e68dc28a6f0
FAIL (2025-12-10 06:02:17 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
32FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483286769 (110h6m40.180855105s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483441889 (110h6m40.181010225s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484188893 (110h6m40.18175724s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484360284 (110h6m40.18192862s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484899961 (110h6m40.182468308s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485473173 (110h6m40.183041519s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485588187 (110h6m40.183156534s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486286061 (110h6m40.183854397s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486614144 (110h6m40.18418248s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486972244 (110h6m40.184540579s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.487764232 (110h6m40.185332569s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.488611475 (110h6m40.186179862s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:56.532754683 (110h6m44.230323019s) [upload=96631]: Next returned nil segment
Dec 10 05:35:56.532767777 (110h6m44.230336114s) [upload=96631]: Waiting for error group managing segments...
Dec 10 05:36:03.072814336 (110h6m50.770382652s) [noise=true , address=81.171.14.70:4033 , piece_id=A7M7632FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:10.426278146 (110h6m58.123846453s) [noise=true , address=185.167.204.205:4003 , piece_id=C6QVIOWAWPAFTTEGTU67E5S2G3F2YNEMN7ZOYJHO7V5DZTJNHBHA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:13.352409435 (110h7m1.049977751s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:15.264994828 (110h7m2.962563144s) [noise=true , address=89.149.201.147:4014 , piece_id=FUWY5JUHVSRU2T7F6FRLNXPHHG7BDCNRXDCYAO26VEURJLYVAURQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:17.549961624 (110h7m5.24752993s) [noise=true , address=81.171.14.70:4031 , piece_id=3OKFG434PBYJ3SPU6KMJ42JH2ASMSDYLC3SCHPVYLJMH5ONMRBJQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:19.306486817 (110h7m7.004055133s) [noise=true , address=185.167.204.205:4027 , piece_id=6NJYN7KJKTEVYCSNQA6HQGU33NCRYDQ46FJFSG6BIQU4LZLEJNJA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.162049031 (110h7m10.859617337s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.737363060 (110h7m11.434931366s) [noise=true , address=185.167.204.205:4032 , piece_id=ZSZ2K73DHDZYFLWQRMDRBE7HVHDEXWA7K4EUNPGIVXFAHCVUKTLA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.786449800 (110h7m11.484018106s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.060159042 (110h7m11.757727358s) [noise=true , address=185.167.204.206:4038 , piece_id=CBND4CAULWE26NIGWFT7DSTQ4WJ4UOGPGPTY2O3TC53QLH3E7RPQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.094361490 (110h7m11.791929795s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.798040935 (110h7m12.495609251s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.378916283 (110h7m13.076484589s) [noise=true , address=89.149.201.147:4021 , piece_id=BEYZFIFW3J5SRMA3TGXM2TL6E6G7NP4Y4ZY7ZG4B7HBZMRW524IA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.827775932 (110h7m13.525344269s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.877397152 (110h7m13.574965468s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.944028435 (110h7m13.641596771s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:26.560902894 (110h7m14.2584712s) [noise=true , address=89.149.201.147:4016 , piece_id=AG43SI5LEABCPKL7BAK2K7OJ4TVXYUIPUS7TVYC5NUQNUQQB5NOA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.812203200 (110h7m15.509771516s) [noise=true , address=89.149.201.147:4023 , piece_id=BI6SXMTHJ5KYB3556G4U6UYG5HRNK5EH64LNT42V3AFNARG5O7LA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.867169354 (110h7m15.56473767s) [noise=true , address=89.149.201.147:4006 , piece_id=UEKDVE6NDKI4NV7HD4AKUH4HNYVRF3C7SPIN26KDK5NX6J4NBQ5Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:29.445827111 (110h7m17.143395446s) [noise=true , address=185.167.204.205:4008 , piece_id=PZIHSKHE4CALB2V3LHWAX5X6BMMQMSMFWM47MIGVH64G2ZLPMRTQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:32.512177560 (110h7m20.209745866s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:35.825912333 (110h7m23.523480649s) [noise=true , address=81.171.14.70:4027 , piece_id=X46BF2SMXFGBFRWBG3TN45CSU2V66GVOXQAHTR42H2QVOTRA36OA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.223889733 (110h7m28.92145804s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.243892176 (110h7m28.941460483s) [noise=true , address=185.167.204.205:4031 , piece_id=EQZNQZ4BMWYSUX5IKBL2MMX5DPQN5XI4QUIKFR6LWIZI6FLFGJLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:43.488315198 (110h7m31.185883505s) [noise=true , address=81.171.14.70:4040 , piece_id=WGBE4UIBTC7XEAT2QNJIZBTLSEGQH5HT6KSEC3ML6Y5Z7OI4YMVA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:51.974826346 (110h7m39.672394662s) [noise=true , address=89.149.201.147:4017 , piece_id=ESM6BDBHOTQQUZECBEYOFXEZNMPXIGZZYUS7Y6EXFWBZ4WVFTFUA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974841284 (110h7m39.672409589s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection
Dec 10 05:36:51.974903630 (110h7m39.672471946s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974922165 (110h7m39.672490481s) [seg_pos={0 0}, upload=96631]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Dec 10 05:36:52.071976396 (110h7m39.769544712s) [upload=96631]: Done uploading segments...
Dec 10 05:36:52.072005610 (110h7m39.769573927s) [upload=96631]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.645166517s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
2.65085914s trace:
https://jaeger.dev.storj.io/trace/78954e68dc28a6f0
FAIL (2025-12-10 06:01:54 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
32FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483286769 (110h6m40.180855105s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483441889 (110h6m40.181010225s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484188893 (110h6m40.18175724s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484360284 (110h6m40.18192862s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484899961 (110h6m40.182468308s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485473173 (110h6m40.183041519s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485588187 (110h6m40.183156534s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486286061 (110h6m40.183854397s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486614144 (110h6m40.18418248s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486972244 (110h6m40.184540579s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.487764232 (110h6m40.185332569s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.488611475 (110h6m40.186179862s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:56.532754683 (110h6m44.230323019s) [upload=96631]: Next returned nil segment
Dec 10 05:35:56.532767777 (110h6m44.230336114s) [upload=96631]: Waiting for error group managing segments...
Dec 10 05:36:03.072814336 (110h6m50.770382652s) [noise=true , address=81.171.14.70:4033 , piece_id=A7M7632FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:10.426278146 (110h6m58.123846453s) [noise=true , address=185.167.204.205:4003 , piece_id=C6QVIOWAWPAFTTEGTU67E5S2G3F2YNEMN7ZOYJHO7V5DZTJNHBHA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:13.352409435 (110h7m1.049977751s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:15.264994828 (110h7m2.962563144s) [noise=true , address=89.149.201.147:4014 , piece_id=FUWY5JUHVSRU2T7F6FRLNXPHHG7BDCNRXDCYAO26VEURJLYVAURQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:17.549961624 (110h7m5.24752993s) [noise=true , address=81.171.14.70:4031 , piece_id=3OKFG434PBYJ3SPU6KMJ42JH2ASMSDYLC3SCHPVYLJMH5ONMRBJQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:19.306486817 (110h7m7.004055133s) [noise=true , address=185.167.204.205:4027 , piece_id=6NJYN7KJKTEVYCSNQA6HQGU33NCRYDQ46FJFSG6BIQU4LZLEJNJA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.162049031 (110h7m10.859617337s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.737363060 (110h7m11.434931366s) [noise=true , address=185.167.204.205:4032 , piece_id=ZSZ2K73DHDZYFLWQRMDRBE7HVHDEXWA7K4EUNPGIVXFAHCVUKTLA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.786449800 (110h7m11.484018106s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.060159042 (110h7m11.757727358s) [noise=true , address=185.167.204.206:4038 , piece_id=CBND4CAULWE26NIGWFT7DSTQ4WJ4UOGPGPTY2O3TC53QLH3E7RPQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.094361490 (110h7m11.791929795s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.798040935 (110h7m12.495609251s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.378916283 (110h7m13.076484589s) [noise=true , address=89.149.201.147:4021 , piece_id=BEYZFIFW3J5SRMA3TGXM2TL6E6G7NP4Y4ZY7ZG4B7HBZMRW524IA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.827775932 (110h7m13.525344269s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.877397152 (110h7m13.574965468s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.944028435 (110h7m13.641596771s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:26.560902894 (110h7m14.2584712s) [noise=true , address=89.149.201.147:4016 , piece_id=AG43SI5LEABCPKL7BAK2K7OJ4TVXYUIPUS7TVYC5NUQNUQQB5NOA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.812203200 (110h7m15.509771516s) [noise=true , address=89.149.201.147:4023 , piece_id=BI6SXMTHJ5KYB3556G4U6UYG5HRNK5EH64LNT42V3AFNARG5O7LA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.867169354 (110h7m15.56473767s) [noise=true , address=89.149.201.147:4006 , piece_id=UEKDVE6NDKI4NV7HD4AKUH4HNYVRF3C7SPIN26KDK5NX6J4NBQ5Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:29.445827111 (110h7m17.143395446s) [noise=true , address=185.167.204.205:4008 , piece_id=PZIHSKHE4CALB2V3LHWAX5X6BMMQMSMFWM47MIGVH64G2ZLPMRTQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:32.512177560 (110h7m20.209745866s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:35.825912333 (110h7m23.523480649s) [noise=true , address=81.171.14.70:4027 , piece_id=X46BF2SMXFGBFRWBG3TN45CSU2V66GVOXQAHTR42H2QVOTRA36OA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.223889733 (110h7m28.92145804s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.243892176 (110h7m28.941460483s) [noise=true , address=185.167.204.205:4031 , piece_id=EQZNQZ4BMWYSUX5IKBL2MMX5DPQN5XI4QUIKFR6LWIZI6FLFGJLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:43.488315198 (110h7m31.185883505s) [noise=true , address=81.171.14.70:4040 , piece_id=WGBE4UIBTC7XEAT2QNJIZBTLSEGQH5HT6KSEC3ML6Y5Z7OI4YMVA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:51.974826346 (110h7m39.672394662s) [noise=true , address=89.149.201.147:4017 , piece_id=ESM6BDBHOTQQUZECBEYOFXEZNMPXIGZZYUS7Y6EXFWBZ4WVFTFUA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974841284 (110h7m39.672409589s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection
Dec 10 05:36:51.974903630 (110h7m39.672471946s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974922165 (110h7m39.672490481s) [seg_pos={0 0}, upload=96631]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Dec 10 05:36:52.071976396 (110h7m39.769544712s) [upload=96631]: Done uploading segments...
Dec 10 05:36:52.072005610 (110h7m39.769573927s) [upload=96631]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.65088034s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
4.58903628s trace:
https://jaeger.dev.storj.io/trace/90b6829c07b062b
FAIL (2025-12-10 06:01:36 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 50)
Duration: 4.589060415s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
1.976683058s trace:
https://jaeger.dev.storj.io/trace/576e3c37403ea2f0
FAIL (2025-12-10 06:01:16 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 53)
Duration: 1.976695852s
core
uplink
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
2.632340816s trace:
https://jaeger.dev.storj.io/trace/78954e68dc28a6f0
FAIL (2025-12-10 06:00:57 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
32FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483286769 (110h6m40.180855105s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483441889 (110h6m40.181010225s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484188893 (110h6m40.18175724s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484360284 (110h6m40.18192862s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484899961 (110h6m40.182468308s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485473173 (110h6m40.183041519s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485588187 (110h6m40.183156534s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486286061 (110h6m40.183854397s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486614144 (110h6m40.18418248s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486972244 (110h6m40.184540579s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.487764232 (110h6m40.185332569s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.488611475 (110h6m40.186179862s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:56.532754683 (110h6m44.230323019s) [upload=96631]: Next returned nil segment
Dec 10 05:35:56.532767777 (110h6m44.230336114s) [upload=96631]: Waiting for error group managing segments...
Dec 10 05:36:03.072814336 (110h6m50.770382652s) [noise=true , address=81.171.14.70:4033 , piece_id=A7M7632FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:10.426278146 (110h6m58.123846453s) [noise=true , address=185.167.204.205:4003 , piece_id=C6QVIOWAWPAFTTEGTU67E5S2G3F2YNEMN7ZOYJHO7V5DZTJNHBHA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:13.352409435 (110h7m1.049977751s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:15.264994828 (110h7m2.962563144s) [noise=true , address=89.149.201.147:4014 , piece_id=FUWY5JUHVSRU2T7F6FRLNXPHHG7BDCNRXDCYAO26VEURJLYVAURQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:17.549961624 (110h7m5.24752993s) [noise=true , address=81.171.14.70:4031 , piece_id=3OKFG434PBYJ3SPU6KMJ42JH2ASMSDYLC3SCHPVYLJMH5ONMRBJQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:19.306486817 (110h7m7.004055133s) [noise=true , address=185.167.204.205:4027 , piece_id=6NJYN7KJKTEVYCSNQA6HQGU33NCRYDQ46FJFSG6BIQU4LZLEJNJA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.162049031 (110h7m10.859617337s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.737363060 (110h7m11.434931366s) [noise=true , address=185.167.204.205:4032 , piece_id=ZSZ2K73DHDZYFLWQRMDRBE7HVHDEXWA7K4EUNPGIVXFAHCVUKTLA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.786449800 (110h7m11.484018106s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.060159042 (110h7m11.757727358s) [noise=true , address=185.167.204.206:4038 , piece_id=CBND4CAULWE26NIGWFT7DSTQ4WJ4UOGPGPTY2O3TC53QLH3E7RPQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.094361490 (110h7m11.791929795s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.798040935 (110h7m12.495609251s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.378916283 (110h7m13.076484589s) [noise=true , address=89.149.201.147:4021 , piece_id=BEYZFIFW3J5SRMA3TGXM2TL6E6G7NP4Y4ZY7ZG4B7HBZMRW524IA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.827775932 (110h7m13.525344269s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.877397152 (110h7m13.574965468s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.944028435 (110h7m13.641596771s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:26.560902894 (110h7m14.2584712s) [noise=true , address=89.149.201.147:4016 , piece_id=AG43SI5LEABCPKL7BAK2K7OJ4TVXYUIPUS7TVYC5NUQNUQQB5NOA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.812203200 (110h7m15.509771516s) [noise=true , address=89.149.201.147:4023 , piece_id=BI6SXMTHJ5KYB3556G4U6UYG5HRNK5EH64LNT42V3AFNARG5O7LA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.867169354 (110h7m15.56473767s) [noise=true , address=89.149.201.147:4006 , piece_id=UEKDVE6NDKI4NV7HD4AKUH4HNYVRF3C7SPIN26KDK5NX6J4NBQ5Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:29.445827111 (110h7m17.143395446s) [noise=true , address=185.167.204.205:4008 , piece_id=PZIHSKHE4CALB2V3LHWAX5X6BMMQMSMFWM47MIGVH64G2ZLPMRTQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:32.512177560 (110h7m20.209745866s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:35.825912333 (110h7m23.523480649s) [noise=true , address=81.171.14.70:4027 , piece_id=X46BF2SMXFGBFRWBG3TN45CSU2V66GVOXQAHTR42H2QVOTRA36OA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.223889733 (110h7m28.92145804s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.243892176 (110h7m28.941460483s) [noise=true , address=185.167.204.205:4031 , piece_id=EQZNQZ4BMWYSUX5IKBL2MMX5DPQN5XI4QUIKFR6LWIZI6FLFGJLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:43.488315198 (110h7m31.185883505s) [noise=true , address=81.171.14.70:4040 , piece_id=WGBE4UIBTC7XEAT2QNJIZBTLSEGQH5HT6KSEC3ML6Y5Z7OI4YMVA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:51.974826346 (110h7m39.672394662s) [noise=true , address=89.149.201.147:4017 , piece_id=ESM6BDBHOTQQUZECBEYOFXEZNMPXIGZZYUS7Y6EXFWBZ4WVFTFUA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974841284 (110h7m39.672409589s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection
Dec 10 05:36:51.974903630 (110h7m39.672471946s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974922165 (110h7m39.672490481s) [seg_pos={0 0}, upload=96631]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Dec 10 05:36:52.071976396 (110h7m39.769544712s) [upload=96631]: Done uploading segments...
Dec 10 05:36:52.072005610 (110h7m39.769573927s) [upload=96631]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.632364431s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
1.828022498s trace:
https://jaeger.dev.storj.io/trace/576e3c37403ea2f0
FAIL (2025-12-10 06:00:48 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 53)
Duration: 1.828041914s
core
uplink
us1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
5.621350864s trace:
https://jaeger.dev.storj.io/trace/90b6829c07b062b
FAIL (2025-12-10 06:00:30 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 50)
Duration: 5.621377974s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
1.737065365s trace:
https://jaeger.dev.storj.io/trace/576e3c37403ea2f0
FAIL (2025-12-10 06:00:25 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 53)
Duration: 1.737087105s
core
uplink
us1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
7.400993891s trace:
https://jaeger.dev.storj.io/trace/90b6829c07b062b
FAIL (2025-12-10 06:00:09 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 50)
Duration: 7.401016133s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
2.510098227s trace:
https://jaeger.dev.storj.io/trace/78954e68dc28a6f0
FAIL (2025-12-10 06:00:06 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
32FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483286769 (110h6m40.180855105s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483441889 (110h6m40.181010225s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484188893 (110h6m40.18175724s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484360284 (110h6m40.18192862s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484899961 (110h6m40.182468308s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485473173 (110h6m40.183041519s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485588187 (110h6m40.183156534s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486286061 (110h6m40.183854397s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486614144 (110h6m40.18418248s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486972244 (110h6m40.184540579s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.487764232 (110h6m40.185332569s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.488611475 (110h6m40.186179862s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:56.532754683 (110h6m44.230323019s) [upload=96631]: Next returned nil segment
Dec 10 05:35:56.532767777 (110h6m44.230336114s) [upload=96631]: Waiting for error group managing segments...
Dec 10 05:36:03.072814336 (110h6m50.770382652s) [noise=true , address=81.171.14.70:4033 , piece_id=A7M7632FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:10.426278146 (110h6m58.123846453s) [noise=true , address=185.167.204.205:4003 , piece_id=C6QVIOWAWPAFTTEGTU67E5S2G3F2YNEMN7ZOYJHO7V5DZTJNHBHA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:13.352409435 (110h7m1.049977751s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:15.264994828 (110h7m2.962563144s) [noise=true , address=89.149.201.147:4014 , piece_id=FUWY5JUHVSRU2T7F6FRLNXPHHG7BDCNRXDCYAO26VEURJLYVAURQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:17.549961624 (110h7m5.24752993s) [noise=true , address=81.171.14.70:4031 , piece_id=3OKFG434PBYJ3SPU6KMJ42JH2ASMSDYLC3SCHPVYLJMH5ONMRBJQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:19.306486817 (110h7m7.004055133s) [noise=true , address=185.167.204.205:4027 , piece_id=6NJYN7KJKTEVYCSNQA6HQGU33NCRYDQ46FJFSG6BIQU4LZLEJNJA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.162049031 (110h7m10.859617337s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.737363060 (110h7m11.434931366s) [noise=true , address=185.167.204.205:4032 , piece_id=ZSZ2K73DHDZYFLWQRMDRBE7HVHDEXWA7K4EUNPGIVXFAHCVUKTLA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.786449800 (110h7m11.484018106s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.060159042 (110h7m11.757727358s) [noise=true , address=185.167.204.206:4038 , piece_id=CBND4CAULWE26NIGWFT7DSTQ4WJ4UOGPGPTY2O3TC53QLH3E7RPQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.094361490 (110h7m11.791929795s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.798040935 (110h7m12.495609251s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.378916283 (110h7m13.076484589s) [noise=true , address=89.149.201.147:4021 , piece_id=BEYZFIFW3J5SRMA3TGXM2TL6E6G7NP4Y4ZY7ZG4B7HBZMRW524IA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.827775932 (110h7m13.525344269s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.877397152 (110h7m13.574965468s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.944028435 (110h7m13.641596771s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:26.560902894 (110h7m14.2584712s) [noise=true , address=89.149.201.147:4016 , piece_id=AG43SI5LEABCPKL7BAK2K7OJ4TVXYUIPUS7TVYC5NUQNUQQB5NOA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.812203200 (110h7m15.509771516s) [noise=true , address=89.149.201.147:4023 , piece_id=BI6SXMTHJ5KYB3556G4U6UYG5HRNK5EH64LNT42V3AFNARG5O7LA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.867169354 (110h7m15.56473767s) [noise=true , address=89.149.201.147:4006 , piece_id=UEKDVE6NDKI4NV7HD4AKUH4HNYVRF3C7SPIN26KDK5NX6J4NBQ5Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:29.445827111 (110h7m17.143395446s) [noise=true , address=185.167.204.205:4008 , piece_id=PZIHSKHE4CALB2V3LHWAX5X6BMMQMSMFWM47MIGVH64G2ZLPMRTQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:32.512177560 (110h7m20.209745866s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:35.825912333 (110h7m23.523480649s) [noise=true , address=81.171.14.70:4027 , piece_id=X46BF2SMXFGBFRWBG3TN45CSU2V66GVOXQAHTR42H2QVOTRA36OA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.223889733 (110h7m28.92145804s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.243892176 (110h7m28.941460483s) [noise=true , address=185.167.204.205:4031 , piece_id=EQZNQZ4BMWYSUX5IKBL2MMX5DPQN5XI4QUIKFR6LWIZI6FLFGJLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:43.488315198 (110h7m31.185883505s) [noise=true , address=81.171.14.70:4040 , piece_id=WGBE4UIBTC7XEAT2QNJIZBTLSEGQH5HT6KSEC3ML6Y5Z7OI4YMVA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:51.974826346 (110h7m39.672394662s) [noise=true , address=89.149.201.147:4017 , piece_id=ESM6BDBHOTQQUZECBEYOFXEZNMPXIGZZYUS7Y6EXFWBZ4WVFTFUA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974841284 (110h7m39.672409589s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection
Dec 10 05:36:51.974903630 (110h7m39.672471946s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974922165 (110h7m39.672490481s) [seg_pos={0 0}, upload=96631]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Dec 10 05:36:52.071976396 (110h7m39.769544712s) [upload=96631]: Done uploading segments...
Dec 10 05:36:52.072005610 (110h7m39.769573927s) [upload=96631]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.510118534s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
1.586403198s trace:
https://jaeger.dev.storj.io/trace/576e3c37403ea2f0
FAIL (2025-12-10 05:59:45 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 53)
Duration: 1.586428897s
core
uplink
us1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
4.49133476s trace:
https://jaeger.dev.storj.io/trace/90b6829c07b062b
FAIL (2025-12-10 05:59:38 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 50)
Duration: 4.491358685s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
2.142102453s trace:
https://jaeger.dev.storj.io/trace/78954e68dc28a6f0
FAIL (2025-12-10 05:58:53 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
32FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483286769 (110h6m40.180855105s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483441889 (110h6m40.181010225s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484188893 (110h6m40.18175724s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484360284 (110h6m40.18192862s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484899961 (110h6m40.182468308s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485473173 (110h6m40.183041519s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485588187 (110h6m40.183156534s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486286061 (110h6m40.183854397s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486614144 (110h6m40.18418248s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486972244 (110h6m40.184540579s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.487764232 (110h6m40.185332569s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.488611475 (110h6m40.186179862s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:56.532754683 (110h6m44.230323019s) [upload=96631]: Next returned nil segment
Dec 10 05:35:56.532767777 (110h6m44.230336114s) [upload=96631]: Waiting for error group managing segments...
Dec 10 05:36:03.072814336 (110h6m50.770382652s) [noise=true , address=81.171.14.70:4033 , piece_id=A7M7632FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:10.426278146 (110h6m58.123846453s) [noise=true , address=185.167.204.205:4003 , piece_id=C6QVIOWAWPAFTTEGTU67E5S2G3F2YNEMN7ZOYJHO7V5DZTJNHBHA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:13.352409435 (110h7m1.049977751s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:15.264994828 (110h7m2.962563144s) [noise=true , address=89.149.201.147:4014 , piece_id=FUWY5JUHVSRU2T7F6FRLNXPHHG7BDCNRXDCYAO26VEURJLYVAURQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:17.549961624 (110h7m5.24752993s) [noise=true , address=81.171.14.70:4031 , piece_id=3OKFG434PBYJ3SPU6KMJ42JH2ASMSDYLC3SCHPVYLJMH5ONMRBJQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:19.306486817 (110h7m7.004055133s) [noise=true , address=185.167.204.205:4027 , piece_id=6NJYN7KJKTEVYCSNQA6HQGU33NCRYDQ46FJFSG6BIQU4LZLEJNJA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.162049031 (110h7m10.859617337s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.737363060 (110h7m11.434931366s) [noise=true , address=185.167.204.205:4032 , piece_id=ZSZ2K73DHDZYFLWQRMDRBE7HVHDEXWA7K4EUNPGIVXFAHCVUKTLA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.786449800 (110h7m11.484018106s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.060159042 (110h7m11.757727358s) [noise=true , address=185.167.204.206:4038 , piece_id=CBND4CAULWE26NIGWFT7DSTQ4WJ4UOGPGPTY2O3TC53QLH3E7RPQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.094361490 (110h7m11.791929795s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.798040935 (110h7m12.495609251s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.378916283 (110h7m13.076484589s) [noise=true , address=89.149.201.147:4021 , piece_id=BEYZFIFW3J5SRMA3TGXM2TL6E6G7NP4Y4ZY7ZG4B7HBZMRW524IA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.827775932 (110h7m13.525344269s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.877397152 (110h7m13.574965468s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.944028435 (110h7m13.641596771s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:26.560902894 (110h7m14.2584712s) [noise=true , address=89.149.201.147:4016 , piece_id=AG43SI5LEABCPKL7BAK2K7OJ4TVXYUIPUS7TVYC5NUQNUQQB5NOA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.812203200 (110h7m15.509771516s) [noise=true , address=89.149.201.147:4023 , piece_id=BI6SXMTHJ5KYB3556G4U6UYG5HRNK5EH64LNT42V3AFNARG5O7LA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.867169354 (110h7m15.56473767s) [noise=true , address=89.149.201.147:4006 , piece_id=UEKDVE6NDKI4NV7HD4AKUH4HNYVRF3C7SPIN26KDK5NX6J4NBQ5Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:29.445827111 (110h7m17.143395446s) [noise=true , address=185.167.204.205:4008 , piece_id=PZIHSKHE4CALB2V3LHWAX5X6BMMQMSMFWM47MIGVH64G2ZLPMRTQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:32.512177560 (110h7m20.209745866s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:35.825912333 (110h7m23.523480649s) [noise=true , address=81.171.14.70:4027 , piece_id=X46BF2SMXFGBFRWBG3TN45CSU2V66GVOXQAHTR42H2QVOTRA36OA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.223889733 (110h7m28.92145804s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.243892176 (110h7m28.941460483s) [noise=true , address=185.167.204.205:4031 , piece_id=EQZNQZ4BMWYSUX5IKBL2MMX5DPQN5XI4QUIKFR6LWIZI6FLFGJLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:43.488315198 (110h7m31.185883505s) [noise=true , address=81.171.14.70:4040 , piece_id=WGBE4UIBTC7XEAT2QNJIZBTLSEGQH5HT6KSEC3ML6Y5Z7OI4YMVA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:51.974826346 (110h7m39.672394662s) [noise=true , address=89.149.201.147:4017 , piece_id=ESM6BDBHOTQQUZECBEYOFXEZNMPXIGZZYUS7Y6EXFWBZ4WVFTFUA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974841284 (110h7m39.672409589s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection
Dec 10 05:36:51.974903630 (110h7m39.672471946s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974922165 (110h7m39.672490481s) [seg_pos={0 0}, upload=96631]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Dec 10 05:36:52.071976396 (110h7m39.769544712s) [upload=96631]: Done uploading segments...
Dec 10 05:36:52.072005610 (110h7m39.769573927s) [upload=96631]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.142123471s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
4.702982177s trace:
https://jaeger.dev.storj.io/trace/90b6829c07b062b
FAIL (2025-12-10 05:58:50 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 50)
Duration: 4.703001793s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
1.74327185s trace:
https://jaeger.dev.storj.io/trace/576e3c37403ea2f0
FAIL (2025-12-10 05:58:44 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 53)
Duration: 1.743291537s
core
uplink
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
2.640128224s trace:
https://jaeger.dev.storj.io/trace/78954e68dc28a6f0
FAIL (2025-12-10 05:58:36 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
32FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483286769 (110h6m40.180855105s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483441889 (110h6m40.181010225s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484188893 (110h6m40.18175724s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484360284 (110h6m40.18192862s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484899961 (110h6m40.182468308s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485473173 (110h6m40.183041519s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485588187 (110h6m40.183156534s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486286061 (110h6m40.183854397s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486614144 (110h6m40.18418248s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486972244 (110h6m40.184540579s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.487764232 (110h6m40.185332569s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.488611475 (110h6m40.186179862s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:56.532754683 (110h6m44.230323019s) [upload=96631]: Next returned nil segment
Dec 10 05:35:56.532767777 (110h6m44.230336114s) [upload=96631]: Waiting for error group managing segments...
Dec 10 05:36:03.072814336 (110h6m50.770382652s) [noise=true , address=81.171.14.70:4033 , piece_id=A7M7632FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:10.426278146 (110h6m58.123846453s) [noise=true , address=185.167.204.205:4003 , piece_id=C6QVIOWAWPAFTTEGTU67E5S2G3F2YNEMN7ZOYJHO7V5DZTJNHBHA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:13.352409435 (110h7m1.049977751s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:15.264994828 (110h7m2.962563144s) [noise=true , address=89.149.201.147:4014 , piece_id=FUWY5JUHVSRU2T7F6FRLNXPHHG7BDCNRXDCYAO26VEURJLYVAURQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:17.549961624 (110h7m5.24752993s) [noise=true , address=81.171.14.70:4031 , piece_id=3OKFG434PBYJ3SPU6KMJ42JH2ASMSDYLC3SCHPVYLJMH5ONMRBJQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:19.306486817 (110h7m7.004055133s) [noise=true , address=185.167.204.205:4027 , piece_id=6NJYN7KJKTEVYCSNQA6HQGU33NCRYDQ46FJFSG6BIQU4LZLEJNJA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.162049031 (110h7m10.859617337s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.737363060 (110h7m11.434931366s) [noise=true , address=185.167.204.205:4032 , piece_id=ZSZ2K73DHDZYFLWQRMDRBE7HVHDEXWA7K4EUNPGIVXFAHCVUKTLA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.786449800 (110h7m11.484018106s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.060159042 (110h7m11.757727358s) [noise=true , address=185.167.204.206:4038 , piece_id=CBND4CAULWE26NIGWFT7DSTQ4WJ4UOGPGPTY2O3TC53QLH3E7RPQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.094361490 (110h7m11.791929795s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.798040935 (110h7m12.495609251s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.378916283 (110h7m13.076484589s) [noise=true , address=89.149.201.147:4021 , piece_id=BEYZFIFW3J5SRMA3TGXM2TL6E6G7NP4Y4ZY7ZG4B7HBZMRW524IA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.827775932 (110h7m13.525344269s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.877397152 (110h7m13.574965468s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.944028435 (110h7m13.641596771s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:26.560902894 (110h7m14.2584712s) [noise=true , address=89.149.201.147:4016 , piece_id=AG43SI5LEABCPKL7BAK2K7OJ4TVXYUIPUS7TVYC5NUQNUQQB5NOA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.812203200 (110h7m15.509771516s) [noise=true , address=89.149.201.147:4023 , piece_id=BI6SXMTHJ5KYB3556G4U6UYG5HRNK5EH64LNT42V3AFNARG5O7LA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.867169354 (110h7m15.56473767s) [noise=true , address=89.149.201.147:4006 , piece_id=UEKDVE6NDKI4NV7HD4AKUH4HNYVRF3C7SPIN26KDK5NX6J4NBQ5Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:29.445827111 (110h7m17.143395446s) [noise=true , address=185.167.204.205:4008 , piece_id=PZIHSKHE4CALB2V3LHWAX5X6BMMQMSMFWM47MIGVH64G2ZLPMRTQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:32.512177560 (110h7m20.209745866s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:35.825912333 (110h7m23.523480649s) [noise=true , address=81.171.14.70:4027 , piece_id=X46BF2SMXFGBFRWBG3TN45CSU2V66GVOXQAHTR42H2QVOTRA36OA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.223889733 (110h7m28.92145804s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.243892176 (110h7m28.941460483s) [noise=true , address=185.167.204.205:4031 , piece_id=EQZNQZ4BMWYSUX5IKBL2MMX5DPQN5XI4QUIKFR6LWIZI6FLFGJLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:43.488315198 (110h7m31.185883505s) [noise=true , address=81.171.14.70:4040 , piece_id=WGBE4UIBTC7XEAT2QNJIZBTLSEGQH5HT6KSEC3ML6Y5Z7OI4YMVA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:51.974826346 (110h7m39.672394662s) [noise=true , address=89.149.201.147:4017 , piece_id=ESM6BDBHOTQQUZECBEYOFXEZNMPXIGZZYUS7Y6EXFWBZ4WVFTFUA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974841284 (110h7m39.672409589s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection
Dec 10 05:36:51.974903630 (110h7m39.672471946s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974922165 (110h7m39.672490481s) [seg_pos={0 0}, upload=96631]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Dec 10 05:36:52.071976396 (110h7m39.769544712s) [upload=96631]: Done uploading segments...
Dec 10 05:36:52.072005610 (110h7m39.769573927s) [upload=96631]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.640144776s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
4.390042224s trace:
https://jaeger.dev.storj.io/trace/90b6829c07b062b
FAIL (2025-12-10 05:58:19 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 50)
Duration: 4.390059377s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
1.736922901s trace:
https://jaeger.dev.storj.io/trace/576e3c37403ea2f0
FAIL (2025-12-10 05:58:09 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 53)
Duration: 1.736944591s
core
uplink
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
2.300802614s trace:
https://jaeger.dev.storj.io/trace/78954e68dc28a6f0
FAIL (2025-12-10 05:58:04 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
32FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483286769 (110h6m40.180855105s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483441889 (110h6m40.181010225s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484188893 (110h6m40.18175724s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484360284 (110h6m40.18192862s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484899961 (110h6m40.182468308s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485473173 (110h6m40.183041519s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485588187 (110h6m40.183156534s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486286061 (110h6m40.183854397s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486614144 (110h6m40.18418248s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486972244 (110h6m40.184540579s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.487764232 (110h6m40.185332569s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.488611475 (110h6m40.186179862s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:56.532754683 (110h6m44.230323019s) [upload=96631]: Next returned nil segment
Dec 10 05:35:56.532767777 (110h6m44.230336114s) [upload=96631]: Waiting for error group managing segments...
Dec 10 05:36:03.072814336 (110h6m50.770382652s) [noise=true , address=81.171.14.70:4033 , piece_id=A7M7632FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:10.426278146 (110h6m58.123846453s) [noise=true , address=185.167.204.205:4003 , piece_id=C6QVIOWAWPAFTTEGTU67E5S2G3F2YNEMN7ZOYJHO7V5DZTJNHBHA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:13.352409435 (110h7m1.049977751s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:15.264994828 (110h7m2.962563144s) [noise=true , address=89.149.201.147:4014 , piece_id=FUWY5JUHVSRU2T7F6FRLNXPHHG7BDCNRXDCYAO26VEURJLYVAURQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:17.549961624 (110h7m5.24752993s) [noise=true , address=81.171.14.70:4031 , piece_id=3OKFG434PBYJ3SPU6KMJ42JH2ASMSDYLC3SCHPVYLJMH5ONMRBJQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:19.306486817 (110h7m7.004055133s) [noise=true , address=185.167.204.205:4027 , piece_id=6NJYN7KJKTEVYCSNQA6HQGU33NCRYDQ46FJFSG6BIQU4LZLEJNJA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.162049031 (110h7m10.859617337s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.737363060 (110h7m11.434931366s) [noise=true , address=185.167.204.205:4032 , piece_id=ZSZ2K73DHDZYFLWQRMDRBE7HVHDEXWA7K4EUNPGIVXFAHCVUKTLA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.786449800 (110h7m11.484018106s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.060159042 (110h7m11.757727358s) [noise=true , address=185.167.204.206:4038 , piece_id=CBND4CAULWE26NIGWFT7DSTQ4WJ4UOGPGPTY2O3TC53QLH3E7RPQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.094361490 (110h7m11.791929795s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.798040935 (110h7m12.495609251s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.378916283 (110h7m13.076484589s) [noise=true , address=89.149.201.147:4021 , piece_id=BEYZFIFW3J5SRMA3TGXM2TL6E6G7NP4Y4ZY7ZG4B7HBZMRW524IA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.827775932 (110h7m13.525344269s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.877397152 (110h7m13.574965468s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.944028435 (110h7m13.641596771s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:26.560902894 (110h7m14.2584712s) [noise=true , address=89.149.201.147:4016 , piece_id=AG43SI5LEABCPKL7BAK2K7OJ4TVXYUIPUS7TVYC5NUQNUQQB5NOA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.812203200 (110h7m15.509771516s) [noise=true , address=89.149.201.147:4023 , piece_id=BI6SXMTHJ5KYB3556G4U6UYG5HRNK5EH64LNT42V3AFNARG5O7LA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.867169354 (110h7m15.56473767s) [noise=true , address=89.149.201.147:4006 , piece_id=UEKDVE6NDKI4NV7HD4AKUH4HNYVRF3C7SPIN26KDK5NX6J4NBQ5Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:29.445827111 (110h7m17.143395446s) [noise=true , address=185.167.204.205:4008 , piece_id=PZIHSKHE4CALB2V3LHWAX5X6BMMQMSMFWM47MIGVH64G2ZLPMRTQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:32.512177560 (110h7m20.209745866s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:35.825912333 (110h7m23.523480649s) [noise=true , address=81.171.14.70:4027 , piece_id=X46BF2SMXFGBFRWBG3TN45CSU2V66GVOXQAHTR42H2QVOTRA36OA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.223889733 (110h7m28.92145804s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.243892176 (110h7m28.941460483s) [noise=true , address=185.167.204.205:4031 , piece_id=EQZNQZ4BMWYSUX5IKBL2MMX5DPQN5XI4QUIKFR6LWIZI6FLFGJLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:43.488315198 (110h7m31.185883505s) [noise=true , address=81.171.14.70:4040 , piece_id=WGBE4UIBTC7XEAT2QNJIZBTLSEGQH5HT6KSEC3ML6Y5Z7OI4YMVA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:51.974826346 (110h7m39.672394662s) [noise=true , address=89.149.201.147:4017 , piece_id=ESM6BDBHOTQQUZECBEYOFXEZNMPXIGZZYUS7Y6EXFWBZ4WVFTFUA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974841284 (110h7m39.672409589s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection
Dec 10 05:36:51.974903630 (110h7m39.672471946s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974922165 (110h7m39.672490481s) [seg_pos={0 0}, upload=96631]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Dec 10 05:36:52.071976396 (110h7m39.769544712s) [upload=96631]: Done uploading segments...
Dec 10 05:36:52.072005610 (110h7m39.769573927s) [upload=96631]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.300823073s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
1.558402515s trace:
https://jaeger.dev.storj.io/trace/576e3c37403ea2f0
FAIL (2025-12-10 05:57:38 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 53)
Duration: 1.558418245s
core
uplink
us1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
4.562374239s trace:
https://jaeger.dev.storj.io/trace/90b6829c07b062b
FAIL (2025-12-10 05:57:28 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 50)
Duration: 4.562414525s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
2.220439651s trace:
https://jaeger.dev.storj.io/trace/78954e68dc28a6f0
FAIL (2025-12-10 05:57:04 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
32FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483286769 (110h6m40.180855105s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483441889 (110h6m40.181010225s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484188893 (110h6m40.18175724s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484360284 (110h6m40.18192862s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484899961 (110h6m40.182468308s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485473173 (110h6m40.183041519s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485588187 (110h6m40.183156534s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486286061 (110h6m40.183854397s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486614144 (110h6m40.18418248s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486972244 (110h6m40.184540579s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.487764232 (110h6m40.185332569s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.488611475 (110h6m40.186179862s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:56.532754683 (110h6m44.230323019s) [upload=96631]: Next returned nil segment
Dec 10 05:35:56.532767777 (110h6m44.230336114s) [upload=96631]: Waiting for error group managing segments...
Dec 10 05:36:03.072814336 (110h6m50.770382652s) [noise=true , address=81.171.14.70:4033 , piece_id=A7M7632FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:10.426278146 (110h6m58.123846453s) [noise=true , address=185.167.204.205:4003 , piece_id=C6QVIOWAWPAFTTEGTU67E5S2G3F2YNEMN7ZOYJHO7V5DZTJNHBHA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:13.352409435 (110h7m1.049977751s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:15.264994828 (110h7m2.962563144s) [noise=true , address=89.149.201.147:4014 , piece_id=FUWY5JUHVSRU2T7F6FRLNXPHHG7BDCNRXDCYAO26VEURJLYVAURQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:17.549961624 (110h7m5.24752993s) [noise=true , address=81.171.14.70:4031 , piece_id=3OKFG434PBYJ3SPU6KMJ42JH2ASMSDYLC3SCHPVYLJMH5ONMRBJQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:19.306486817 (110h7m7.004055133s) [noise=true , address=185.167.204.205:4027 , piece_id=6NJYN7KJKTEVYCSNQA6HQGU33NCRYDQ46FJFSG6BIQU4LZLEJNJA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.162049031 (110h7m10.859617337s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.737363060 (110h7m11.434931366s) [noise=true , address=185.167.204.205:4032 , piece_id=ZSZ2K73DHDZYFLWQRMDRBE7HVHDEXWA7K4EUNPGIVXFAHCVUKTLA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.786449800 (110h7m11.484018106s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.060159042 (110h7m11.757727358s) [noise=true , address=185.167.204.206:4038 , piece_id=CBND4CAULWE26NIGWFT7DSTQ4WJ4UOGPGPTY2O3TC53QLH3E7RPQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.094361490 (110h7m11.791929795s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.798040935 (110h7m12.495609251s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.378916283 (110h7m13.076484589s) [noise=true , address=89.149.201.147:4021 , piece_id=BEYZFIFW3J5SRMA3TGXM2TL6E6G7NP4Y4ZY7ZG4B7HBZMRW524IA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.827775932 (110h7m13.525344269s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.877397152 (110h7m13.574965468s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.944028435 (110h7m13.641596771s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:26.560902894 (110h7m14.2584712s) [noise=true , address=89.149.201.147:4016 , piece_id=AG43SI5LEABCPKL7BAK2K7OJ4TVXYUIPUS7TVYC5NUQNUQQB5NOA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.812203200 (110h7m15.509771516s) [noise=true , address=89.149.201.147:4023 , piece_id=BI6SXMTHJ5KYB3556G4U6UYG5HRNK5EH64LNT42V3AFNARG5O7LA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.867169354 (110h7m15.56473767s) [noise=true , address=89.149.201.147:4006 , piece_id=UEKDVE6NDKI4NV7HD4AKUH4HNYVRF3C7SPIN26KDK5NX6J4NBQ5Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:29.445827111 (110h7m17.143395446s) [noise=true , address=185.167.204.205:4008 , piece_id=PZIHSKHE4CALB2V3LHWAX5X6BMMQMSMFWM47MIGVH64G2ZLPMRTQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:32.512177560 (110h7m20.209745866s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:35.825912333 (110h7m23.523480649s) [noise=true , address=81.171.14.70:4027 , piece_id=X46BF2SMXFGBFRWBG3TN45CSU2V66GVOXQAHTR42H2QVOTRA36OA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.223889733 (110h7m28.92145804s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.243892176 (110h7m28.941460483s) [noise=true , address=185.167.204.205:4031 , piece_id=EQZNQZ4BMWYSUX5IKBL2MMX5DPQN5XI4QUIKFR6LWIZI6FLFGJLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:43.488315198 (110h7m31.185883505s) [noise=true , address=81.171.14.70:4040 , piece_id=WGBE4UIBTC7XEAT2QNJIZBTLSEGQH5HT6KSEC3ML6Y5Z7OI4YMVA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:51.974826346 (110h7m39.672394662s) [noise=true , address=89.149.201.147:4017 , piece_id=ESM6BDBHOTQQUZECBEYOFXEZNMPXIGZZYUS7Y6EXFWBZ4WVFTFUA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974841284 (110h7m39.672409589s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection
Dec 10 05:36:51.974903630 (110h7m39.672471946s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974922165 (110h7m39.672490481s) [seg_pos={0 0}, upload=96631]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Dec 10 05:36:52.071976396 (110h7m39.769544712s) [upload=96631]: Done uploading segments...
Dec 10 05:36:52.072005610 (110h7m39.769573927s) [upload=96631]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.220460038s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
1.770030454s trace:
https://jaeger.dev.storj.io/trace/576e3c37403ea2f0
FAIL (2025-12-10 05:56:49 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 53)
Duration: 1.770049961s
core
uplink
us1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
4.568538953s trace:
https://jaeger.dev.storj.io/trace/90b6829c07b062b
FAIL (2025-12-10 05:56:42 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 50)
Duration: 4.568556204s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
2.167417079s trace:
https://jaeger.dev.storj.io/trace/78954e68dc28a6f0
FAIL (2025-12-10 05:56:14 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
32FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483286769 (110h6m40.180855105s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483441889 (110h6m40.181010225s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484188893 (110h6m40.18175724s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484360284 (110h6m40.18192862s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484899961 (110h6m40.182468308s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485473173 (110h6m40.183041519s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485588187 (110h6m40.183156534s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486286061 (110h6m40.183854397s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486614144 (110h6m40.18418248s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486972244 (110h6m40.184540579s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.487764232 (110h6m40.185332569s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.488611475 (110h6m40.186179862s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:56.532754683 (110h6m44.230323019s) [upload=96631]: Next returned nil segment
Dec 10 05:35:56.532767777 (110h6m44.230336114s) [upload=96631]: Waiting for error group managing segments...
Dec 10 05:36:03.072814336 (110h6m50.770382652s) [noise=true , address=81.171.14.70:4033 , piece_id=A7M7632FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:10.426278146 (110h6m58.123846453s) [noise=true , address=185.167.204.205:4003 , piece_id=C6QVIOWAWPAFTTEGTU67E5S2G3F2YNEMN7ZOYJHO7V5DZTJNHBHA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:13.352409435 (110h7m1.049977751s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:15.264994828 (110h7m2.962563144s) [noise=true , address=89.149.201.147:4014 , piece_id=FUWY5JUHVSRU2T7F6FRLNXPHHG7BDCNRXDCYAO26VEURJLYVAURQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:17.549961624 (110h7m5.24752993s) [noise=true , address=81.171.14.70:4031 , piece_id=3OKFG434PBYJ3SPU6KMJ42JH2ASMSDYLC3SCHPVYLJMH5ONMRBJQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:19.306486817 (110h7m7.004055133s) [noise=true , address=185.167.204.205:4027 , piece_id=6NJYN7KJKTEVYCSNQA6HQGU33NCRYDQ46FJFSG6BIQU4LZLEJNJA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.162049031 (110h7m10.859617337s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.737363060 (110h7m11.434931366s) [noise=true , address=185.167.204.205:4032 , piece_id=ZSZ2K73DHDZYFLWQRMDRBE7HVHDEXWA7K4EUNPGIVXFAHCVUKTLA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.786449800 (110h7m11.484018106s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.060159042 (110h7m11.757727358s) [noise=true , address=185.167.204.206:4038 , piece_id=CBND4CAULWE26NIGWFT7DSTQ4WJ4UOGPGPTY2O3TC53QLH3E7RPQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.094361490 (110h7m11.791929795s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.798040935 (110h7m12.495609251s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.378916283 (110h7m13.076484589s) [noise=true , address=89.149.201.147:4021 , piece_id=BEYZFIFW3J5SRMA3TGXM2TL6E6G7NP4Y4ZY7ZG4B7HBZMRW524IA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.827775932 (110h7m13.525344269s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.877397152 (110h7m13.574965468s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.944028435 (110h7m13.641596771s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:26.560902894 (110h7m14.2584712s) [noise=true , address=89.149.201.147:4016 , piece_id=AG43SI5LEABCPKL7BAK2K7OJ4TVXYUIPUS7TVYC5NUQNUQQB5NOA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.812203200 (110h7m15.509771516s) [noise=true , address=89.149.201.147:4023 , piece_id=BI6SXMTHJ5KYB3556G4U6UYG5HRNK5EH64LNT42V3AFNARG5O7LA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.867169354 (110h7m15.56473767s) [noise=true , address=89.149.201.147:4006 , piece_id=UEKDVE6NDKI4NV7HD4AKUH4HNYVRF3C7SPIN26KDK5NX6J4NBQ5Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:29.445827111 (110h7m17.143395446s) [noise=true , address=185.167.204.205:4008 , piece_id=PZIHSKHE4CALB2V3LHWAX5X6BMMQMSMFWM47MIGVH64G2ZLPMRTQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:32.512177560 (110h7m20.209745866s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:35.825912333 (110h7m23.523480649s) [noise=true , address=81.171.14.70:4027 , piece_id=X46BF2SMXFGBFRWBG3TN45CSU2V66GVOXQAHTR42H2QVOTRA36OA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.223889733 (110h7m28.92145804s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.243892176 (110h7m28.941460483s) [noise=true , address=185.167.204.205:4031 , piece_id=EQZNQZ4BMWYSUX5IKBL2MMX5DPQN5XI4QUIKFR6LWIZI6FLFGJLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:43.488315198 (110h7m31.185883505s) [noise=true , address=81.171.14.70:4040 , piece_id=WGBE4UIBTC7XEAT2QNJIZBTLSEGQH5HT6KSEC3ML6Y5Z7OI4YMVA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:51.974826346 (110h7m39.672394662s) [noise=true , address=89.149.201.147:4017 , piece_id=ESM6BDBHOTQQUZECBEYOFXEZNMPXIGZZYUS7Y6EXFWBZ4WVFTFUA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974841284 (110h7m39.672409589s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection
Dec 10 05:36:51.974903630 (110h7m39.672471946s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974922165 (110h7m39.672490481s) [seg_pos={0 0}, upload=96631]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Dec 10 05:36:52.071976396 (110h7m39.769544712s) [upload=96631]: Done uploading segments...
Dec 10 05:36:52.072005610 (110h7m39.769573927s) [upload=96631]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.167433951s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
2.165881667s trace:
https://jaeger.dev.storj.io/trace/78954e68dc28a6f0
FAIL (2025-12-10 05:55:55 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
32FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483286769 (110h6m40.180855105s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483441889 (110h6m40.181010225s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484188893 (110h6m40.18175724s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484360284 (110h6m40.18192862s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484899961 (110h6m40.182468308s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485473173 (110h6m40.183041519s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485588187 (110h6m40.183156534s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486286061 (110h6m40.183854397s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486614144 (110h6m40.18418248s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486972244 (110h6m40.184540579s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.487764232 (110h6m40.185332569s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.488611475 (110h6m40.186179862s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:56.532754683 (110h6m44.230323019s) [upload=96631]: Next returned nil segment
Dec 10 05:35:56.532767777 (110h6m44.230336114s) [upload=96631]: Waiting for error group managing segments...
Dec 10 05:36:03.072814336 (110h6m50.770382652s) [noise=true , address=81.171.14.70:4033 , piece_id=A7M7632FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:10.426278146 (110h6m58.123846453s) [noise=true , address=185.167.204.205:4003 , piece_id=C6QVIOWAWPAFTTEGTU67E5S2G3F2YNEMN7ZOYJHO7V5DZTJNHBHA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:13.352409435 (110h7m1.049977751s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:15.264994828 (110h7m2.962563144s) [noise=true , address=89.149.201.147:4014 , piece_id=FUWY5JUHVSRU2T7F6FRLNXPHHG7BDCNRXDCYAO26VEURJLYVAURQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:17.549961624 (110h7m5.24752993s) [noise=true , address=81.171.14.70:4031 , piece_id=3OKFG434PBYJ3SPU6KMJ42JH2ASMSDYLC3SCHPVYLJMH5ONMRBJQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:19.306486817 (110h7m7.004055133s) [noise=true , address=185.167.204.205:4027 , piece_id=6NJYN7KJKTEVYCSNQA6HQGU33NCRYDQ46FJFSG6BIQU4LZLEJNJA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.162049031 (110h7m10.859617337s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.737363060 (110h7m11.434931366s) [noise=true , address=185.167.204.205:4032 , piece_id=ZSZ2K73DHDZYFLWQRMDRBE7HVHDEXWA7K4EUNPGIVXFAHCVUKTLA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.786449800 (110h7m11.484018106s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.060159042 (110h7m11.757727358s) [noise=true , address=185.167.204.206:4038 , piece_id=CBND4CAULWE26NIGWFT7DSTQ4WJ4UOGPGPTY2O3TC53QLH3E7RPQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.094361490 (110h7m11.791929795s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.798040935 (110h7m12.495609251s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.378916283 (110h7m13.076484589s) [noise=true , address=89.149.201.147:4021 , piece_id=BEYZFIFW3J5SRMA3TGXM2TL6E6G7NP4Y4ZY7ZG4B7HBZMRW524IA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.827775932 (110h7m13.525344269s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.877397152 (110h7m13.574965468s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.944028435 (110h7m13.641596771s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:26.560902894 (110h7m14.2584712s) [noise=true , address=89.149.201.147:4016 , piece_id=AG43SI5LEABCPKL7BAK2K7OJ4TVXYUIPUS7TVYC5NUQNUQQB5NOA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.812203200 (110h7m15.509771516s) [noise=true , address=89.149.201.147:4023 , piece_id=BI6SXMTHJ5KYB3556G4U6UYG5HRNK5EH64LNT42V3AFNARG5O7LA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.867169354 (110h7m15.56473767s) [noise=true , address=89.149.201.147:4006 , piece_id=UEKDVE6NDKI4NV7HD4AKUH4HNYVRF3C7SPIN26KDK5NX6J4NBQ5Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:29.445827111 (110h7m17.143395446s) [noise=true , address=185.167.204.205:4008 , piece_id=PZIHSKHE4CALB2V3LHWAX5X6BMMQMSMFWM47MIGVH64G2ZLPMRTQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:32.512177560 (110h7m20.209745866s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:35.825912333 (110h7m23.523480649s) [noise=true , address=81.171.14.70:4027 , piece_id=X46BF2SMXFGBFRWBG3TN45CSU2V66GVOXQAHTR42H2QVOTRA36OA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.223889733 (110h7m28.92145804s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.243892176 (110h7m28.941460483s) [noise=true , address=185.167.204.205:4031 , piece_id=EQZNQZ4BMWYSUX5IKBL2MMX5DPQN5XI4QUIKFR6LWIZI6FLFGJLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:43.488315198 (110h7m31.185883505s) [noise=true , address=81.171.14.70:4040 , piece_id=WGBE4UIBTC7XEAT2QNJIZBTLSEGQH5HT6KSEC3ML6Y5Z7OI4YMVA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:51.974826346 (110h7m39.672394662s) [noise=true , address=89.149.201.147:4017 , piece_id=ESM6BDBHOTQQUZECBEYOFXEZNMPXIGZZYUS7Y6EXFWBZ4WVFTFUA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974841284 (110h7m39.672409589s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection
Dec 10 05:36:51.974903630 (110h7m39.672471946s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974922165 (110h7m39.672490481s) [seg_pos={0 0}, upload=96631]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Dec 10 05:36:52.071976396 (110h7m39.769544712s) [upload=96631]: Done uploading segments...
Dec 10 05:36:52.072005610 (110h7m39.769573927s) [upload=96631]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.165903088s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
1.645809727s trace:
https://jaeger.dev.storj.io/trace/576e3c37403ea2f0
FAIL (2025-12-10 05:55:51 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 53)
Duration: 1.645824533s
core
uplink
us1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
4.544298736s trace:
https://jaeger.dev.storj.io/trace/90b6829c07b062b
FAIL (2025-12-10 05:55:39 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 50)
Duration: 4.54432232s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
1.940378473s trace:
https://jaeger.dev.storj.io/trace/576e3c37403ea2f0
FAIL (2025-12-10 05:55:16 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 53)
Duration: 1.940394864s
core
uplink
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
2.619827373s trace:
https://jaeger.dev.storj.io/trace/78954e68dc28a6f0
FAIL (2025-12-10 05:55:16 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
32FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483286769 (110h6m40.180855105s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483441889 (110h6m40.181010225s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484188893 (110h6m40.18175724s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484360284 (110h6m40.18192862s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484899961 (110h6m40.182468308s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485473173 (110h6m40.183041519s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485588187 (110h6m40.183156534s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486286061 (110h6m40.183854397s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486614144 (110h6m40.18418248s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486972244 (110h6m40.184540579s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.487764232 (110h6m40.185332569s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.488611475 (110h6m40.186179862s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:56.532754683 (110h6m44.230323019s) [upload=96631]: Next returned nil segment
Dec 10 05:35:56.532767777 (110h6m44.230336114s) [upload=96631]: Waiting for error group managing segments...
Dec 10 05:36:03.072814336 (110h6m50.770382652s) [noise=true , address=81.171.14.70:4033 , piece_id=A7M7632FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:10.426278146 (110h6m58.123846453s) [noise=true , address=185.167.204.205:4003 , piece_id=C6QVIOWAWPAFTTEGTU67E5S2G3F2YNEMN7ZOYJHO7V5DZTJNHBHA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:13.352409435 (110h7m1.049977751s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:15.264994828 (110h7m2.962563144s) [noise=true , address=89.149.201.147:4014 , piece_id=FUWY5JUHVSRU2T7F6FRLNXPHHG7BDCNRXDCYAO26VEURJLYVAURQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:17.549961624 (110h7m5.24752993s) [noise=true , address=81.171.14.70:4031 , piece_id=3OKFG434PBYJ3SPU6KMJ42JH2ASMSDYLC3SCHPVYLJMH5ONMRBJQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:19.306486817 (110h7m7.004055133s) [noise=true , address=185.167.204.205:4027 , piece_id=6NJYN7KJKTEVYCSNQA6HQGU33NCRYDQ46FJFSG6BIQU4LZLEJNJA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.162049031 (110h7m10.859617337s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.737363060 (110h7m11.434931366s) [noise=true , address=185.167.204.205:4032 , piece_id=ZSZ2K73DHDZYFLWQRMDRBE7HVHDEXWA7K4EUNPGIVXFAHCVUKTLA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.786449800 (110h7m11.484018106s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.060159042 (110h7m11.757727358s) [noise=true , address=185.167.204.206:4038 , piece_id=CBND4CAULWE26NIGWFT7DSTQ4WJ4UOGPGPTY2O3TC53QLH3E7RPQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.094361490 (110h7m11.791929795s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.798040935 (110h7m12.495609251s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.378916283 (110h7m13.076484589s) [noise=true , address=89.149.201.147:4021 , piece_id=BEYZFIFW3J5SRMA3TGXM2TL6E6G7NP4Y4ZY7ZG4B7HBZMRW524IA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.827775932 (110h7m13.525344269s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.877397152 (110h7m13.574965468s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.944028435 (110h7m13.641596771s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:26.560902894 (110h7m14.2584712s) [noise=true , address=89.149.201.147:4016 , piece_id=AG43SI5LEABCPKL7BAK2K7OJ4TVXYUIPUS7TVYC5NUQNUQQB5NOA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.812203200 (110h7m15.509771516s) [noise=true , address=89.149.201.147:4023 , piece_id=BI6SXMTHJ5KYB3556G4U6UYG5HRNK5EH64LNT42V3AFNARG5O7LA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.867169354 (110h7m15.56473767s) [noise=true , address=89.149.201.147:4006 , piece_id=UEKDVE6NDKI4NV7HD4AKUH4HNYVRF3C7SPIN26KDK5NX6J4NBQ5Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:29.445827111 (110h7m17.143395446s) [noise=true , address=185.167.204.205:4008 , piece_id=PZIHSKHE4CALB2V3LHWAX5X6BMMQMSMFWM47MIGVH64G2ZLPMRTQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:32.512177560 (110h7m20.209745866s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:35.825912333 (110h7m23.523480649s) [noise=true , address=81.171.14.70:4027 , piece_id=X46BF2SMXFGBFRWBG3TN45CSU2V66GVOXQAHTR42H2QVOTRA36OA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.223889733 (110h7m28.92145804s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.243892176 (110h7m28.941460483s) [noise=true , address=185.167.204.205:4031 , piece_id=EQZNQZ4BMWYSUX5IKBL2MMX5DPQN5XI4QUIKFR6LWIZI6FLFGJLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:43.488315198 (110h7m31.185883505s) [noise=true , address=81.171.14.70:4040 , piece_id=WGBE4UIBTC7XEAT2QNJIZBTLSEGQH5HT6KSEC3ML6Y5Z7OI4YMVA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:51.974826346 (110h7m39.672394662s) [noise=true , address=89.149.201.147:4017 , piece_id=ESM6BDBHOTQQUZECBEYOFXEZNMPXIGZZYUS7Y6EXFWBZ4WVFTFUA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974841284 (110h7m39.672409589s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection
Dec 10 05:36:51.974903630 (110h7m39.672471946s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974922165 (110h7m39.672490481s) [seg_pos={0 0}, upload=96631]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Dec 10 05:36:52.071976396 (110h7m39.769544712s) [upload=96631]: Done uploading segments...
Dec 10 05:36:52.072005610 (110h7m39.769573927s) [upload=96631]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.619847813s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
4.702592796s trace:
https://jaeger.dev.storj.io/trace/90b6829c07b062b
FAIL (2025-12-10 05:55:09 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 50)
Duration: 4.702618063s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
4.406218928s trace:
https://jaeger.dev.storj.io/trace/90b6829c07b062b
FAIL (2025-12-10 05:54:48 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 50)
Duration: 4.406235577s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
2.640704259s trace:
https://jaeger.dev.storj.io/trace/78954e68dc28a6f0
FAIL (2025-12-10 05:54:44 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
32FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483286769 (110h6m40.180855105s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483441889 (110h6m40.181010225s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484188893 (110h6m40.18175724s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484360284 (110h6m40.18192862s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484899961 (110h6m40.182468308s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485473173 (110h6m40.183041519s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485588187 (110h6m40.183156534s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486286061 (110h6m40.183854397s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486614144 (110h6m40.18418248s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486972244 (110h6m40.184540579s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.487764232 (110h6m40.185332569s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.488611475 (110h6m40.186179862s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:56.532754683 (110h6m44.230323019s) [upload=96631]: Next returned nil segment
Dec 10 05:35:56.532767777 (110h6m44.230336114s) [upload=96631]: Waiting for error group managing segments...
Dec 10 05:36:03.072814336 (110h6m50.770382652s) [noise=true , address=81.171.14.70:4033 , piece_id=A7M7632FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:10.426278146 (110h6m58.123846453s) [noise=true , address=185.167.204.205:4003 , piece_id=C6QVIOWAWPAFTTEGTU67E5S2G3F2YNEMN7ZOYJHO7V5DZTJNHBHA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:13.352409435 (110h7m1.049977751s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:15.264994828 (110h7m2.962563144s) [noise=true , address=89.149.201.147:4014 , piece_id=FUWY5JUHVSRU2T7F6FRLNXPHHG7BDCNRXDCYAO26VEURJLYVAURQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:17.549961624 (110h7m5.24752993s) [noise=true , address=81.171.14.70:4031 , piece_id=3OKFG434PBYJ3SPU6KMJ42JH2ASMSDYLC3SCHPVYLJMH5ONMRBJQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:19.306486817 (110h7m7.004055133s) [noise=true , address=185.167.204.205:4027 , piece_id=6NJYN7KJKTEVYCSNQA6HQGU33NCRYDQ46FJFSG6BIQU4LZLEJNJA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.162049031 (110h7m10.859617337s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.737363060 (110h7m11.434931366s) [noise=true , address=185.167.204.205:4032 , piece_id=ZSZ2K73DHDZYFLWQRMDRBE7HVHDEXWA7K4EUNPGIVXFAHCVUKTLA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.786449800 (110h7m11.484018106s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.060159042 (110h7m11.757727358s) [noise=true , address=185.167.204.206:4038 , piece_id=CBND4CAULWE26NIGWFT7DSTQ4WJ4UOGPGPTY2O3TC53QLH3E7RPQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.094361490 (110h7m11.791929795s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.798040935 (110h7m12.495609251s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.378916283 (110h7m13.076484589s) [noise=true , address=89.149.201.147:4021 , piece_id=BEYZFIFW3J5SRMA3TGXM2TL6E6G7NP4Y4ZY7ZG4B7HBZMRW524IA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.827775932 (110h7m13.525344269s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.877397152 (110h7m13.574965468s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.944028435 (110h7m13.641596771s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:26.560902894 (110h7m14.2584712s) [noise=true , address=89.149.201.147:4016 , piece_id=AG43SI5LEABCPKL7BAK2K7OJ4TVXYUIPUS7TVYC5NUQNUQQB5NOA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.812203200 (110h7m15.509771516s) [noise=true , address=89.149.201.147:4023 , piece_id=BI6SXMTHJ5KYB3556G4U6UYG5HRNK5EH64LNT42V3AFNARG5O7LA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.867169354 (110h7m15.56473767s) [noise=true , address=89.149.201.147:4006 , piece_id=UEKDVE6NDKI4NV7HD4AKUH4HNYVRF3C7SPIN26KDK5NX6J4NBQ5Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:29.445827111 (110h7m17.143395446s) [noise=true , address=185.167.204.205:4008 , piece_id=PZIHSKHE4CALB2V3LHWAX5X6BMMQMSMFWM47MIGVH64G2ZLPMRTQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:32.512177560 (110h7m20.209745866s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:35.825912333 (110h7m23.523480649s) [noise=true , address=81.171.14.70:4027 , piece_id=X46BF2SMXFGBFRWBG3TN45CSU2V66GVOXQAHTR42H2QVOTRA36OA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.223889733 (110h7m28.92145804s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.243892176 (110h7m28.941460483s) [noise=true , address=185.167.204.205:4031 , piece_id=EQZNQZ4BMWYSUX5IKBL2MMX5DPQN5XI4QUIKFR6LWIZI6FLFGJLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:43.488315198 (110h7m31.185883505s) [noise=true , address=81.171.14.70:4040 , piece_id=WGBE4UIBTC7XEAT2QNJIZBTLSEGQH5HT6KSEC3ML6Y5Z7OI4YMVA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:51.974826346 (110h7m39.672394662s) [noise=true , address=89.149.201.147:4017 , piece_id=ESM6BDBHOTQQUZECBEYOFXEZNMPXIGZZYUS7Y6EXFWBZ4WVFTFUA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974841284 (110h7m39.672409589s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection
Dec 10 05:36:51.974903630 (110h7m39.672471946s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974922165 (110h7m39.672490481s) [seg_pos={0 0}, upload=96631]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Dec 10 05:36:52.071976396 (110h7m39.769544712s) [upload=96631]: Done uploading segments...
Dec 10 05:36:52.072005610 (110h7m39.769573927s) [upload=96631]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.640724428s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
1.647853494s trace:
https://jaeger.dev.storj.io/trace/576e3c37403ea2f0
FAIL (2025-12-10 05:54:33 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 53)
Duration: 1.647875285s
core
uplink
us1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
4.687666662s trace:
https://jaeger.dev.storj.io/trace/90b6829c07b062b
FAIL (2025-12-10 05:54:16 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 50)
Duration: 4.687692551s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
1.660793436s trace:
https://jaeger.dev.storj.io/trace/576e3c37403ea2f0
FAIL (2025-12-10 05:54:09 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 53)
Duration: 1.660814576s
core
uplink
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
2.62135688s trace:
https://jaeger.dev.storj.io/trace/78954e68dc28a6f0
FAIL (2025-12-10 05:54:00 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
32FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483286769 (110h6m40.180855105s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483441889 (110h6m40.181010225s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484188893 (110h6m40.18175724s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484360284 (110h6m40.18192862s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484899961 (110h6m40.182468308s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485473173 (110h6m40.183041519s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485588187 (110h6m40.183156534s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486286061 (110h6m40.183854397s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486614144 (110h6m40.18418248s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486972244 (110h6m40.184540579s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.487764232 (110h6m40.185332569s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.488611475 (110h6m40.186179862s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:56.532754683 (110h6m44.230323019s) [upload=96631]: Next returned nil segment
Dec 10 05:35:56.532767777 (110h6m44.230336114s) [upload=96631]: Waiting for error group managing segments...
Dec 10 05:36:03.072814336 (110h6m50.770382652s) [noise=true , address=81.171.14.70:4033 , piece_id=A7M7632FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:10.426278146 (110h6m58.123846453s) [noise=true , address=185.167.204.205:4003 , piece_id=C6QVIOWAWPAFTTEGTU67E5S2G3F2YNEMN7ZOYJHO7V5DZTJNHBHA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:13.352409435 (110h7m1.049977751s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:15.264994828 (110h7m2.962563144s) [noise=true , address=89.149.201.147:4014 , piece_id=FUWY5JUHVSRU2T7F6FRLNXPHHG7BDCNRXDCYAO26VEURJLYVAURQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:17.549961624 (110h7m5.24752993s) [noise=true , address=81.171.14.70:4031 , piece_id=3OKFG434PBYJ3SPU6KMJ42JH2ASMSDYLC3SCHPVYLJMH5ONMRBJQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:19.306486817 (110h7m7.004055133s) [noise=true , address=185.167.204.205:4027 , piece_id=6NJYN7KJKTEVYCSNQA6HQGU33NCRYDQ46FJFSG6BIQU4LZLEJNJA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.162049031 (110h7m10.859617337s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.737363060 (110h7m11.434931366s) [noise=true , address=185.167.204.205:4032 , piece_id=ZSZ2K73DHDZYFLWQRMDRBE7HVHDEXWA7K4EUNPGIVXFAHCVUKTLA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.786449800 (110h7m11.484018106s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.060159042 (110h7m11.757727358s) [noise=true , address=185.167.204.206:4038 , piece_id=CBND4CAULWE26NIGWFT7DSTQ4WJ4UOGPGPTY2O3TC53QLH3E7RPQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.094361490 (110h7m11.791929795s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.798040935 (110h7m12.495609251s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.378916283 (110h7m13.076484589s) [noise=true , address=89.149.201.147:4021 , piece_id=BEYZFIFW3J5SRMA3TGXM2TL6E6G7NP4Y4ZY7ZG4B7HBZMRW524IA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.827775932 (110h7m13.525344269s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.877397152 (110h7m13.574965468s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.944028435 (110h7m13.641596771s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:26.560902894 (110h7m14.2584712s) [noise=true , address=89.149.201.147:4016 , piece_id=AG43SI5LEABCPKL7BAK2K7OJ4TVXYUIPUS7TVYC5NUQNUQQB5NOA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.812203200 (110h7m15.509771516s) [noise=true , address=89.149.201.147:4023 , piece_id=BI6SXMTHJ5KYB3556G4U6UYG5HRNK5EH64LNT42V3AFNARG5O7LA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.867169354 (110h7m15.56473767s) [noise=true , address=89.149.201.147:4006 , piece_id=UEKDVE6NDKI4NV7HD4AKUH4HNYVRF3C7SPIN26KDK5NX6J4NBQ5Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:29.445827111 (110h7m17.143395446s) [noise=true , address=185.167.204.205:4008 , piece_id=PZIHSKHE4CALB2V3LHWAX5X6BMMQMSMFWM47MIGVH64G2ZLPMRTQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:32.512177560 (110h7m20.209745866s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:35.825912333 (110h7m23.523480649s) [noise=true , address=81.171.14.70:4027 , piece_id=X46BF2SMXFGBFRWBG3TN45CSU2V66GVOXQAHTR42H2QVOTRA36OA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.223889733 (110h7m28.92145804s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.243892176 (110h7m28.941460483s) [noise=true , address=185.167.204.205:4031 , piece_id=EQZNQZ4BMWYSUX5IKBL2MMX5DPQN5XI4QUIKFR6LWIZI6FLFGJLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:43.488315198 (110h7m31.185883505s) [noise=true , address=81.171.14.70:4040 , piece_id=WGBE4UIBTC7XEAT2QNJIZBTLSEGQH5HT6KSEC3ML6Y5Z7OI4YMVA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:51.974826346 (110h7m39.672394662s) [noise=true , address=89.149.201.147:4017 , piece_id=ESM6BDBHOTQQUZECBEYOFXEZNMPXIGZZYUS7Y6EXFWBZ4WVFTFUA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974841284 (110h7m39.672409589s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection
Dec 10 05:36:51.974903630 (110h7m39.672471946s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974922165 (110h7m39.672490481s) [seg_pos={0 0}, upload=96631]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Dec 10 05:36:52.071976396 (110h7m39.769544712s) [upload=96631]: Done uploading segments...
Dec 10 05:36:52.072005610 (110h7m39.769573927s) [upload=96631]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.62137836s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
2.617793935s trace:
https://jaeger.dev.storj.io/trace/78954e68dc28a6f0
FAIL (2025-12-10 05:53:43 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
32FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483286769 (110h6m40.180855105s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483441889 (110h6m40.181010225s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484188893 (110h6m40.18175724s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484360284 (110h6m40.18192862s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484899961 (110h6m40.182468308s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485473173 (110h6m40.183041519s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485588187 (110h6m40.183156534s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486286061 (110h6m40.183854397s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486614144 (110h6m40.18418248s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486972244 (110h6m40.184540579s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.487764232 (110h6m40.185332569s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.488611475 (110h6m40.186179862s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:56.532754683 (110h6m44.230323019s) [upload=96631]: Next returned nil segment
Dec 10 05:35:56.532767777 (110h6m44.230336114s) [upload=96631]: Waiting for error group managing segments...
Dec 10 05:36:03.072814336 (110h6m50.770382652s) [noise=true , address=81.171.14.70:4033 , piece_id=A7M7632FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:10.426278146 (110h6m58.123846453s) [noise=true , address=185.167.204.205:4003 , piece_id=C6QVIOWAWPAFTTEGTU67E5S2G3F2YNEMN7ZOYJHO7V5DZTJNHBHA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:13.352409435 (110h7m1.049977751s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:15.264994828 (110h7m2.962563144s) [noise=true , address=89.149.201.147:4014 , piece_id=FUWY5JUHVSRU2T7F6FRLNXPHHG7BDCNRXDCYAO26VEURJLYVAURQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:17.549961624 (110h7m5.24752993s) [noise=true , address=81.171.14.70:4031 , piece_id=3OKFG434PBYJ3SPU6KMJ42JH2ASMSDYLC3SCHPVYLJMH5ONMRBJQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:19.306486817 (110h7m7.004055133s) [noise=true , address=185.167.204.205:4027 , piece_id=6NJYN7KJKTEVYCSNQA6HQGU33NCRYDQ46FJFSG6BIQU4LZLEJNJA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.162049031 (110h7m10.859617337s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.737363060 (110h7m11.434931366s) [noise=true , address=185.167.204.205:4032 , piece_id=ZSZ2K73DHDZYFLWQRMDRBE7HVHDEXWA7K4EUNPGIVXFAHCVUKTLA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.786449800 (110h7m11.484018106s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.060159042 (110h7m11.757727358s) [noise=true , address=185.167.204.206:4038 , piece_id=CBND4CAULWE26NIGWFT7DSTQ4WJ4UOGPGPTY2O3TC53QLH3E7RPQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.094361490 (110h7m11.791929795s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.798040935 (110h7m12.495609251s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.378916283 (110h7m13.076484589s) [noise=true , address=89.149.201.147:4021 , piece_id=BEYZFIFW3J5SRMA3TGXM2TL6E6G7NP4Y4ZY7ZG4B7HBZMRW524IA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.827775932 (110h7m13.525344269s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.877397152 (110h7m13.574965468s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.944028435 (110h7m13.641596771s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:26.560902894 (110h7m14.2584712s) [noise=true , address=89.149.201.147:4016 , piece_id=AG43SI5LEABCPKL7BAK2K7OJ4TVXYUIPUS7TVYC5NUQNUQQB5NOA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.812203200 (110h7m15.509771516s) [noise=true , address=89.149.201.147:4023 , piece_id=BI6SXMTHJ5KYB3556G4U6UYG5HRNK5EH64LNT42V3AFNARG5O7LA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.867169354 (110h7m15.56473767s) [noise=true , address=89.149.201.147:4006 , piece_id=UEKDVE6NDKI4NV7HD4AKUH4HNYVRF3C7SPIN26KDK5NX6J4NBQ5Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:29.445827111 (110h7m17.143395446s) [noise=true , address=185.167.204.205:4008 , piece_id=PZIHSKHE4CALB2V3LHWAX5X6BMMQMSMFWM47MIGVH64G2ZLPMRTQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:32.512177560 (110h7m20.209745866s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:35.825912333 (110h7m23.523480649s) [noise=true , address=81.171.14.70:4027 , piece_id=X46BF2SMXFGBFRWBG3TN45CSU2V66GVOXQAHTR42H2QVOTRA36OA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.223889733 (110h7m28.92145804s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.243892176 (110h7m28.941460483s) [noise=true , address=185.167.204.205:4031 , piece_id=EQZNQZ4BMWYSUX5IKBL2MMX5DPQN5XI4QUIKFR6LWIZI6FLFGJLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:43.488315198 (110h7m31.185883505s) [noise=true , address=81.171.14.70:4040 , piece_id=WGBE4UIBTC7XEAT2QNJIZBTLSEGQH5HT6KSEC3ML6Y5Z7OI4YMVA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:51.974826346 (110h7m39.672394662s) [noise=true , address=89.149.201.147:4017 , piece_id=ESM6BDBHOTQQUZECBEYOFXEZNMPXIGZZYUS7Y6EXFWBZ4WVFTFUA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974841284 (110h7m39.672409589s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection
Dec 10 05:36:51.974903630 (110h7m39.672471946s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974922165 (110h7m39.672490481s) [seg_pos={0 0}, upload=96631]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Dec 10 05:36:52.071976396 (110h7m39.769544712s) [upload=96631]: Done uploading segments...
Dec 10 05:36:52.072005610 (110h7m39.769573927s) [upload=96631]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.617811257s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
1.725622501s trace:
https://jaeger.dev.storj.io/trace/576e3c37403ea2f0
FAIL (2025-12-10 05:53:42 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 53)
Duration: 1.725646617s
core
uplink
us1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
4.382393795s trace:
https://jaeger.dev.storj.io/trace/90b6829c07b062b
FAIL (2025-12-10 05:53:03 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 50)
Duration: 4.382411628s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
1.626178736s trace:
https://jaeger.dev.storj.io/trace/576e3c37403ea2f0
FAIL (2025-12-10 05:52:51 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 53)
Duration: 1.626192432s
core
uplink
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
2.261210206s trace:
https://jaeger.dev.storj.io/trace/78954e68dc28a6f0
FAIL (2025-12-10 05:52:44 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
32FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483286769 (110h6m40.180855105s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483441889 (110h6m40.181010225s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484188893 (110h6m40.18175724s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484360284 (110h6m40.18192862s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484899961 (110h6m40.182468308s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485473173 (110h6m40.183041519s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485588187 (110h6m40.183156534s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486286061 (110h6m40.183854397s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486614144 (110h6m40.18418248s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486972244 (110h6m40.184540579s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.487764232 (110h6m40.185332569s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.488611475 (110h6m40.186179862s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:56.532754683 (110h6m44.230323019s) [upload=96631]: Next returned nil segment
Dec 10 05:35:56.532767777 (110h6m44.230336114s) [upload=96631]: Waiting for error group managing segments...
Dec 10 05:36:03.072814336 (110h6m50.770382652s) [noise=true , address=81.171.14.70:4033 , piece_id=A7M7632FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:10.426278146 (110h6m58.123846453s) [noise=true , address=185.167.204.205:4003 , piece_id=C6QVIOWAWPAFTTEGTU67E5S2G3F2YNEMN7ZOYJHO7V5DZTJNHBHA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:13.352409435 (110h7m1.049977751s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:15.264994828 (110h7m2.962563144s) [noise=true , address=89.149.201.147:4014 , piece_id=FUWY5JUHVSRU2T7F6FRLNXPHHG7BDCNRXDCYAO26VEURJLYVAURQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:17.549961624 (110h7m5.24752993s) [noise=true , address=81.171.14.70:4031 , piece_id=3OKFG434PBYJ3SPU6KMJ42JH2ASMSDYLC3SCHPVYLJMH5ONMRBJQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:19.306486817 (110h7m7.004055133s) [noise=true , address=185.167.204.205:4027 , piece_id=6NJYN7KJKTEVYCSNQA6HQGU33NCRYDQ46FJFSG6BIQU4LZLEJNJA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.162049031 (110h7m10.859617337s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.737363060 (110h7m11.434931366s) [noise=true , address=185.167.204.205:4032 , piece_id=ZSZ2K73DHDZYFLWQRMDRBE7HVHDEXWA7K4EUNPGIVXFAHCVUKTLA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.786449800 (110h7m11.484018106s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.060159042 (110h7m11.757727358s) [noise=true , address=185.167.204.206:4038 , piece_id=CBND4CAULWE26NIGWFT7DSTQ4WJ4UOGPGPTY2O3TC53QLH3E7RPQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.094361490 (110h7m11.791929795s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.798040935 (110h7m12.495609251s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.378916283 (110h7m13.076484589s) [noise=true , address=89.149.201.147:4021 , piece_id=BEYZFIFW3J5SRMA3TGXM2TL6E6G7NP4Y4ZY7ZG4B7HBZMRW524IA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.827775932 (110h7m13.525344269s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.877397152 (110h7m13.574965468s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.944028435 (110h7m13.641596771s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:26.560902894 (110h7m14.2584712s) [noise=true , address=89.149.201.147:4016 , piece_id=AG43SI5LEABCPKL7BAK2K7OJ4TVXYUIPUS7TVYC5NUQNUQQB5NOA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.812203200 (110h7m15.509771516s) [noise=true , address=89.149.201.147:4023 , piece_id=BI6SXMTHJ5KYB3556G4U6UYG5HRNK5EH64LNT42V3AFNARG5O7LA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.867169354 (110h7m15.56473767s) [noise=true , address=89.149.201.147:4006 , piece_id=UEKDVE6NDKI4NV7HD4AKUH4HNYVRF3C7SPIN26KDK5NX6J4NBQ5Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:29.445827111 (110h7m17.143395446s) [noise=true , address=185.167.204.205:4008 , piece_id=PZIHSKHE4CALB2V3LHWAX5X6BMMQMSMFWM47MIGVH64G2ZLPMRTQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:32.512177560 (110h7m20.209745866s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:35.825912333 (110h7m23.523480649s) [noise=true , address=81.171.14.70:4027 , piece_id=X46BF2SMXFGBFRWBG3TN45CSU2V66GVOXQAHTR42H2QVOTRA36OA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.223889733 (110h7m28.92145804s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.243892176 (110h7m28.941460483s) [noise=true , address=185.167.204.205:4031 , piece_id=EQZNQZ4BMWYSUX5IKBL2MMX5DPQN5XI4QUIKFR6LWIZI6FLFGJLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:43.488315198 (110h7m31.185883505s) [noise=true , address=81.171.14.70:4040 , piece_id=WGBE4UIBTC7XEAT2QNJIZBTLSEGQH5HT6KSEC3ML6Y5Z7OI4YMVA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:51.974826346 (110h7m39.672394662s) [noise=true , address=89.149.201.147:4017 , piece_id=ESM6BDBHOTQQUZECBEYOFXEZNMPXIGZZYUS7Y6EXFWBZ4WVFTFUA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974841284 (110h7m39.672409589s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection
Dec 10 05:36:51.974903630 (110h7m39.672471946s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974922165 (110h7m39.672490481s) [seg_pos={0 0}, upload=96631]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Dec 10 05:36:52.071976396 (110h7m39.769544712s) [upload=96631]: Done uploading segments...
Dec 10 05:36:52.072005610 (110h7m39.769573927s) [upload=96631]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.261226597s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
4.394428967s trace:
https://jaeger.dev.storj.io/trace/90b6829c07b062b
FAIL (2025-12-10 05:52:42 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 50)
Duration: 4.394448833s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
4.518344982s trace:
https://jaeger.dev.storj.io/trace/90b6829c07b062b
FAIL (2025-12-10 05:52:18 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 50)
Duration: 4.518360972s
core
uplink
ap1
|