Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
2.615006062s trace:
https://jaeger.dev.storj.io/trace/78954e68dc28a6f0
FAIL (2025-12-10 06:16:24 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
32FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483286769 (110h6m40.180855105s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483441889 (110h6m40.181010225s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484188893 (110h6m40.18175724s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484360284 (110h6m40.18192862s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484899961 (110h6m40.182468308s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485473173 (110h6m40.183041519s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485588187 (110h6m40.183156534s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486286061 (110h6m40.183854397s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486614144 (110h6m40.18418248s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486972244 (110h6m40.184540579s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.487764232 (110h6m40.185332569s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.488611475 (110h6m40.186179862s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:56.532754683 (110h6m44.230323019s) [upload=96631]: Next returned nil segment
Dec 10 05:35:56.532767777 (110h6m44.230336114s) [upload=96631]: Waiting for error group managing segments...
Dec 10 05:36:03.072814336 (110h6m50.770382652s) [noise=true , address=81.171.14.70:4033 , piece_id=A7M7632FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:10.426278146 (110h6m58.123846453s) [noise=true , address=185.167.204.205:4003 , piece_id=C6QVIOWAWPAFTTEGTU67E5S2G3F2YNEMN7ZOYJHO7V5DZTJNHBHA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:13.352409435 (110h7m1.049977751s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:15.264994828 (110h7m2.962563144s) [noise=true , address=89.149.201.147:4014 , piece_id=FUWY5JUHVSRU2T7F6FRLNXPHHG7BDCNRXDCYAO26VEURJLYVAURQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:17.549961624 (110h7m5.24752993s) [noise=true , address=81.171.14.70:4031 , piece_id=3OKFG434PBYJ3SPU6KMJ42JH2ASMSDYLC3SCHPVYLJMH5ONMRBJQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:19.306486817 (110h7m7.004055133s) [noise=true , address=185.167.204.205:4027 , piece_id=6NJYN7KJKTEVYCSNQA6HQGU33NCRYDQ46FJFSG6BIQU4LZLEJNJA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.162049031 (110h7m10.859617337s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.737363060 (110h7m11.434931366s) [noise=true , address=185.167.204.205:4032 , piece_id=ZSZ2K73DHDZYFLWQRMDRBE7HVHDEXWA7K4EUNPGIVXFAHCVUKTLA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.786449800 (110h7m11.484018106s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.060159042 (110h7m11.757727358s) [noise=true , address=185.167.204.206:4038 , piece_id=CBND4CAULWE26NIGWFT7DSTQ4WJ4UOGPGPTY2O3TC53QLH3E7RPQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.094361490 (110h7m11.791929795s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.798040935 (110h7m12.495609251s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.378916283 (110h7m13.076484589s) [noise=true , address=89.149.201.147:4021 , piece_id=BEYZFIFW3J5SRMA3TGXM2TL6E6G7NP4Y4ZY7ZG4B7HBZMRW524IA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.827775932 (110h7m13.525344269s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.877397152 (110h7m13.574965468s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.944028435 (110h7m13.641596771s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:26.560902894 (110h7m14.2584712s) [noise=true , address=89.149.201.147:4016 , piece_id=AG43SI5LEABCPKL7BAK2K7OJ4TVXYUIPUS7TVYC5NUQNUQQB5NOA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.812203200 (110h7m15.509771516s) [noise=true , address=89.149.201.147:4023 , piece_id=BI6SXMTHJ5KYB3556G4U6UYG5HRNK5EH64LNT42V3AFNARG5O7LA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.867169354 (110h7m15.56473767s) [noise=true , address=89.149.201.147:4006 , piece_id=UEKDVE6NDKI4NV7HD4AKUH4HNYVRF3C7SPIN26KDK5NX6J4NBQ5Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:29.445827111 (110h7m17.143395446s) [noise=true , address=185.167.204.205:4008 , piece_id=PZIHSKHE4CALB2V3LHWAX5X6BMMQMSMFWM47MIGVH64G2ZLPMRTQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:32.512177560 (110h7m20.209745866s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:35.825912333 (110h7m23.523480649s) [noise=true , address=81.171.14.70:4027 , piece_id=X46BF2SMXFGBFRWBG3TN45CSU2V66GVOXQAHTR42H2QVOTRA36OA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.223889733 (110h7m28.92145804s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.243892176 (110h7m28.941460483s) [noise=true , address=185.167.204.205:4031 , piece_id=EQZNQZ4BMWYSUX5IKBL2MMX5DPQN5XI4QUIKFR6LWIZI6FLFGJLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:43.488315198 (110h7m31.185883505s) [noise=true , address=81.171.14.70:4040 , piece_id=WGBE4UIBTC7XEAT2QNJIZBTLSEGQH5HT6KSEC3ML6Y5Z7OI4YMVA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:51.974826346 (110h7m39.672394662s) [noise=true , address=89.149.201.147:4017 , piece_id=ESM6BDBHOTQQUZECBEYOFXEZNMPXIGZZYUS7Y6EXFWBZ4WVFTFUA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974841284 (110h7m39.672409589s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection
Dec 10 05:36:51.974903630 (110h7m39.672471946s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974922165 (110h7m39.672490481s) [seg_pos={0 0}, upload=96631]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Dec 10 05:36:52.071976396 (110h7m39.769544712s) [upload=96631]: Done uploading segments...
Dec 10 05:36:52.072005610 (110h7m39.769573927s) [upload=96631]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.615029867s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
1.659253938s trace:
https://jaeger.dev.storj.io/trace/576e3c37403ea2f0
FAIL (2025-12-10 06:16:19 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 53)
Duration: 1.659273875s
core
uplink
us1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.........................................................X..] duration:
9.203395677s remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/547ba7d8bb5b781f
FAIL (2025-12-10 06:16:17 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 9.203417006s
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [..........................................................X.] duration:
154.026941ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/547ba7d8bb5b781f
FAIL (2025-12-10 06:15:44 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 154.039794ms
edge
linksharing
bgp
eu1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
4.66598786s trace:
https://jaeger.dev.storj.io/trace/90b6829c07b062b
FAIL (2025-12-10 06:15:35 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 50)
Duration: 4.666004902s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
2.649719917s trace:
https://jaeger.dev.storj.io/trace/78954e68dc28a6f0
FAIL (2025-12-10 06:15:24 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
32FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483286769 (110h6m40.180855105s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483441889 (110h6m40.181010225s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484188893 (110h6m40.18175724s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484360284 (110h6m40.18192862s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484899961 (110h6m40.182468308s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485473173 (110h6m40.183041519s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485588187 (110h6m40.183156534s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486286061 (110h6m40.183854397s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486614144 (110h6m40.18418248s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486972244 (110h6m40.184540579s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.487764232 (110h6m40.185332569s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.488611475 (110h6m40.186179862s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:56.532754683 (110h6m44.230323019s) [upload=96631]: Next returned nil segment
Dec 10 05:35:56.532767777 (110h6m44.230336114s) [upload=96631]: Waiting for error group managing segments...
Dec 10 05:36:03.072814336 (110h6m50.770382652s) [noise=true , address=81.171.14.70:4033 , piece_id=A7M7632FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:10.426278146 (110h6m58.123846453s) [noise=true , address=185.167.204.205:4003 , piece_id=C6QVIOWAWPAFTTEGTU67E5S2G3F2YNEMN7ZOYJHO7V5DZTJNHBHA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:13.352409435 (110h7m1.049977751s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:15.264994828 (110h7m2.962563144s) [noise=true , address=89.149.201.147:4014 , piece_id=FUWY5JUHVSRU2T7F6FRLNXPHHG7BDCNRXDCYAO26VEURJLYVAURQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:17.549961624 (110h7m5.24752993s) [noise=true , address=81.171.14.70:4031 , piece_id=3OKFG434PBYJ3SPU6KMJ42JH2ASMSDYLC3SCHPVYLJMH5ONMRBJQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:19.306486817 (110h7m7.004055133s) [noise=true , address=185.167.204.205:4027 , piece_id=6NJYN7KJKTEVYCSNQA6HQGU33NCRYDQ46FJFSG6BIQU4LZLEJNJA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.162049031 (110h7m10.859617337s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.737363060 (110h7m11.434931366s) [noise=true , address=185.167.204.205:4032 , piece_id=ZSZ2K73DHDZYFLWQRMDRBE7HVHDEXWA7K4EUNPGIVXFAHCVUKTLA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.786449800 (110h7m11.484018106s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.060159042 (110h7m11.757727358s) [noise=true , address=185.167.204.206:4038 , piece_id=CBND4CAULWE26NIGWFT7DSTQ4WJ4UOGPGPTY2O3TC53QLH3E7RPQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.094361490 (110h7m11.791929795s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.798040935 (110h7m12.495609251s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.378916283 (110h7m13.076484589s) [noise=true , address=89.149.201.147:4021 , piece_id=BEYZFIFW3J5SRMA3TGXM2TL6E6G7NP4Y4ZY7ZG4B7HBZMRW524IA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.827775932 (110h7m13.525344269s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.877397152 (110h7m13.574965468s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.944028435 (110h7m13.641596771s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:26.560902894 (110h7m14.2584712s) [noise=true , address=89.149.201.147:4016 , piece_id=AG43SI5LEABCPKL7BAK2K7OJ4TVXYUIPUS7TVYC5NUQNUQQB5NOA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.812203200 (110h7m15.509771516s) [noise=true , address=89.149.201.147:4023 , piece_id=BI6SXMTHJ5KYB3556G4U6UYG5HRNK5EH64LNT42V3AFNARG5O7LA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.867169354 (110h7m15.56473767s) [noise=true , address=89.149.201.147:4006 , piece_id=UEKDVE6NDKI4NV7HD4AKUH4HNYVRF3C7SPIN26KDK5NX6J4NBQ5Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:29.445827111 (110h7m17.143395446s) [noise=true , address=185.167.204.205:4008 , piece_id=PZIHSKHE4CALB2V3LHWAX5X6BMMQMSMFWM47MIGVH64G2ZLPMRTQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:32.512177560 (110h7m20.209745866s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:35.825912333 (110h7m23.523480649s) [noise=true , address=81.171.14.70:4027 , piece_id=X46BF2SMXFGBFRWBG3TN45CSU2V66GVOXQAHTR42H2QVOTRA36OA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.223889733 (110h7m28.92145804s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.243892176 (110h7m28.941460483s) [noise=true , address=185.167.204.205:4031 , piece_id=EQZNQZ4BMWYSUX5IKBL2MMX5DPQN5XI4QUIKFR6LWIZI6FLFGJLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:43.488315198 (110h7m31.185883505s) [noise=true , address=81.171.14.70:4040 , piece_id=WGBE4UIBTC7XEAT2QNJIZBTLSEGQH5HT6KSEC3ML6Y5Z7OI4YMVA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:51.974826346 (110h7m39.672394662s) [noise=true , address=89.149.201.147:4017 , piece_id=ESM6BDBHOTQQUZECBEYOFXEZNMPXIGZZYUS7Y6EXFWBZ4WVFTFUA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974841284 (110h7m39.672409589s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection
Dec 10 05:36:51.974903630 (110h7m39.672471946s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974922165 (110h7m39.672490481s) [seg_pos={0 0}, upload=96631]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Dec 10 05:36:52.071976396 (110h7m39.769544712s) [upload=96631]: Done uploading segments...
Dec 10 05:36:52.072005610 (110h7m39.769573927s) [upload=96631]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.649740556s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
1.624316597s trace:
https://jaeger.dev.storj.io/trace/576e3c37403ea2f0
FAIL (2025-12-10 06:15:22 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 53)
Duration: 1.624338508s
core
uplink
us1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
4.431135933s trace:
https://jaeger.dev.storj.io/trace/90b6829c07b062b
FAIL (2025-12-10 06:14:58 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 50)
Duration: 4.43115603s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
1.592191429s trace:
https://jaeger.dev.storj.io/trace/576e3c37403ea2f0
FAIL (2025-12-10 06:14:47 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 53)
Duration: 1.592201998s
core
uplink
us1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
4.516487697s trace:
https://jaeger.dev.storj.io/trace/90b6829c07b062b
FAIL (2025-12-10 06:14:31 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 50)
Duration: 4.516511811s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
2.659500686s trace:
https://jaeger.dev.storj.io/trace/78954e68dc28a6f0
FAIL (2025-12-10 06:14:14 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
32FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483286769 (110h6m40.180855105s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483441889 (110h6m40.181010225s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484188893 (110h6m40.18175724s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484360284 (110h6m40.18192862s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484899961 (110h6m40.182468308s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485473173 (110h6m40.183041519s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485588187 (110h6m40.183156534s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486286061 (110h6m40.183854397s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486614144 (110h6m40.18418248s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486972244 (110h6m40.184540579s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.487764232 (110h6m40.185332569s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.488611475 (110h6m40.186179862s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:56.532754683 (110h6m44.230323019s) [upload=96631]: Next returned nil segment
Dec 10 05:35:56.532767777 (110h6m44.230336114s) [upload=96631]: Waiting for error group managing segments...
Dec 10 05:36:03.072814336 (110h6m50.770382652s) [noise=true , address=81.171.14.70:4033 , piece_id=A7M7632FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:10.426278146 (110h6m58.123846453s) [noise=true , address=185.167.204.205:4003 , piece_id=C6QVIOWAWPAFTTEGTU67E5S2G3F2YNEMN7ZOYJHO7V5DZTJNHBHA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:13.352409435 (110h7m1.049977751s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:15.264994828 (110h7m2.962563144s) [noise=true , address=89.149.201.147:4014 , piece_id=FUWY5JUHVSRU2T7F6FRLNXPHHG7BDCNRXDCYAO26VEURJLYVAURQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:17.549961624 (110h7m5.24752993s) [noise=true , address=81.171.14.70:4031 , piece_id=3OKFG434PBYJ3SPU6KMJ42JH2ASMSDYLC3SCHPVYLJMH5ONMRBJQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:19.306486817 (110h7m7.004055133s) [noise=true , address=185.167.204.205:4027 , piece_id=6NJYN7KJKTEVYCSNQA6HQGU33NCRYDQ46FJFSG6BIQU4LZLEJNJA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.162049031 (110h7m10.859617337s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.737363060 (110h7m11.434931366s) [noise=true , address=185.167.204.205:4032 , piece_id=ZSZ2K73DHDZYFLWQRMDRBE7HVHDEXWA7K4EUNPGIVXFAHCVUKTLA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.786449800 (110h7m11.484018106s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.060159042 (110h7m11.757727358s) [noise=true , address=185.167.204.206:4038 , piece_id=CBND4CAULWE26NIGWFT7DSTQ4WJ4UOGPGPTY2O3TC53QLH3E7RPQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.094361490 (110h7m11.791929795s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.798040935 (110h7m12.495609251s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.378916283 (110h7m13.076484589s) [noise=true , address=89.149.201.147:4021 , piece_id=BEYZFIFW3J5SRMA3TGXM2TL6E6G7NP4Y4ZY7ZG4B7HBZMRW524IA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.827775932 (110h7m13.525344269s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.877397152 (110h7m13.574965468s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.944028435 (110h7m13.641596771s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:26.560902894 (110h7m14.2584712s) [noise=true , address=89.149.201.147:4016 , piece_id=AG43SI5LEABCPKL7BAK2K7OJ4TVXYUIPUS7TVYC5NUQNUQQB5NOA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.812203200 (110h7m15.509771516s) [noise=true , address=89.149.201.147:4023 , piece_id=BI6SXMTHJ5KYB3556G4U6UYG5HRNK5EH64LNT42V3AFNARG5O7LA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.867169354 (110h7m15.56473767s) [noise=true , address=89.149.201.147:4006 , piece_id=UEKDVE6NDKI4NV7HD4AKUH4HNYVRF3C7SPIN26KDK5NX6J4NBQ5Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:29.445827111 (110h7m17.143395446s) [noise=true , address=185.167.204.205:4008 , piece_id=PZIHSKHE4CALB2V3LHWAX5X6BMMQMSMFWM47MIGVH64G2ZLPMRTQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:32.512177560 (110h7m20.209745866s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:35.825912333 (110h7m23.523480649s) [noise=true , address=81.171.14.70:4027 , piece_id=X46BF2SMXFGBFRWBG3TN45CSU2V66GVOXQAHTR42H2QVOTRA36OA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.223889733 (110h7m28.92145804s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.243892176 (110h7m28.941460483s) [noise=true , address=185.167.204.205:4031 , piece_id=EQZNQZ4BMWYSUX5IKBL2MMX5DPQN5XI4QUIKFR6LWIZI6FLFGJLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:43.488315198 (110h7m31.185883505s) [noise=true , address=81.171.14.70:4040 , piece_id=WGBE4UIBTC7XEAT2QNJIZBTLSEGQH5HT6KSEC3ML6Y5Z7OI4YMVA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:51.974826346 (110h7m39.672394662s) [noise=true , address=89.149.201.147:4017 , piece_id=ESM6BDBHOTQQUZECBEYOFXEZNMPXIGZZYUS7Y6EXFWBZ4WVFTFUA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974841284 (110h7m39.672409589s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection
Dec 10 05:36:51.974903630 (110h7m39.672471946s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974922165 (110h7m39.672490481s) [seg_pos={0 0}, upload=96631]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Dec 10 05:36:52.071976396 (110h7m39.769544712s) [upload=96631]: Done uploading segments...
Dec 10 05:36:52.072005610 (110h7m39.769573927s) [upload=96631]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.659516937s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
4.632120844s trace:
https://jaeger.dev.storj.io/trace/90b6829c07b062b
FAIL (2025-12-10 06:13:56 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 50)
Duration: 4.632160288s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
1.576768261s trace:
https://jaeger.dev.storj.io/trace/576e3c37403ea2f0
FAIL (2025-12-10 06:13:33 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 53)
Duration: 1.57678446s
core
uplink
us1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
4.415010869s trace:
https://jaeger.dev.storj.io/trace/90b6829c07b062b
FAIL (2025-12-10 06:13:25 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 50)
Duration: 4.415027912s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
2.614370449s trace:
https://jaeger.dev.storj.io/trace/78954e68dc28a6f0
FAIL (2025-12-10 06:13:14 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
32FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483286769 (110h6m40.180855105s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483441889 (110h6m40.181010225s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484188893 (110h6m40.18175724s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484360284 (110h6m40.18192862s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484899961 (110h6m40.182468308s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485473173 (110h6m40.183041519s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485588187 (110h6m40.183156534s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486286061 (110h6m40.183854397s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486614144 (110h6m40.18418248s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486972244 (110h6m40.184540579s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.487764232 (110h6m40.185332569s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.488611475 (110h6m40.186179862s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:56.532754683 (110h6m44.230323019s) [upload=96631]: Next returned nil segment
Dec 10 05:35:56.532767777 (110h6m44.230336114s) [upload=96631]: Waiting for error group managing segments...
Dec 10 05:36:03.072814336 (110h6m50.770382652s) [noise=true , address=81.171.14.70:4033 , piece_id=A7M7632FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:10.426278146 (110h6m58.123846453s) [noise=true , address=185.167.204.205:4003 , piece_id=C6QVIOWAWPAFTTEGTU67E5S2G3F2YNEMN7ZOYJHO7V5DZTJNHBHA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:13.352409435 (110h7m1.049977751s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:15.264994828 (110h7m2.962563144s) [noise=true , address=89.149.201.147:4014 , piece_id=FUWY5JUHVSRU2T7F6FRLNXPHHG7BDCNRXDCYAO26VEURJLYVAURQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:17.549961624 (110h7m5.24752993s) [noise=true , address=81.171.14.70:4031 , piece_id=3OKFG434PBYJ3SPU6KMJ42JH2ASMSDYLC3SCHPVYLJMH5ONMRBJQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:19.306486817 (110h7m7.004055133s) [noise=true , address=185.167.204.205:4027 , piece_id=6NJYN7KJKTEVYCSNQA6HQGU33NCRYDQ46FJFSG6BIQU4LZLEJNJA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.162049031 (110h7m10.859617337s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.737363060 (110h7m11.434931366s) [noise=true , address=185.167.204.205:4032 , piece_id=ZSZ2K73DHDZYFLWQRMDRBE7HVHDEXWA7K4EUNPGIVXFAHCVUKTLA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.786449800 (110h7m11.484018106s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.060159042 (110h7m11.757727358s) [noise=true , address=185.167.204.206:4038 , piece_id=CBND4CAULWE26NIGWFT7DSTQ4WJ4UOGPGPTY2O3TC53QLH3E7RPQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.094361490 (110h7m11.791929795s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.798040935 (110h7m12.495609251s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.378916283 (110h7m13.076484589s) [noise=true , address=89.149.201.147:4021 , piece_id=BEYZFIFW3J5SRMA3TGXM2TL6E6G7NP4Y4ZY7ZG4B7HBZMRW524IA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.827775932 (110h7m13.525344269s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.877397152 (110h7m13.574965468s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.944028435 (110h7m13.641596771s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:26.560902894 (110h7m14.2584712s) [noise=true , address=89.149.201.147:4016 , piece_id=AG43SI5LEABCPKL7BAK2K7OJ4TVXYUIPUS7TVYC5NUQNUQQB5NOA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.812203200 (110h7m15.509771516s) [noise=true , address=89.149.201.147:4023 , piece_id=BI6SXMTHJ5KYB3556G4U6UYG5HRNK5EH64LNT42V3AFNARG5O7LA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.867169354 (110h7m15.56473767s) [noise=true , address=89.149.201.147:4006 , piece_id=UEKDVE6NDKI4NV7HD4AKUH4HNYVRF3C7SPIN26KDK5NX6J4NBQ5Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:29.445827111 (110h7m17.143395446s) [noise=true , address=185.167.204.205:4008 , piece_id=PZIHSKHE4CALB2V3LHWAX5X6BMMQMSMFWM47MIGVH64G2ZLPMRTQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:32.512177560 (110h7m20.209745866s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:35.825912333 (110h7m23.523480649s) [noise=true , address=81.171.14.70:4027 , piece_id=X46BF2SMXFGBFRWBG3TN45CSU2V66GVOXQAHTR42H2QVOTRA36OA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.223889733 (110h7m28.92145804s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.243892176 (110h7m28.941460483s) [noise=true , address=185.167.204.205:4031 , piece_id=EQZNQZ4BMWYSUX5IKBL2MMX5DPQN5XI4QUIKFR6LWIZI6FLFGJLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:43.488315198 (110h7m31.185883505s) [noise=true , address=81.171.14.70:4040 , piece_id=WGBE4UIBTC7XEAT2QNJIZBTLSEGQH5HT6KSEC3ML6Y5Z7OI4YMVA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:51.974826346 (110h7m39.672394662s) [noise=true , address=89.149.201.147:4017 , piece_id=ESM6BDBHOTQQUZECBEYOFXEZNMPXIGZZYUS7Y6EXFWBZ4WVFTFUA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974841284 (110h7m39.672409589s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection
Dec 10 05:36:51.974903630 (110h7m39.672471946s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974922165 (110h7m39.672490481s) [seg_pos={0 0}, upload=96631]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Dec 10 05:36:52.071976396 (110h7m39.769544712s) [upload=96631]: Done uploading segments...
Dec 10 05:36:52.072005610 (110h7m39.769573927s) [upload=96631]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.614390507s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
1.759389623s trace:
https://jaeger.dev.storj.io/trace/576e3c37403ea2f0
FAIL (2025-12-10 06:12:35 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 53)
Duration: 1.759406854s
core
uplink
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
2.308286993s trace:
https://jaeger.dev.storj.io/trace/78954e68dc28a6f0
FAIL (2025-12-10 06:12:29 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
32FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483286769 (110h6m40.180855105s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483441889 (110h6m40.181010225s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484188893 (110h6m40.18175724s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484360284 (110h6m40.18192862s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484899961 (110h6m40.182468308s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485473173 (110h6m40.183041519s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485588187 (110h6m40.183156534s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486286061 (110h6m40.183854397s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486614144 (110h6m40.18418248s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486972244 (110h6m40.184540579s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.487764232 (110h6m40.185332569s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.488611475 (110h6m40.186179862s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:56.532754683 (110h6m44.230323019s) [upload=96631]: Next returned nil segment
Dec 10 05:35:56.532767777 (110h6m44.230336114s) [upload=96631]: Waiting for error group managing segments...
Dec 10 05:36:03.072814336 (110h6m50.770382652s) [noise=true , address=81.171.14.70:4033 , piece_id=A7M7632FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:10.426278146 (110h6m58.123846453s) [noise=true , address=185.167.204.205:4003 , piece_id=C6QVIOWAWPAFTTEGTU67E5S2G3F2YNEMN7ZOYJHO7V5DZTJNHBHA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:13.352409435 (110h7m1.049977751s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:15.264994828 (110h7m2.962563144s) [noise=true , address=89.149.201.147:4014 , piece_id=FUWY5JUHVSRU2T7F6FRLNXPHHG7BDCNRXDCYAO26VEURJLYVAURQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:17.549961624 (110h7m5.24752993s) [noise=true , address=81.171.14.70:4031 , piece_id=3OKFG434PBYJ3SPU6KMJ42JH2ASMSDYLC3SCHPVYLJMH5ONMRBJQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:19.306486817 (110h7m7.004055133s) [noise=true , address=185.167.204.205:4027 , piece_id=6NJYN7KJKTEVYCSNQA6HQGU33NCRYDQ46FJFSG6BIQU4LZLEJNJA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.162049031 (110h7m10.859617337s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.737363060 (110h7m11.434931366s) [noise=true , address=185.167.204.205:4032 , piece_id=ZSZ2K73DHDZYFLWQRMDRBE7HVHDEXWA7K4EUNPGIVXFAHCVUKTLA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.786449800 (110h7m11.484018106s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.060159042 (110h7m11.757727358s) [noise=true , address=185.167.204.206:4038 , piece_id=CBND4CAULWE26NIGWFT7DSTQ4WJ4UOGPGPTY2O3TC53QLH3E7RPQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.094361490 (110h7m11.791929795s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.798040935 (110h7m12.495609251s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.378916283 (110h7m13.076484589s) [noise=true , address=89.149.201.147:4021 , piece_id=BEYZFIFW3J5SRMA3TGXM2TL6E6G7NP4Y4ZY7ZG4B7HBZMRW524IA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.827775932 (110h7m13.525344269s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.877397152 (110h7m13.574965468s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.944028435 (110h7m13.641596771s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:26.560902894 (110h7m14.2584712s) [noise=true , address=89.149.201.147:4016 , piece_id=AG43SI5LEABCPKL7BAK2K7OJ4TVXYUIPUS7TVYC5NUQNUQQB5NOA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.812203200 (110h7m15.509771516s) [noise=true , address=89.149.201.147:4023 , piece_id=BI6SXMTHJ5KYB3556G4U6UYG5HRNK5EH64LNT42V3AFNARG5O7LA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.867169354 (110h7m15.56473767s) [noise=true , address=89.149.201.147:4006 , piece_id=UEKDVE6NDKI4NV7HD4AKUH4HNYVRF3C7SPIN26KDK5NX6J4NBQ5Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:29.445827111 (110h7m17.143395446s) [noise=true , address=185.167.204.205:4008 , piece_id=PZIHSKHE4CALB2V3LHWAX5X6BMMQMSMFWM47MIGVH64G2ZLPMRTQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:32.512177560 (110h7m20.209745866s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:35.825912333 (110h7m23.523480649s) [noise=true , address=81.171.14.70:4027 , piece_id=X46BF2SMXFGBFRWBG3TN45CSU2V66GVOXQAHTR42H2QVOTRA36OA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.223889733 (110h7m28.92145804s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.243892176 (110h7m28.941460483s) [noise=true , address=185.167.204.205:4031 , piece_id=EQZNQZ4BMWYSUX5IKBL2MMX5DPQN5XI4QUIKFR6LWIZI6FLFGJLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:43.488315198 (110h7m31.185883505s) [noise=true , address=81.171.14.70:4040 , piece_id=WGBE4UIBTC7XEAT2QNJIZBTLSEGQH5HT6KSEC3ML6Y5Z7OI4YMVA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:51.974826346 (110h7m39.672394662s) [noise=true , address=89.149.201.147:4017 , piece_id=ESM6BDBHOTQQUZECBEYOFXEZNMPXIGZZYUS7Y6EXFWBZ4WVFTFUA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974841284 (110h7m39.672409589s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection
Dec 10 05:36:51.974903630 (110h7m39.672471946s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974922165 (110h7m39.672490481s) [seg_pos={0 0}, upload=96631]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Dec 10 05:36:52.071976396 (110h7m39.769544712s) [upload=96631]: Done uploading segments...
Dec 10 05:36:52.072005610 (110h7m39.769573927s) [upload=96631]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.308300318s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
4.838553742s trace:
https://jaeger.dev.storj.io/trace/90b6829c07b062b
FAIL (2025-12-10 06:12:16 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 50)
Duration: 4.8385743s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
1.700649901s trace:
https://jaeger.dev.storj.io/trace/576e3c37403ea2f0
FAIL (2025-12-10 06:12:13 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 53)
Duration: 1.700673364s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
1.744383252s trace:
https://jaeger.dev.storj.io/trace/576e3c37403ea2f0
FAIL (2025-12-10 06:11:57 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 53)
Duration: 1.744405914s
core
uplink
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
2.606731287s trace:
https://jaeger.dev.storj.io/trace/78954e68dc28a6f0
FAIL (2025-12-10 06:11:39 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
32FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483286769 (110h6m40.180855105s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483441889 (110h6m40.181010225s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484188893 (110h6m40.18175724s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484360284 (110h6m40.18192862s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484899961 (110h6m40.182468308s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485473173 (110h6m40.183041519s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485588187 (110h6m40.183156534s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486286061 (110h6m40.183854397s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486614144 (110h6m40.18418248s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486972244 (110h6m40.184540579s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.487764232 (110h6m40.185332569s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.488611475 (110h6m40.186179862s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:56.532754683 (110h6m44.230323019s) [upload=96631]: Next returned nil segment
Dec 10 05:35:56.532767777 (110h6m44.230336114s) [upload=96631]: Waiting for error group managing segments...
Dec 10 05:36:03.072814336 (110h6m50.770382652s) [noise=true , address=81.171.14.70:4033 , piece_id=A7M7632FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:10.426278146 (110h6m58.123846453s) [noise=true , address=185.167.204.205:4003 , piece_id=C6QVIOWAWPAFTTEGTU67E5S2G3F2YNEMN7ZOYJHO7V5DZTJNHBHA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:13.352409435 (110h7m1.049977751s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:15.264994828 (110h7m2.962563144s) [noise=true , address=89.149.201.147:4014 , piece_id=FUWY5JUHVSRU2T7F6FRLNXPHHG7BDCNRXDCYAO26VEURJLYVAURQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:17.549961624 (110h7m5.24752993s) [noise=true , address=81.171.14.70:4031 , piece_id=3OKFG434PBYJ3SPU6KMJ42JH2ASMSDYLC3SCHPVYLJMH5ONMRBJQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:19.306486817 (110h7m7.004055133s) [noise=true , address=185.167.204.205:4027 , piece_id=6NJYN7KJKTEVYCSNQA6HQGU33NCRYDQ46FJFSG6BIQU4LZLEJNJA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.162049031 (110h7m10.859617337s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.737363060 (110h7m11.434931366s) [noise=true , address=185.167.204.205:4032 , piece_id=ZSZ2K73DHDZYFLWQRMDRBE7HVHDEXWA7K4EUNPGIVXFAHCVUKTLA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.786449800 (110h7m11.484018106s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.060159042 (110h7m11.757727358s) [noise=true , address=185.167.204.206:4038 , piece_id=CBND4CAULWE26NIGWFT7DSTQ4WJ4UOGPGPTY2O3TC53QLH3E7RPQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.094361490 (110h7m11.791929795s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.798040935 (110h7m12.495609251s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.378916283 (110h7m13.076484589s) [noise=true , address=89.149.201.147:4021 , piece_id=BEYZFIFW3J5SRMA3TGXM2TL6E6G7NP4Y4ZY7ZG4B7HBZMRW524IA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.827775932 (110h7m13.525344269s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.877397152 (110h7m13.574965468s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.944028435 (110h7m13.641596771s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:26.560902894 (110h7m14.2584712s) [noise=true , address=89.149.201.147:4016 , piece_id=AG43SI5LEABCPKL7BAK2K7OJ4TVXYUIPUS7TVYC5NUQNUQQB5NOA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.812203200 (110h7m15.509771516s) [noise=true , address=89.149.201.147:4023 , piece_id=BI6SXMTHJ5KYB3556G4U6UYG5HRNK5EH64LNT42V3AFNARG5O7LA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.867169354 (110h7m15.56473767s) [noise=true , address=89.149.201.147:4006 , piece_id=UEKDVE6NDKI4NV7HD4AKUH4HNYVRF3C7SPIN26KDK5NX6J4NBQ5Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:29.445827111 (110h7m17.143395446s) [noise=true , address=185.167.204.205:4008 , piece_id=PZIHSKHE4CALB2V3LHWAX5X6BMMQMSMFWM47MIGVH64G2ZLPMRTQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:32.512177560 (110h7m20.209745866s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:35.825912333 (110h7m23.523480649s) [noise=true , address=81.171.14.70:4027 , piece_id=X46BF2SMXFGBFRWBG3TN45CSU2V66GVOXQAHTR42H2QVOTRA36OA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.223889733 (110h7m28.92145804s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.243892176 (110h7m28.941460483s) [noise=true , address=185.167.204.205:4031 , piece_id=EQZNQZ4BMWYSUX5IKBL2MMX5DPQN5XI4QUIKFR6LWIZI6FLFGJLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:43.488315198 (110h7m31.185883505s) [noise=true , address=81.171.14.70:4040 , piece_id=WGBE4UIBTC7XEAT2QNJIZBTLSEGQH5HT6KSEC3ML6Y5Z7OI4YMVA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:51.974826346 (110h7m39.672394662s) [noise=true , address=89.149.201.147:4017 , piece_id=ESM6BDBHOTQQUZECBEYOFXEZNMPXIGZZYUS7Y6EXFWBZ4WVFTFUA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974841284 (110h7m39.672409589s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection
Dec 10 05:36:51.974903630 (110h7m39.672471946s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974922165 (110h7m39.672490481s) [seg_pos={0 0}, upload=96631]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Dec 10 05:36:52.071976396 (110h7m39.769544712s) [upload=96631]: Done uploading segments...
Dec 10 05:36:52.072005610 (110h7m39.769573927s) [upload=96631]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.606747768s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
4.569515305s trace:
https://jaeger.dev.storj.io/trace/90b6829c07b062b
FAIL (2025-12-10 06:11:22 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 50)
Duration: 4.569530183s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
1.637783272s trace:
https://jaeger.dev.storj.io/trace/576e3c37403ea2f0
FAIL (2025-12-10 06:11:02 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 53)
Duration: 1.63780878s
core
uplink
us1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
4.541272602s trace:
https://jaeger.dev.storj.io/trace/90b6829c07b062b
FAIL (2025-12-10 06:10:50 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 50)
Duration: 4.541311235s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
2.237565581s trace:
https://jaeger.dev.storj.io/trace/78954e68dc28a6f0
FAIL (2025-12-10 06:10:48 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
32FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483286769 (110h6m40.180855105s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483441889 (110h6m40.181010225s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484188893 (110h6m40.18175724s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484360284 (110h6m40.18192862s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484899961 (110h6m40.182468308s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485473173 (110h6m40.183041519s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485588187 (110h6m40.183156534s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486286061 (110h6m40.183854397s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486614144 (110h6m40.18418248s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486972244 (110h6m40.184540579s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.487764232 (110h6m40.185332569s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.488611475 (110h6m40.186179862s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:56.532754683 (110h6m44.230323019s) [upload=96631]: Next returned nil segment
Dec 10 05:35:56.532767777 (110h6m44.230336114s) [upload=96631]: Waiting for error group managing segments...
Dec 10 05:36:03.072814336 (110h6m50.770382652s) [noise=true , address=81.171.14.70:4033 , piece_id=A7M7632FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:10.426278146 (110h6m58.123846453s) [noise=true , address=185.167.204.205:4003 , piece_id=C6QVIOWAWPAFTTEGTU67E5S2G3F2YNEMN7ZOYJHO7V5DZTJNHBHA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:13.352409435 (110h7m1.049977751s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:15.264994828 (110h7m2.962563144s) [noise=true , address=89.149.201.147:4014 , piece_id=FUWY5JUHVSRU2T7F6FRLNXPHHG7BDCNRXDCYAO26VEURJLYVAURQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:17.549961624 (110h7m5.24752993s) [noise=true , address=81.171.14.70:4031 , piece_id=3OKFG434PBYJ3SPU6KMJ42JH2ASMSDYLC3SCHPVYLJMH5ONMRBJQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:19.306486817 (110h7m7.004055133s) [noise=true , address=185.167.204.205:4027 , piece_id=6NJYN7KJKTEVYCSNQA6HQGU33NCRYDQ46FJFSG6BIQU4LZLEJNJA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.162049031 (110h7m10.859617337s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.737363060 (110h7m11.434931366s) [noise=true , address=185.167.204.205:4032 , piece_id=ZSZ2K73DHDZYFLWQRMDRBE7HVHDEXWA7K4EUNPGIVXFAHCVUKTLA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.786449800 (110h7m11.484018106s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.060159042 (110h7m11.757727358s) [noise=true , address=185.167.204.206:4038 , piece_id=CBND4CAULWE26NIGWFT7DSTQ4WJ4UOGPGPTY2O3TC53QLH3E7RPQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.094361490 (110h7m11.791929795s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.798040935 (110h7m12.495609251s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.378916283 (110h7m13.076484589s) [noise=true , address=89.149.201.147:4021 , piece_id=BEYZFIFW3J5SRMA3TGXM2TL6E6G7NP4Y4ZY7ZG4B7HBZMRW524IA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.827775932 (110h7m13.525344269s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.877397152 (110h7m13.574965468s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.944028435 (110h7m13.641596771s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:26.560902894 (110h7m14.2584712s) [noise=true , address=89.149.201.147:4016 , piece_id=AG43SI5LEABCPKL7BAK2K7OJ4TVXYUIPUS7TVYC5NUQNUQQB5NOA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.812203200 (110h7m15.509771516s) [noise=true , address=89.149.201.147:4023 , piece_id=BI6SXMTHJ5KYB3556G4U6UYG5HRNK5EH64LNT42V3AFNARG5O7LA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.867169354 (110h7m15.56473767s) [noise=true , address=89.149.201.147:4006 , piece_id=UEKDVE6NDKI4NV7HD4AKUH4HNYVRF3C7SPIN26KDK5NX6J4NBQ5Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:29.445827111 (110h7m17.143395446s) [noise=true , address=185.167.204.205:4008 , piece_id=PZIHSKHE4CALB2V3LHWAX5X6BMMQMSMFWM47MIGVH64G2ZLPMRTQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:32.512177560 (110h7m20.209745866s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:35.825912333 (110h7m23.523480649s) [noise=true , address=81.171.14.70:4027 , piece_id=X46BF2SMXFGBFRWBG3TN45CSU2V66GVOXQAHTR42H2QVOTRA36OA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.223889733 (110h7m28.92145804s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.243892176 (110h7m28.941460483s) [noise=true , address=185.167.204.205:4031 , piece_id=EQZNQZ4BMWYSUX5IKBL2MMX5DPQN5XI4QUIKFR6LWIZI6FLFGJLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:43.488315198 (110h7m31.185883505s) [noise=true , address=81.171.14.70:4040 , piece_id=WGBE4UIBTC7XEAT2QNJIZBTLSEGQH5HT6KSEC3ML6Y5Z7OI4YMVA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:51.974826346 (110h7m39.672394662s) [noise=true , address=89.149.201.147:4017 , piece_id=ESM6BDBHOTQQUZECBEYOFXEZNMPXIGZZYUS7Y6EXFWBZ4WVFTFUA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974841284 (110h7m39.672409589s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection
Dec 10 05:36:51.974903630 (110h7m39.672471946s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974922165 (110h7m39.672490481s) [seg_pos={0 0}, upload=96631]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Dec 10 05:36:52.071976396 (110h7m39.769544712s) [upload=96631]: Done uploading segments...
Dec 10 05:36:52.072005610 (110h7m39.769573927s) [upload=96631]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.237583103s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
1.665957319s trace:
https://jaeger.dev.storj.io/trace/576e3c37403ea2f0
FAIL (2025-12-10 06:10:47 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 53)
Duration: 1.66597927s
core
uplink
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
2.185202639s trace:
https://jaeger.dev.storj.io/trace/78954e68dc28a6f0
FAIL (2025-12-10 06:10:13 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
32FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483286769 (110h6m40.180855105s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483441889 (110h6m40.181010225s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484188893 (110h6m40.18175724s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484360284 (110h6m40.18192862s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484899961 (110h6m40.182468308s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485473173 (110h6m40.183041519s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485588187 (110h6m40.183156534s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486286061 (110h6m40.183854397s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486614144 (110h6m40.18418248s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486972244 (110h6m40.184540579s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.487764232 (110h6m40.185332569s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.488611475 (110h6m40.186179862s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:56.532754683 (110h6m44.230323019s) [upload=96631]: Next returned nil segment
Dec 10 05:35:56.532767777 (110h6m44.230336114s) [upload=96631]: Waiting for error group managing segments...
Dec 10 05:36:03.072814336 (110h6m50.770382652s) [noise=true , address=81.171.14.70:4033 , piece_id=A7M7632FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:10.426278146 (110h6m58.123846453s) [noise=true , address=185.167.204.205:4003 , piece_id=C6QVIOWAWPAFTTEGTU67E5S2G3F2YNEMN7ZOYJHO7V5DZTJNHBHA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:13.352409435 (110h7m1.049977751s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:15.264994828 (110h7m2.962563144s) [noise=true , address=89.149.201.147:4014 , piece_id=FUWY5JUHVSRU2T7F6FRLNXPHHG7BDCNRXDCYAO26VEURJLYVAURQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:17.549961624 (110h7m5.24752993s) [noise=true , address=81.171.14.70:4031 , piece_id=3OKFG434PBYJ3SPU6KMJ42JH2ASMSDYLC3SCHPVYLJMH5ONMRBJQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:19.306486817 (110h7m7.004055133s) [noise=true , address=185.167.204.205:4027 , piece_id=6NJYN7KJKTEVYCSNQA6HQGU33NCRYDQ46FJFSG6BIQU4LZLEJNJA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.162049031 (110h7m10.859617337s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.737363060 (110h7m11.434931366s) [noise=true , address=185.167.204.205:4032 , piece_id=ZSZ2K73DHDZYFLWQRMDRBE7HVHDEXWA7K4EUNPGIVXFAHCVUKTLA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.786449800 (110h7m11.484018106s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.060159042 (110h7m11.757727358s) [noise=true , address=185.167.204.206:4038 , piece_id=CBND4CAULWE26NIGWFT7DSTQ4WJ4UOGPGPTY2O3TC53QLH3E7RPQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.094361490 (110h7m11.791929795s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.798040935 (110h7m12.495609251s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.378916283 (110h7m13.076484589s) [noise=true , address=89.149.201.147:4021 , piece_id=BEYZFIFW3J5SRMA3TGXM2TL6E6G7NP4Y4ZY7ZG4B7HBZMRW524IA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.827775932 (110h7m13.525344269s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.877397152 (110h7m13.574965468s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.944028435 (110h7m13.641596771s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:26.560902894 (110h7m14.2584712s) [noise=true , address=89.149.201.147:4016 , piece_id=AG43SI5LEABCPKL7BAK2K7OJ4TVXYUIPUS7TVYC5NUQNUQQB5NOA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.812203200 (110h7m15.509771516s) [noise=true , address=89.149.201.147:4023 , piece_id=BI6SXMTHJ5KYB3556G4U6UYG5HRNK5EH64LNT42V3AFNARG5O7LA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.867169354 (110h7m15.56473767s) [noise=true , address=89.149.201.147:4006 , piece_id=UEKDVE6NDKI4NV7HD4AKUH4HNYVRF3C7SPIN26KDK5NX6J4NBQ5Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:29.445827111 (110h7m17.143395446s) [noise=true , address=185.167.204.205:4008 , piece_id=PZIHSKHE4CALB2V3LHWAX5X6BMMQMSMFWM47MIGVH64G2ZLPMRTQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:32.512177560 (110h7m20.209745866s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:35.825912333 (110h7m23.523480649s) [noise=true , address=81.171.14.70:4027 , piece_id=X46BF2SMXFGBFRWBG3TN45CSU2V66GVOXQAHTR42H2QVOTRA36OA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.223889733 (110h7m28.92145804s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.243892176 (110h7m28.941460483s) [noise=true , address=185.167.204.205:4031 , piece_id=EQZNQZ4BMWYSUX5IKBL2MMX5DPQN5XI4QUIKFR6LWIZI6FLFGJLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:43.488315198 (110h7m31.185883505s) [noise=true , address=81.171.14.70:4040 , piece_id=WGBE4UIBTC7XEAT2QNJIZBTLSEGQH5HT6KSEC3ML6Y5Z7OI4YMVA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:51.974826346 (110h7m39.672394662s) [noise=true , address=89.149.201.147:4017 , piece_id=ESM6BDBHOTQQUZECBEYOFXEZNMPXIGZZYUS7Y6EXFWBZ4WVFTFUA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974841284 (110h7m39.672409589s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection
Dec 10 05:36:51.974903630 (110h7m39.672471946s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974922165 (110h7m39.672490481s) [seg_pos={0 0}, upload=96631]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Dec 10 05:36:52.071976396 (110h7m39.769544712s) [upload=96631]: Done uploading segments...
Dec 10 05:36:52.072005610 (110h7m39.769573927s) [upload=96631]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.185222757s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
1.673611727s trace:
https://jaeger.dev.storj.io/trace/576e3c37403ea2f0
FAIL (2025-12-10 06:10:02 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 53)
Duration: 1.67362921s
core
uplink
us1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
4.443913107s trace:
https://jaeger.dev.storj.io/trace/90b6829c07b062b
FAIL (2025-12-10 06:09:41 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 50)
Duration: 4.443933606s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
4.467532916s trace:
https://jaeger.dev.storj.io/trace/90b6829c07b062b
FAIL (2025-12-10 06:09:17 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 50)
Duration: 4.467554728s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
1.719550038s trace:
https://jaeger.dev.storj.io/trace/576e3c37403ea2f0
FAIL (2025-12-10 06:09:09 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 53)
Duration: 1.719571879s
core
uplink
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
2.62156792s trace:
https://jaeger.dev.storj.io/trace/78954e68dc28a6f0
FAIL (2025-12-10 06:09:00 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
32FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483286769 (110h6m40.180855105s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483441889 (110h6m40.181010225s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484188893 (110h6m40.18175724s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484360284 (110h6m40.18192862s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484899961 (110h6m40.182468308s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485473173 (110h6m40.183041519s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485588187 (110h6m40.183156534s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486286061 (110h6m40.183854397s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486614144 (110h6m40.18418248s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486972244 (110h6m40.184540579s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.487764232 (110h6m40.185332569s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.488611475 (110h6m40.186179862s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:56.532754683 (110h6m44.230323019s) [upload=96631]: Next returned nil segment
Dec 10 05:35:56.532767777 (110h6m44.230336114s) [upload=96631]: Waiting for error group managing segments...
Dec 10 05:36:03.072814336 (110h6m50.770382652s) [noise=true , address=81.171.14.70:4033 , piece_id=A7M7632FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:10.426278146 (110h6m58.123846453s) [noise=true , address=185.167.204.205:4003 , piece_id=C6QVIOWAWPAFTTEGTU67E5S2G3F2YNEMN7ZOYJHO7V5DZTJNHBHA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:13.352409435 (110h7m1.049977751s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:15.264994828 (110h7m2.962563144s) [noise=true , address=89.149.201.147:4014 , piece_id=FUWY5JUHVSRU2T7F6FRLNXPHHG7BDCNRXDCYAO26VEURJLYVAURQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:17.549961624 (110h7m5.24752993s) [noise=true , address=81.171.14.70:4031 , piece_id=3OKFG434PBYJ3SPU6KMJ42JH2ASMSDYLC3SCHPVYLJMH5ONMRBJQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:19.306486817 (110h7m7.004055133s) [noise=true , address=185.167.204.205:4027 , piece_id=6NJYN7KJKTEVYCSNQA6HQGU33NCRYDQ46FJFSG6BIQU4LZLEJNJA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.162049031 (110h7m10.859617337s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.737363060 (110h7m11.434931366s) [noise=true , address=185.167.204.205:4032 , piece_id=ZSZ2K73DHDZYFLWQRMDRBE7HVHDEXWA7K4EUNPGIVXFAHCVUKTLA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.786449800 (110h7m11.484018106s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.060159042 (110h7m11.757727358s) [noise=true , address=185.167.204.206:4038 , piece_id=CBND4CAULWE26NIGWFT7DSTQ4WJ4UOGPGPTY2O3TC53QLH3E7RPQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.094361490 (110h7m11.791929795s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.798040935 (110h7m12.495609251s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.378916283 (110h7m13.076484589s) [noise=true , address=89.149.201.147:4021 , piece_id=BEYZFIFW3J5SRMA3TGXM2TL6E6G7NP4Y4ZY7ZG4B7HBZMRW524IA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.827775932 (110h7m13.525344269s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.877397152 (110h7m13.574965468s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.944028435 (110h7m13.641596771s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:26.560902894 (110h7m14.2584712s) [noise=true , address=89.149.201.147:4016 , piece_id=AG43SI5LEABCPKL7BAK2K7OJ4TVXYUIPUS7TVYC5NUQNUQQB5NOA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.812203200 (110h7m15.509771516s) [noise=true , address=89.149.201.147:4023 , piece_id=BI6SXMTHJ5KYB3556G4U6UYG5HRNK5EH64LNT42V3AFNARG5O7LA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.867169354 (110h7m15.56473767s) [noise=true , address=89.149.201.147:4006 , piece_id=UEKDVE6NDKI4NV7HD4AKUH4HNYVRF3C7SPIN26KDK5NX6J4NBQ5Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:29.445827111 (110h7m17.143395446s) [noise=true , address=185.167.204.205:4008 , piece_id=PZIHSKHE4CALB2V3LHWAX5X6BMMQMSMFWM47MIGVH64G2ZLPMRTQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:32.512177560 (110h7m20.209745866s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:35.825912333 (110h7m23.523480649s) [noise=true , address=81.171.14.70:4027 , piece_id=X46BF2SMXFGBFRWBG3TN45CSU2V66GVOXQAHTR42H2QVOTRA36OA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.223889733 (110h7m28.92145804s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.243892176 (110h7m28.941460483s) [noise=true , address=185.167.204.205:4031 , piece_id=EQZNQZ4BMWYSUX5IKBL2MMX5DPQN5XI4QUIKFR6LWIZI6FLFGJLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:43.488315198 (110h7m31.185883505s) [noise=true , address=81.171.14.70:4040 , piece_id=WGBE4UIBTC7XEAT2QNJIZBTLSEGQH5HT6KSEC3ML6Y5Z7OI4YMVA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:51.974826346 (110h7m39.672394662s) [noise=true , address=89.149.201.147:4017 , piece_id=ESM6BDBHOTQQUZECBEYOFXEZNMPXIGZZYUS7Y6EXFWBZ4WVFTFUA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974841284 (110h7m39.672409589s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection
Dec 10 05:36:51.974903630 (110h7m39.672471946s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974922165 (110h7m39.672490481s) [seg_pos={0 0}, upload=96631]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Dec 10 05:36:52.071976396 (110h7m39.769544712s) [upload=96631]: Done uploading segments...
Dec 10 05:36:52.072005610 (110h7m39.769573927s) [upload=96631]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.621590692s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
4.747121803s trace:
https://jaeger.dev.storj.io/trace/90b6829c07b062b
FAIL (2025-12-10 06:09:00 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 50)
Duration: 4.747138825s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
4.509074806s trace:
https://jaeger.dev.storj.io/trace/90b6829c07b062b
FAIL (2025-12-10 06:08:43 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 50)
Duration: 4.509095895s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
1.752980766s trace:
https://jaeger.dev.storj.io/trace/576e3c37403ea2f0
FAIL (2025-12-10 06:08:26 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 53)
Duration: 1.753000914s
core
uplink
us1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
4.475524599s trace:
https://jaeger.dev.storj.io/trace/90b6829c07b062b
FAIL (2025-12-10 06:08:16 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 50)
Duration: 4.47554124s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
2.668610259s trace:
https://jaeger.dev.storj.io/trace/78954e68dc28a6f0
FAIL (2025-12-10 06:07:46 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
32FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483286769 (110h6m40.180855105s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483441889 (110h6m40.181010225s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484188893 (110h6m40.18175724s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484360284 (110h6m40.18192862s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484899961 (110h6m40.182468308s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485473173 (110h6m40.183041519s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485588187 (110h6m40.183156534s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486286061 (110h6m40.183854397s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486614144 (110h6m40.18418248s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486972244 (110h6m40.184540579s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.487764232 (110h6m40.185332569s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.488611475 (110h6m40.186179862s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:56.532754683 (110h6m44.230323019s) [upload=96631]: Next returned nil segment
Dec 10 05:35:56.532767777 (110h6m44.230336114s) [upload=96631]: Waiting for error group managing segments...
Dec 10 05:36:03.072814336 (110h6m50.770382652s) [noise=true , address=81.171.14.70:4033 , piece_id=A7M7632FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:10.426278146 (110h6m58.123846453s) [noise=true , address=185.167.204.205:4003 , piece_id=C6QVIOWAWPAFTTEGTU67E5S2G3F2YNEMN7ZOYJHO7V5DZTJNHBHA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:13.352409435 (110h7m1.049977751s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:15.264994828 (110h7m2.962563144s) [noise=true , address=89.149.201.147:4014 , piece_id=FUWY5JUHVSRU2T7F6FRLNXPHHG7BDCNRXDCYAO26VEURJLYVAURQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:17.549961624 (110h7m5.24752993s) [noise=true , address=81.171.14.70:4031 , piece_id=3OKFG434PBYJ3SPU6KMJ42JH2ASMSDYLC3SCHPVYLJMH5ONMRBJQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:19.306486817 (110h7m7.004055133s) [noise=true , address=185.167.204.205:4027 , piece_id=6NJYN7KJKTEVYCSNQA6HQGU33NCRYDQ46FJFSG6BIQU4LZLEJNJA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.162049031 (110h7m10.859617337s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.737363060 (110h7m11.434931366s) [noise=true , address=185.167.204.205:4032 , piece_id=ZSZ2K73DHDZYFLWQRMDRBE7HVHDEXWA7K4EUNPGIVXFAHCVUKTLA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.786449800 (110h7m11.484018106s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.060159042 (110h7m11.757727358s) [noise=true , address=185.167.204.206:4038 , piece_id=CBND4CAULWE26NIGWFT7DSTQ4WJ4UOGPGPTY2O3TC53QLH3E7RPQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.094361490 (110h7m11.791929795s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.798040935 (110h7m12.495609251s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.378916283 (110h7m13.076484589s) [noise=true , address=89.149.201.147:4021 , piece_id=BEYZFIFW3J5SRMA3TGXM2TL6E6G7NP4Y4ZY7ZG4B7HBZMRW524IA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.827775932 (110h7m13.525344269s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.877397152 (110h7m13.574965468s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.944028435 (110h7m13.641596771s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:26.560902894 (110h7m14.2584712s) [noise=true , address=89.149.201.147:4016 , piece_id=AG43SI5LEABCPKL7BAK2K7OJ4TVXYUIPUS7TVYC5NUQNUQQB5NOA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.812203200 (110h7m15.509771516s) [noise=true , address=89.149.201.147:4023 , piece_id=BI6SXMTHJ5KYB3556G4U6UYG5HRNK5EH64LNT42V3AFNARG5O7LA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.867169354 (110h7m15.56473767s) [noise=true , address=89.149.201.147:4006 , piece_id=UEKDVE6NDKI4NV7HD4AKUH4HNYVRF3C7SPIN26KDK5NX6J4NBQ5Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:29.445827111 (110h7m17.143395446s) [noise=true , address=185.167.204.205:4008 , piece_id=PZIHSKHE4CALB2V3LHWAX5X6BMMQMSMFWM47MIGVH64G2ZLPMRTQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:32.512177560 (110h7m20.209745866s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:35.825912333 (110h7m23.523480649s) [noise=true , address=81.171.14.70:4027 , piece_id=X46BF2SMXFGBFRWBG3TN45CSU2V66GVOXQAHTR42H2QVOTRA36OA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.223889733 (110h7m28.92145804s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.243892176 (110h7m28.941460483s) [noise=true , address=185.167.204.205:4031 , piece_id=EQZNQZ4BMWYSUX5IKBL2MMX5DPQN5XI4QUIKFR6LWIZI6FLFGJLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:43.488315198 (110h7m31.185883505s) [noise=true , address=81.171.14.70:4040 , piece_id=WGBE4UIBTC7XEAT2QNJIZBTLSEGQH5HT6KSEC3ML6Y5Z7OI4YMVA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:51.974826346 (110h7m39.672394662s) [noise=true , address=89.149.201.147:4017 , piece_id=ESM6BDBHOTQQUZECBEYOFXEZNMPXIGZZYUS7Y6EXFWBZ4WVFTFUA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974841284 (110h7m39.672409589s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection
Dec 10 05:36:51.974903630 (110h7m39.672471946s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974922165 (110h7m39.672490481s) [seg_pos={0 0}, upload=96631]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Dec 10 05:36:52.071976396 (110h7m39.769544712s) [upload=96631]: Done uploading segments...
Dec 10 05:36:52.072005610 (110h7m39.769573927s) [upload=96631]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.668628003s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
4.484342259s trace:
https://jaeger.dev.storj.io/trace/90b6829c07b062b
FAIL (2025-12-10 06:07:40 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 50)
Duration: 4.484359152s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
1.669045038s trace:
https://jaeger.dev.storj.io/trace/576e3c37403ea2f0
FAIL (2025-12-10 06:07:24 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 53)
Duration: 1.669172185s
core
uplink
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
2.553847526s trace:
https://jaeger.dev.storj.io/trace/78954e68dc28a6f0
FAIL (2025-12-10 06:07:19 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
32FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483286769 (110h6m40.180855105s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483441889 (110h6m40.181010225s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484188893 (110h6m40.18175724s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484360284 (110h6m40.18192862s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484899961 (110h6m40.182468308s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485473173 (110h6m40.183041519s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485588187 (110h6m40.183156534s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486286061 (110h6m40.183854397s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486614144 (110h6m40.18418248s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486972244 (110h6m40.184540579s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.487764232 (110h6m40.185332569s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.488611475 (110h6m40.186179862s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:56.532754683 (110h6m44.230323019s) [upload=96631]: Next returned nil segment
Dec 10 05:35:56.532767777 (110h6m44.230336114s) [upload=96631]: Waiting for error group managing segments...
Dec 10 05:36:03.072814336 (110h6m50.770382652s) [noise=true , address=81.171.14.70:4033 , piece_id=A7M7632FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:10.426278146 (110h6m58.123846453s) [noise=true , address=185.167.204.205:4003 , piece_id=C6QVIOWAWPAFTTEGTU67E5S2G3F2YNEMN7ZOYJHO7V5DZTJNHBHA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:13.352409435 (110h7m1.049977751s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:15.264994828 (110h7m2.962563144s) [noise=true , address=89.149.201.147:4014 , piece_id=FUWY5JUHVSRU2T7F6FRLNXPHHG7BDCNRXDCYAO26VEURJLYVAURQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:17.549961624 (110h7m5.24752993s) [noise=true , address=81.171.14.70:4031 , piece_id=3OKFG434PBYJ3SPU6KMJ42JH2ASMSDYLC3SCHPVYLJMH5ONMRBJQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:19.306486817 (110h7m7.004055133s) [noise=true , address=185.167.204.205:4027 , piece_id=6NJYN7KJKTEVYCSNQA6HQGU33NCRYDQ46FJFSG6BIQU4LZLEJNJA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.162049031 (110h7m10.859617337s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.737363060 (110h7m11.434931366s) [noise=true , address=185.167.204.205:4032 , piece_id=ZSZ2K73DHDZYFLWQRMDRBE7HVHDEXWA7K4EUNPGIVXFAHCVUKTLA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.786449800 (110h7m11.484018106s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.060159042 (110h7m11.757727358s) [noise=true , address=185.167.204.206:4038 , piece_id=CBND4CAULWE26NIGWFT7DSTQ4WJ4UOGPGPTY2O3TC53QLH3E7RPQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.094361490 (110h7m11.791929795s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.798040935 (110h7m12.495609251s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.378916283 (110h7m13.076484589s) [noise=true , address=89.149.201.147:4021 , piece_id=BEYZFIFW3J5SRMA3TGXM2TL6E6G7NP4Y4ZY7ZG4B7HBZMRW524IA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.827775932 (110h7m13.525344269s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.877397152 (110h7m13.574965468s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.944028435 (110h7m13.641596771s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:26.560902894 (110h7m14.2584712s) [noise=true , address=89.149.201.147:4016 , piece_id=AG43SI5LEABCPKL7BAK2K7OJ4TVXYUIPUS7TVYC5NUQNUQQB5NOA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.812203200 (110h7m15.509771516s) [noise=true , address=89.149.201.147:4023 , piece_id=BI6SXMTHJ5KYB3556G4U6UYG5HRNK5EH64LNT42V3AFNARG5O7LA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.867169354 (110h7m15.56473767s) [noise=true , address=89.149.201.147:4006 , piece_id=UEKDVE6NDKI4NV7HD4AKUH4HNYVRF3C7SPIN26KDK5NX6J4NBQ5Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:29.445827111 (110h7m17.143395446s) [noise=true , address=185.167.204.205:4008 , piece_id=PZIHSKHE4CALB2V3LHWAX5X6BMMQMSMFWM47MIGVH64G2ZLPMRTQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:32.512177560 (110h7m20.209745866s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:35.825912333 (110h7m23.523480649s) [noise=true , address=81.171.14.70:4027 , piece_id=X46BF2SMXFGBFRWBG3TN45CSU2V66GVOXQAHTR42H2QVOTRA36OA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.223889733 (110h7m28.92145804s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.243892176 (110h7m28.941460483s) [noise=true , address=185.167.204.205:4031 , piece_id=EQZNQZ4BMWYSUX5IKBL2MMX5DPQN5XI4QUIKFR6LWIZI6FLFGJLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:43.488315198 (110h7m31.185883505s) [noise=true , address=81.171.14.70:4040 , piece_id=WGBE4UIBTC7XEAT2QNJIZBTLSEGQH5HT6KSEC3ML6Y5Z7OI4YMVA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:51.974826346 (110h7m39.672394662s) [noise=true , address=89.149.201.147:4017 , piece_id=ESM6BDBHOTQQUZECBEYOFXEZNMPXIGZZYUS7Y6EXFWBZ4WVFTFUA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974841284 (110h7m39.672409589s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection
Dec 10 05:36:51.974903630 (110h7m39.672471946s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974922165 (110h7m39.672490481s) [seg_pos={0 0}, upload=96631]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Dec 10 05:36:52.071976396 (110h7m39.769544712s) [upload=96631]: Done uploading segments...
Dec 10 05:36:52.072005610 (110h7m39.769573927s) [upload=96631]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.553894415s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
4.621824566s trace:
https://jaeger.dev.storj.io/trace/90b6829c07b062b
FAIL (2025-12-10 06:07:10 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 50)
Duration: 4.621854722s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
1.7383093s trace:
https://jaeger.dev.storj.io/trace/576e3c37403ea2f0
FAIL (2025-12-10 06:07:05 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 53)
Duration: 1.738324718s
core
uplink
us1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
4.462163913s trace:
https://jaeger.dev.storj.io/trace/90b6829c07b062b
FAIL (2025-12-10 06:06:55 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 50)
Duration: 4.46218363s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
2.682424804s trace:
https://jaeger.dev.storj.io/trace/78954e68dc28a6f0
FAIL (2025-12-10 06:06:31 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
32FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483286769 (110h6m40.180855105s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483441889 (110h6m40.181010225s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484188893 (110h6m40.18175724s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484360284 (110h6m40.18192862s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484899961 (110h6m40.182468308s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485473173 (110h6m40.183041519s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485588187 (110h6m40.183156534s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486286061 (110h6m40.183854397s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486614144 (110h6m40.18418248s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486972244 (110h6m40.184540579s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.487764232 (110h6m40.185332569s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.488611475 (110h6m40.186179862s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:56.532754683 (110h6m44.230323019s) [upload=96631]: Next returned nil segment
Dec 10 05:35:56.532767777 (110h6m44.230336114s) [upload=96631]: Waiting for error group managing segments...
Dec 10 05:36:03.072814336 (110h6m50.770382652s) [noise=true , address=81.171.14.70:4033 , piece_id=A7M7632FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:10.426278146 (110h6m58.123846453s) [noise=true , address=185.167.204.205:4003 , piece_id=C6QVIOWAWPAFTTEGTU67E5S2G3F2YNEMN7ZOYJHO7V5DZTJNHBHA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:13.352409435 (110h7m1.049977751s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:15.264994828 (110h7m2.962563144s) [noise=true , address=89.149.201.147:4014 , piece_id=FUWY5JUHVSRU2T7F6FRLNXPHHG7BDCNRXDCYAO26VEURJLYVAURQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:17.549961624 (110h7m5.24752993s) [noise=true , address=81.171.14.70:4031 , piece_id=3OKFG434PBYJ3SPU6KMJ42JH2ASMSDYLC3SCHPVYLJMH5ONMRBJQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:19.306486817 (110h7m7.004055133s) [noise=true , address=185.167.204.205:4027 , piece_id=6NJYN7KJKTEVYCSNQA6HQGU33NCRYDQ46FJFSG6BIQU4LZLEJNJA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.162049031 (110h7m10.859617337s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.737363060 (110h7m11.434931366s) [noise=true , address=185.167.204.205:4032 , piece_id=ZSZ2K73DHDZYFLWQRMDRBE7HVHDEXWA7K4EUNPGIVXFAHCVUKTLA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.786449800 (110h7m11.484018106s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.060159042 (110h7m11.757727358s) [noise=true , address=185.167.204.206:4038 , piece_id=CBND4CAULWE26NIGWFT7DSTQ4WJ4UOGPGPTY2O3TC53QLH3E7RPQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.094361490 (110h7m11.791929795s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.798040935 (110h7m12.495609251s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.378916283 (110h7m13.076484589s) [noise=true , address=89.149.201.147:4021 , piece_id=BEYZFIFW3J5SRMA3TGXM2TL6E6G7NP4Y4ZY7ZG4B7HBZMRW524IA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.827775932 (110h7m13.525344269s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.877397152 (110h7m13.574965468s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.944028435 (110h7m13.641596771s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:26.560902894 (110h7m14.2584712s) [noise=true , address=89.149.201.147:4016 , piece_id=AG43SI5LEABCPKL7BAK2K7OJ4TVXYUIPUS7TVYC5NUQNUQQB5NOA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.812203200 (110h7m15.509771516s) [noise=true , address=89.149.201.147:4023 , piece_id=BI6SXMTHJ5KYB3556G4U6UYG5HRNK5EH64LNT42V3AFNARG5O7LA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.867169354 (110h7m15.56473767s) [noise=true , address=89.149.201.147:4006 , piece_id=UEKDVE6NDKI4NV7HD4AKUH4HNYVRF3C7SPIN26KDK5NX6J4NBQ5Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:29.445827111 (110h7m17.143395446s) [noise=true , address=185.167.204.205:4008 , piece_id=PZIHSKHE4CALB2V3LHWAX5X6BMMQMSMFWM47MIGVH64G2ZLPMRTQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:32.512177560 (110h7m20.209745866s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:35.825912333 (110h7m23.523480649s) [noise=true , address=81.171.14.70:4027 , piece_id=X46BF2SMXFGBFRWBG3TN45CSU2V66GVOXQAHTR42H2QVOTRA36OA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.223889733 (110h7m28.92145804s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.243892176 (110h7m28.941460483s) [noise=true , address=185.167.204.205:4031 , piece_id=EQZNQZ4BMWYSUX5IKBL2MMX5DPQN5XI4QUIKFR6LWIZI6FLFGJLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:43.488315198 (110h7m31.185883505s) [noise=true , address=81.171.14.70:4040 , piece_id=WGBE4UIBTC7XEAT2QNJIZBTLSEGQH5HT6KSEC3ML6Y5Z7OI4YMVA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:51.974826346 (110h7m39.672394662s) [noise=true , address=89.149.201.147:4017 , piece_id=ESM6BDBHOTQQUZECBEYOFXEZNMPXIGZZYUS7Y6EXFWBZ4WVFTFUA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974841284 (110h7m39.672409589s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection
Dec 10 05:36:51.974903630 (110h7m39.672471946s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974922165 (110h7m39.672490481s) [seg_pos={0 0}, upload=96631]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Dec 10 05:36:52.071976396 (110h7m39.769544712s) [upload=96631]: Done uploading segments...
Dec 10 05:36:52.072005610 (110h7m39.769573927s) [upload=96631]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.68244455s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
1.597474579s trace:
https://jaeger.dev.storj.io/trace/576e3c37403ea2f0
FAIL (2025-12-10 06:06:16 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 53)
Duration: 1.597492483s
core
uplink
us1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
4.396746607s trace:
https://jaeger.dev.storj.io/trace/90b6829c07b062b
FAIL (2025-12-10 06:05:58 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 50)
Duration: 4.396766744s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
2.59461122s trace:
https://jaeger.dev.storj.io/trace/78954e68dc28a6f0
FAIL (2025-12-10 06:05:22 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
32FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483286769 (110h6m40.180855105s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483441889 (110h6m40.181010225s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484188893 (110h6m40.18175724s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484360284 (110h6m40.18192862s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484899961 (110h6m40.182468308s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485473173 (110h6m40.183041519s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485588187 (110h6m40.183156534s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486286061 (110h6m40.183854397s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486614144 (110h6m40.18418248s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486972244 (110h6m40.184540579s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.487764232 (110h6m40.185332569s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.488611475 (110h6m40.186179862s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:56.532754683 (110h6m44.230323019s) [upload=96631]: Next returned nil segment
Dec 10 05:35:56.532767777 (110h6m44.230336114s) [upload=96631]: Waiting for error group managing segments...
Dec 10 05:36:03.072814336 (110h6m50.770382652s) [noise=true , address=81.171.14.70:4033 , piece_id=A7M7632FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:10.426278146 (110h6m58.123846453s) [noise=true , address=185.167.204.205:4003 , piece_id=C6QVIOWAWPAFTTEGTU67E5S2G3F2YNEMN7ZOYJHO7V5DZTJNHBHA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:13.352409435 (110h7m1.049977751s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:15.264994828 (110h7m2.962563144s) [noise=true , address=89.149.201.147:4014 , piece_id=FUWY5JUHVSRU2T7F6FRLNXPHHG7BDCNRXDCYAO26VEURJLYVAURQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:17.549961624 (110h7m5.24752993s) [noise=true , address=81.171.14.70:4031 , piece_id=3OKFG434PBYJ3SPU6KMJ42JH2ASMSDYLC3SCHPVYLJMH5ONMRBJQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:19.306486817 (110h7m7.004055133s) [noise=true , address=185.167.204.205:4027 , piece_id=6NJYN7KJKTEVYCSNQA6HQGU33NCRYDQ46FJFSG6BIQU4LZLEJNJA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.162049031 (110h7m10.859617337s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.737363060 (110h7m11.434931366s) [noise=true , address=185.167.204.205:4032 , piece_id=ZSZ2K73DHDZYFLWQRMDRBE7HVHDEXWA7K4EUNPGIVXFAHCVUKTLA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.786449800 (110h7m11.484018106s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.060159042 (110h7m11.757727358s) [noise=true , address=185.167.204.206:4038 , piece_id=CBND4CAULWE26NIGWFT7DSTQ4WJ4UOGPGPTY2O3TC53QLH3E7RPQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.094361490 (110h7m11.791929795s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.798040935 (110h7m12.495609251s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.378916283 (110h7m13.076484589s) [noise=true , address=89.149.201.147:4021 , piece_id=BEYZFIFW3J5SRMA3TGXM2TL6E6G7NP4Y4ZY7ZG4B7HBZMRW524IA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.827775932 (110h7m13.525344269s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.877397152 (110h7m13.574965468s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.944028435 (110h7m13.641596771s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:26.560902894 (110h7m14.2584712s) [noise=true , address=89.149.201.147:4016 , piece_id=AG43SI5LEABCPKL7BAK2K7OJ4TVXYUIPUS7TVYC5NUQNUQQB5NOA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.812203200 (110h7m15.509771516s) [noise=true , address=89.149.201.147:4023 , piece_id=BI6SXMTHJ5KYB3556G4U6UYG5HRNK5EH64LNT42V3AFNARG5O7LA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.867169354 (110h7m15.56473767s) [noise=true , address=89.149.201.147:4006 , piece_id=UEKDVE6NDKI4NV7HD4AKUH4HNYVRF3C7SPIN26KDK5NX6J4NBQ5Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:29.445827111 (110h7m17.143395446s) [noise=true , address=185.167.204.205:4008 , piece_id=PZIHSKHE4CALB2V3LHWAX5X6BMMQMSMFWM47MIGVH64G2ZLPMRTQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:32.512177560 (110h7m20.209745866s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:35.825912333 (110h7m23.523480649s) [noise=true , address=81.171.14.70:4027 , piece_id=X46BF2SMXFGBFRWBG3TN45CSU2V66GVOXQAHTR42H2QVOTRA36OA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.223889733 (110h7m28.92145804s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.243892176 (110h7m28.941460483s) [noise=true , address=185.167.204.205:4031 , piece_id=EQZNQZ4BMWYSUX5IKBL2MMX5DPQN5XI4QUIKFR6LWIZI6FLFGJLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:43.488315198 (110h7m31.185883505s) [noise=true , address=81.171.14.70:4040 , piece_id=WGBE4UIBTC7XEAT2QNJIZBTLSEGQH5HT6KSEC3ML6Y5Z7OI4YMVA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:51.974826346 (110h7m39.672394662s) [noise=true , address=89.149.201.147:4017 , piece_id=ESM6BDBHOTQQUZECBEYOFXEZNMPXIGZZYUS7Y6EXFWBZ4WVFTFUA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974841284 (110h7m39.672409589s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection
Dec 10 05:36:51.974903630 (110h7m39.672471946s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974922165 (110h7m39.672490481s) [seg_pos={0 0}, upload=96631]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Dec 10 05:36:52.071976396 (110h7m39.769544712s) [upload=96631]: Done uploading segments...
Dec 10 05:36:52.072005610 (110h7m39.769573927s) [upload=96631]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.594629024s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
1.680613084s trace:
https://jaeger.dev.storj.io/trace/576e3c37403ea2f0
FAIL (2025-12-10 06:05:02 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 53)
Duration: 1.680635656s
core
uplink
us1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
5.457822463s trace:
https://jaeger.dev.storj.io/trace/90b6829c07b062b
FAIL (2025-12-10 06:04:56 UTC)
orbiter warning: operation: Commit uplink: failed to upload enough pieces (needed at least 54 but got 50)
Duration: 5.457834496s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
2.700831834s trace:
https://jaeger.dev.storj.io/trace/78954e68dc28a6f0
FAIL (2025-12-10 06:04:21 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
32FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483286769 (110h6m40.180855105s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.483441889 (110h6m40.181010225s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484188893 (110h6m40.18175724s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484360284 (110h6m40.18192862s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.484899961 (110h6m40.182468308s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485473173 (110h6m40.183041519s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.485588187 (110h6m40.183156534s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486286061 (110h6m40.183854397s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486614144 (110h6m40.18418248s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.486972244 (110h6m40.184540579s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.487764232 (110h6m40.185332569s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:52.488611475 (110h6m40.186179862s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Uploading piece...
Dec 10 05:35:56.532754683 (110h6m44.230323019s) [upload=96631]: Next returned nil segment
Dec 10 05:35:56.532767777 (110h6m44.230336114s) [upload=96631]: Waiting for error group managing segments...
Dec 10 05:36:03.072814336 (110h6m50.770382652s) [noise=true , address=81.171.14.70:4033 , piece_id=A7M7632FFSAZK7S5S6G4J72AVRGUSAVIFNVQG7QKTLTKEWTZPWFQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:10.426278146 (110h6m58.123846453s) [noise=true , address=185.167.204.205:4003 , piece_id=C6QVIOWAWPAFTTEGTU67E5S2G3F2YNEMN7ZOYJHO7V5DZTJNHBHA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:13.352409435 (110h7m1.049977751s) [noise=true , address=89.149.201.147:4005 , piece_id=SZUARGEGZLRFD5GL53ML3PSRE3NX3WJIU2QLIAIWJ5X74FDM546Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:15.264994828 (110h7m2.962563144s) [noise=true , address=89.149.201.147:4014 , piece_id=FUWY5JUHVSRU2T7F6FRLNXPHHG7BDCNRXDCYAO26VEURJLYVAURQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:17.549961624 (110h7m5.24752993s) [noise=true , address=81.171.14.70:4031 , piece_id=3OKFG434PBYJ3SPU6KMJ42JH2ASMSDYLC3SCHPVYLJMH5ONMRBJQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:19.306486817 (110h7m7.004055133s) [noise=true , address=185.167.204.205:4027 , piece_id=6NJYN7KJKTEVYCSNQA6HQGU33NCRYDQ46FJFSG6BIQU4LZLEJNJA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.162049031 (110h7m10.859617337s) [noise=true , address=81.171.14.70:4046 , piece_id=W5XKF4BDKWOEBYXOBRBCBKY5MORF47WA2C2W7QPT5BMICFJZZBWA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.737363060 (110h7m11.434931366s) [noise=true , address=185.167.204.205:4032 , piece_id=ZSZ2K73DHDZYFLWQRMDRBE7HVHDEXWA7K4EUNPGIVXFAHCVUKTLA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:23.786449800 (110h7m11.484018106s) [noise=true , address=81.171.14.70:4030 , piece_id=X7PDS4QDWBSSWIJES2QO6JI4ZP5EB6T6PMEQNWR42M4MTAOUUF3A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.060159042 (110h7m11.757727358s) [noise=true , address=185.167.204.206:4038 , piece_id=CBND4CAULWE26NIGWFT7DSTQ4WJ4UOGPGPTY2O3TC53QLH3E7RPQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.094361490 (110h7m11.791929795s) [noise=true , address=89.149.201.147:4012 , piece_id=JX6YJHUZEJYORE6IKANUGTMQPBYAY22WNCX2GCMAH74UFJE7X46A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:24.798040935 (110h7m12.495609251s) [noise=true , address=81.171.14.70:4038 , piece_id=JV63T6L5WD2VHUJRS74XJX4VUUNGEROPX2GWX6GXKLFSBI46VBLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.378916283 (110h7m13.076484589s) [noise=true , address=89.149.201.147:4021 , piece_id=BEYZFIFW3J5SRMA3TGXM2TL6E6G7NP4Y4ZY7ZG4B7HBZMRW524IA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.827775932 (110h7m13.525344269s) [noise=true , address=185.167.204.206:4064 , piece_id=O4VT3N4CWID6DN7GVVYJ6SFV3UGLKFHDCLV5TNN3ROQ2TDSBTCKQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.877397152 (110h7m13.574965468s) [noise=true , address=185.167.204.205:4029 , piece_id=HY7GATALKCEDP563CEVY53JEM7S2JLZGQI7IVX7YH3PO5MNQKE7Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:25.944028435 (110h7m13.641596771s) [noise=true , address=81.171.14.70:4048 , piece_id=FHKHNB56U67PNJPDJIBOZLTY2PW6NAGTHLBLL5LLIJOPPXBQDQUQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:26.560902894 (110h7m14.2584712s) [noise=true , address=89.149.201.147:4016 , piece_id=AG43SI5LEABCPKL7BAK2K7OJ4TVXYUIPUS7TVYC5NUQNUQQB5NOA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.812203200 (110h7m15.509771516s) [noise=true , address=89.149.201.147:4023 , piece_id=BI6SXMTHJ5KYB3556G4U6UYG5HRNK5EH64LNT42V3AFNARG5O7LA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:27.867169354 (110h7m15.56473767s) [noise=true , address=89.149.201.147:4006 , piece_id=UEKDVE6NDKI4NV7HD4AKUH4HNYVRF3C7SPIN26KDK5NX6J4NBQ5Q, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:29.445827111 (110h7m17.143395446s) [noise=true , address=185.167.204.205:4008 , piece_id=PZIHSKHE4CALB2V3LHWAX5X6BMMQMSMFWM47MIGVH64G2ZLPMRTQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:32.512177560 (110h7m20.209745866s) [noise=true , address=81.171.14.70:4045 , piece_id=4MHEGBEG6BSYE4TAJ7FKO6QAJEAZAPTAZL2CP77GSZ2NWQCUJDIQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:35.825912333 (110h7m23.523480649s) [noise=true , address=81.171.14.70:4027 , piece_id=X46BF2SMXFGBFRWBG3TN45CSU2V66GVOXQAHTR42H2QVOTRA36OA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.223889733 (110h7m28.92145804s) [noise=true , address=185.167.204.205:4002 , piece_id=ZTKK6O7XAOPFFTLH3BNGFDEMW6C74KDYKXFE6SUA3MIARRPYDT4A, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:41.243892176 (110h7m28.941460483s) [noise=true , address=185.167.204.205:4031 , piece_id=EQZNQZ4BMWYSUX5IKBL2MMX5DPQN5XI4QUIKFR6LWIZI6FLFGJLQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:43.488315198 (110h7m31.185883505s) [noise=true , address=81.171.14.70:4040 , piece_id=WGBE4UIBTC7XEAT2QNJIZBTLSEGQH5HT6KSEC3ML6Y5Z7OI4YMVA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: <nil>
Dec 10 05:36:51.974826346 (110h7m39.672394662s) [noise=true , address=89.149.201.147:4017 , piece_id=ESM6BDBHOTQQUZECBEYOFXEZNMPXIGZZYUS7Y6EXFWBZ4WVFTFUA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974841284 (110h7m39.672409589s) [noise=true , address=185.167.204.205:4004 , piece_id=PA7UKEJIRVVTB4Q6VKPQ7TZ2C2ZAWHIGZKY3RDNWCRDJIFSVKOSQ, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:55016->185.167.204.205:4004: use of closed network connection
Dec 10 05:36:51.974903630 (110h7m39.672471946s) [noise=true , address=81.171.14.70:4029 , piece_id=JWETD2NVRRRPRGGDYZAYFI3L5OH6AIDVYRPQKFFSBUUNDJ5DKWEA, seg_pos={0 0}, upload=96631]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: expected piece hash; context deadline exceeded; EOF
Dec 10 05:36:51.974922165 (110h7m39.672490481s) [seg_pos={0 0}, upload=96631]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Dec 10 05:36:52.071976396 (110h7m39.769544712s) [upload=96631]: Done uploading segments...
Dec 10 05:36:52.072005610 (110h7m39.769573927s) [upload=96631]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.700847242s
core
uplink
eu-select-1
eu1-placement-15
|