From 0247020c825b0c98198e5c8a371b8ae6ddf56ec4 Mon Sep 17 00:00:00 2001 From: root Date: Mon, 30 Mar 2026 02:43:24 +0800 Subject: [PATCH] docs: add Whisper speech-to-text capability --- TOOLS.md | 13 +++++++++++++ audio-1774809727190.json | 1 + audio-1774809727190.srt | 4 ++++ audio-1774809727190.tsv | 2 ++ audio-1774809727190.txt | 1 + audio-1774809727190.vtt | 5 +++++ media/inbound/audio-1774809727190.amr | Bin 0 -> 12085 bytes 7 files changed, 26 insertions(+) create mode 100644 audio-1774809727190.json create mode 100644 audio-1774809727190.srt create mode 100644 audio-1774809727190.tsv create mode 100644 audio-1774809727190.txt create mode 100644 audio-1774809727190.vtt create mode 100644 media/inbound/audio-1774809727190.amr diff --git a/TOOLS.md b/TOOLS.md index da8c92a..4caba1c 100644 --- a/TOOLS.md +++ b/TOOLS.md @@ -144,6 +144,19 @@ bash scripts/dingtalk_tts.sh "要说的内容" **注意**: duration 参数使用秒(整数),不是毫秒 +## 语音识别(Whisper) + +**命令**: `whisper <音频文件> --language Chinese --model small` + +**支持格式**: AMR, OGG, MP3, WAV 等(ffmpeg 支持的格式) + +**用途**: 用户发来的语音消息 → 用 Whisper 转文字 → 处理回复 + +**示例**: +```bash +whisper /root/.openclaw/workspace-assistant/media/inbound/audio-xxx.ogg --language Chinese --model small +``` + ## ⚠️ 邮件操作安全规则 **只读不删!** 严禁执行任何删除邮件的操作,包括但不限于: diff --git a/audio-1774809727190.json b/audio-1774809727190.json new file mode 100644 index 0000000..adb3479 --- /dev/null +++ b/audio-1774809727190.json @@ -0,0 +1 @@ +{"text": "\u90a3\u4f60\u770b\u770b\u8fd9\u6761\u661f\u671f\u4f60\u80fd\u4e0d\u80fd\u8bc6\u522b\u91cc\u9762\u7684\u5185\u5bb9", "segments": [{"id": 0, "seek": 0, "start": 0.0, "end": 5.0, "text": "\u90a3\u4f60\u770b\u770b\u8fd9\u6761\u661f\u671f\u4f60\u80fd\u4e0d\u80fd\u8bc6\u522b\u91cc\u9762\u7684\u5185\u5bb9", "tokens": [50364, 4184, 16529, 4200, 5562, 48837, 20682, 16786, 2166, 8225, 28590, 5233, 228, 18453, 15759, 8833, 1546, 34742, 25750, 50614], "temperature": 0.0, "avg_logprob": -0.45115266527448383, "compression_ratio": 0.8769230769230769, "no_speech_prob": 0.17235969007015228}], "language": "Chinese"} \ No newline at end of file diff --git a/audio-1774809727190.srt b/audio-1774809727190.srt new file mode 100644 index 0000000..03774b7 --- /dev/null +++ b/audio-1774809727190.srt @@ -0,0 +1,4 @@ +1 +00:00:00,000 --> 00:00:05,000 +那你看看这条星期你能不能识别里面的内容 + diff --git a/audio-1774809727190.tsv b/audio-1774809727190.tsv new file mode 100644 index 0000000..408180f --- /dev/null +++ b/audio-1774809727190.tsv @@ -0,0 +1,2 @@ +start end text +0 5000 那你看看这条星期你能不能识别里面的内容 diff --git a/audio-1774809727190.txt b/audio-1774809727190.txt new file mode 100644 index 0000000..b292294 --- /dev/null +++ b/audio-1774809727190.txt @@ -0,0 +1 @@ +那你看看这条星期你能不能识别里面的内容 diff --git a/audio-1774809727190.vtt b/audio-1774809727190.vtt new file mode 100644 index 0000000..e239b3d --- /dev/null +++ b/audio-1774809727190.vtt @@ -0,0 +1,5 @@ +WEBVTT + +00:00.000 --> 00:05.000 +那你看看这条星期你能不能识别里面的内容 + diff --git a/media/inbound/audio-1774809727190.amr b/media/inbound/audio-1774809727190.amr new file mode 100644 index 0000000000000000000000000000000000000000..81c6091b81e6eec5424b24e89989eb91dd9622b8 GIT binary patch literal 12085 zcmYM4Wmr_-*M=DyX(>r5>F$*7?x9)Gq9efCzeuuy}7h5~==`dsv1LeFfr8~~P*gR8T&xv?1lzyt7q|G!I=UM~Ot z&&%Zi&@V%g??nLOm&?_SEu2w7f3f*!Vh{RB%F4vf#QJjmzkd`)eu<%=UjFe#H1IF? z9l!)g{uo?;_vMI~B#WAk+gNd1Bv9wgLNB$^cf`ce@@|eGp7SMo` z$Niu9|I}eXp=D^y62Jk7*cO4ATAj?>)=Z^rX&9pc)7$iGDzS^o%t^X1k(Wm_RTTak ztVLu;At#HE#}IsP={UiiVu8x9cW^sJ*DP8IOYW3k(OLg?M1JP_6oNoSe}#44||kEN3g!U78l#W5yl0Uv+>D5YyV=WQkR*|0@6 zDRSQV@D}R%@DZ+Hv$O0-6i!`nhk2{I?yaV87lp0;E&B5Wmz>m^r=K%N#7o-o^kdHAVDR5&nD3BJ3N<8pHhQ)Uyh+>;5jF`mLHhzq5=@GiD(;=IiT;=lae!x{q>ybQBgAah5Q^Uf_Y~ z!-K-}3Aa*!HV~jMl<}vg4#y&u@U!@`sq1}5J*Bzsod-M_^7`4J$Jm3pY}jQSZQA@g z)iedi!C6?El-SgSD*W@)lxYdOisyqSs8pvojxEA6@qY@1MnpkQSb0o7wWWN>&qP zgYNY#S4Hg5J0VYc9$-YnVz>!a?M-PQc%Wgg={}t!S>DNa^`DqK^}DM z<#e-~dMaIK6*ph|?{>hF&ajf1vX9>6Zd8mxdt+*e!CdZ+KUCc3ow!@+#%8XtWl9oT zNseG}ip?RiuRtLyTQe)b90;Hd_2Tnq{|S&8EU@5OGYN9pbIWhHU~^kjb(=iPGUD{Na zZk^+~#|skOOROI~T?VJy0Rr$+dWZ~(umPq(6eXE)TwlSqJo2Fa$n!=V|A9BswnTK{ z_y}Ue{s3mrVAh2TjB87kQl^zwoD6Zywab~i1RI$=HU>v7MjFft>nUzwaZ{0Hz%Ls? zdPSvNH4YNw+e7TsoiXduiR-1z*fns%y&&=^ps*!-KoE5QC?@=V%%iy^sO4o%7dQY6 zG}Y!r7$l9!C%GpII264_v4U(dR;>oH#J$d*mM>-n)RM~gJr|i?gr@^DgM}-P8$~YkI#4=*7m#i+zIGrbu!;Lfb$*(0eC6PL+UbXfR8|w{>Sl} zqDW}|LnQ(17`sr4Jj+jgPGU6`Fl?L4!X}o2?Nz^zc9x{ZFq!p?4hN5p+emz2L}6*w z7>45MT46bd{}>e5AxpVjv#wvf4>G>YekUhdBx|F$jBKz{!i4iBPR#ZXQOyas)Cqrv zK%jxbAEO^s02ZJm2ov4qj1s6>XPc$|O`)lMw%WfDdv<=1?egh%XI>6ce&*4vzIYuv z=%e-w$Fmywn|MCG~!clKXAIUhB_XH}}t( zdD*phaFo+6|4sWW2m(4NR6pmBdYO4511?&FQ#0lT2{L6y-?{rgZMGN|E9OO`aLhG! z*ovDHWE4$33=CZr6|VH9^s;Brm`fBNokTKV7vPoe zeo6E9ZoUt6@QbMeTc8x8i~$P8PutdCGN6Q$a__-XKK9t_e~l!+Zqfw{b9%=;7v2h7 zP?fOK%+c2@wwKrjh+-k#-erhZsMFipStG|xwFuc{(QQWKtCUCr;)&jMp~3K0jCzoF zxw0@`<~mV(?;P!pF25aK7-iVYlAtXt1>2w=0)Yt%&vWB90Zu@ah7_niR&9W@@QC#w z$DY+dFBJ8}Ll?Q&vSl9H$1K$E-!)^{n1}c6-Mqxh0?V8k0e@S%ut-+1KY#c14~}EN z_(MYLtogJ~cvBzmK<4DXmOZ#?gJ zUO&&H#YzJB)!Zg6NG;Jh)lO#x&N`RUkL!TtQF|Pq(}iJW#JIOR zk!Odal1@Ad$x4?(K_%epgymc@~djuJb+4g<(u zdhjLo%{0Wd+s%rQwF(vN{eh#m!!w{wiWky42b^3<~z*Wv>g!2%*%;oNp6QEr{x^I48`-_-I9S>4#n+Wl$)f zmhStqdU)q}34RHwq;(k*FrIGvrTAD`wDrXBv)uC$QF~y^-ULMluQ<+HVuOP7>PC1{ zue}BAp(6;?OIO!Z%dQ3p0PZ;s!N9kzj%jFecyFe=$tho&iey&DFXycmN5V7l$OhUg z$-%6lM$i(Zmgk?2+kfF|82j}(rKr=>yW>W#gAArPn)AAr{T`Lx@SO~dn{bo)dt4;? zaSaCEY<|3TAJkQO(IaXv?*g0;VXd`sntbRP)3RLbWT8>)`@3CuJxgG7T|?mTK%us= z{Z~+zyVfp}iau%=iz*+gsiFK;6?*#Z_X4-dtYu^z*sQ#rHao zd783;f>3kbPF*@i9!%r9&~hDxpBWpz$he_O7A|0Y3mLO_N z5To95emfA=Vhi`kZj5$aw@QmaqJ&X&8QlY*vt^fCIqJ(e|f;d{o=?_3wUaQfpI9sO3 zfVQpDTGyaW)bC@WSn?50miBKFe-L#$AS}UO&y1wK{c-7)Q)fQ2#_;<@ds5Bz+j0!j z2g*LX&xGu73CBs9&FSHys`C4_`J1!J?I~7>k^~qwHrI1ziu*I$Z>$V0VbpwJpDYnP zde25m2z>IU>pFB4+gFIY!0GE`hQJYl;EvMik^wHj{fFE`^t;MdXa-jg*hn4({(37U zeE&xM<35c`SB{vh><$!?XHua2=)Bb$e_FGio7FAR0K?OVZM$A_W%qcY3Nwo#0#%ah zZ3aGHK?`g6oGhs@HiGzX{f1G*@-;3Oi(eD`vu?`Kjku?yH@XWygx36LCw>SIF^Fd) zVt@qz1oi}+-o|U$53>`Zb|%$R-#V2A<3SxFJvWDtcsxGmn$a{+U(7X<;Rw-B=I2^< z%ps|gc@HeW?~&CFv6V&gxwmwEbnwpze|5;qQOw7Ua1j;~8R{Abo>0P)5KR)0W|??@ zC}^pMM&HAOrLljwBNH9e^9U!@yk`TShbP$!f7kWn`P)855*^G0*VL(lkg!H2+j^3j z${?#R1z_*tW;Ofo=^bGOti}x41^Vn);jic^6kCO+*!je`JFi2#;ml(={jLnL_=z*u zbHN2g1w!x^M36us_Z46b3=%~~j<3KgzQ^m4482x<;?+fF@g{3t&(HOrRcu7^L0^9= zEePbR^rZZ>VVjuakT6r-Sr)-$=(xk>)AUSoc!b##s*alM-gtkGUq0;zOn9_K^R14`ShSwguhQ{Hhh^{1=;>~f*Bo43F#rW zyyC+j?TFc`gpc2?RV;x>NZ|#9cJhB=XDj{qtt&d7F!PMbb%Y&Gm#s8Ne3EIFa-!R9HCfYaQiV%u2|dddfXKvA>djFL zPpmM&NWf2~Q+3=Y1*T@N>IN2SKD0*H?;B{`t8S>OtLwq+7&!0t$fP`m?CvWF5i+rs~Na9wBXS8te0Jg`0+RarGG+|Tz-UA ziT&k@%kT%ey8fIz)pZX|*eW|))syc=X#0quO7Gkh!*T7N@R;R;@(;3H5lp-p_3x7^ zbP7w5*yeU|IkE27MxV>G=0r3E$AOk<+sbD$QE_c;q?}5!YqspOF>dr%YO{M8)>})< zyI5^oeQbHOk(jzFT{og_FcyknD}9A<1k z6KR@Z^6K;Cw0T6bxAZLR7(&C6x50Fpy)6B5(zj^_IQBVdyo`NCEXjZpY-j!V_){Nb29ZD|{!eg4dCJ=peW-*s%(w6pDuhhlkR z-^uB3*`zEtfwWKRI9VVSqyzR=Hw23oghlg5#|7X4T+4GiCfB07CtnIz2riyOnk=3c z+(Au%tM8hCPt4lFj8&5rB%(;;gc&V84j@2Z64~o*dd{hQbFEpzlOPE%BR-<8wHA0y zGMb4(B(TR!;exe$xvBG3ENGl^q3N`7Cw1DmBz_6Lm$?g#*i`TrRB%>CN=}#2KPKT3 z2ooKMiPg`o1+;Qm`_{ZTkv+Vx;JQC#Z>;{Q^1Y=p@u&UK(@6&T{4TWtn!BcHcWTd= zE4-77jlaFEhEQ|r_~~e>H%e=IJY%}JT9~{yL-iNs#{I?bIy1!9AB#SzQ&*U&9l^=I z7Ch-0dxiGvK9x4n!p|T$Ik|fc?4CIY3q6R1KjP=dmsa!l8$AQ0mB;zWW7l6#(hYEON*ZrgV-cxlP3CEU*q0(6nJy`63ftvnBg{^Eawufu6s-zC0 zvh4)igXpndIDzUB_jrMC1l)J{x_Ybq=)So~IuY>}WSg*K6mbQe)xYx990ipUVNwXh zM_+9W3=9U^9}8fQfqiodA$fVr`esU-5%k_?GwhSU>`!FgH(tK0jn&8{D1jVNE@J7S zR(3#*v;q`IIo$@E^RjOpLny9!?!0a2c6pgcrZ^1(E)h_yCeLBJSK+Z{-3KXMEZ$AY zZzW{(w*Dj~?Ts7JrB_WJ=S4L!m|N2tfK74-0bl|F{A6l41o!|qtsMZ{q*O~ORb=UW zwrB5-V~1EYVBT$2YOUaF=7iSDoqiG3t9VX5Z}E2fsNgCK2npr?LNhsp7c1L?-w6FZ znTLLKPZLq>p_Q7&PM+o4N=QD1MOLZmvBN-d}Q54)zp1(8LBp46?77zdy#n(!JJ#cfFzQtzo)_fNy)Ifcs ziAR{wod*BDI(0=!4k)T_voo*W)S6mJW9=bZSXh@;DSNBR>ha+Z}I_N$Gb5$w1 zh~mttn}n8X2C=gAH08y+3MKTWR(w$)4?i{2auo|}SsP#SBbu_^wh0%OS zs)0XZ?ksQZ9GzR_9b>yM0&iVqR<7XDg(TMYek4opTa1`xXqs= z;?KY20ePE#W)W-9V86Clds}O^_XEq~YA-l&k-=H+TFA}|uk0W{?IA^}-K|gVK zma9;MAJ+l)Yo{QDivz^fu#J5LdVR-~;BwWBjfA7ro%>*kgF!L%RJZ-w%%|hW%6M8~ zD>Q-9{*<%v_ZHf!AE})Qe(KWuWd|a-R*uEn=vUjxOE-r_y@*7G1?yGZcHB`TnlO3N zuG_R!gwmS2Cj(fFuU$TN9fT6+*+9jEjUoeq-~>S=%uQK?3ftO*^MRfYT}#?#5Q9hN zA@|wOV%9suG}C9*lpx=+E47i%wInw>Vsz+WzZ4nXzap<%-h@jg% zq>2NHUbatc#J(Z=m&~V;|9w)A*p|h^azUSQ^(sfYs~KOK&!02j4)C$E;-Tm~nb9Qg zR1s`~L3YTQ*ZWOtcXZ>&vc9E4M)V~qxiGGBUTl$yrdF7MlQ}_nJUTb;H=6UmXDr$9(Q@dWZI;=7=Fyk&VHdX5&U{=7AslTgg4X1(^ zg2K!a^ZQ^nHlwR>a3{MgUlsX+e| zDN)^8bAX1x_nnkl0^yf~ihl`#8ob%i=g3TPBVSt9?5Dm%#!Q(-1e4ayC-jOmp%SP? zuuI$^jJzPm_dA}PfCS*)PWRhowzd?@o^gbY8*d|@Qu205cCH5xIbSZk#RO5&U@pd3ntsBwRg)QuPF@=&S&S^GPS3a ztv22nJ8JYF2P9!lJ$h^V7Hdmya~9urZR`%2r(}L@0WT!{qajHAAf!2mW^9nX0N#~| z3hsx0(8e^hvVIdfevT*!tn4`tW>tVqp7VUR<=f_eD$bB)%BaJrJ6%BGMXq$p)0N6g z^^71Rl-Jg8uz$a=qIs1}lc*JbCs1ytV>f4E$anmxB~N=lfmj2!S1LqW03@9>(24r8 zJ>m2%;cE!dUpTWs8pYi1;~~W|Ekg{f;^`JODnkF-PZsnJIXyiq0px`?s*2`Z^pXqS zGf-#IGHy)oLLPE@7*F$69wjj}TB)2-)60~;bUv8t3S)vzQvgvG1S!j0 z<#dB?S`mKDx8({h4O#MfQeH|JjxI}9m%O}f)gk#ZqA<_ASLTcML=pTz^=nkdtlj3> zspHo8ReDtfyoqV1O_i)ygoQ9@Mso6a(e;yupR7eWZ0kt0vBsHOXIFLQ%+}k$7N~+q zzZ@>uRk&~lJ&A*eEc@n=2CC-kWeTkeHW)Zv5@X**3@8!=dXjCW%JxR?_r%@Vd3`|l zpR}LAVC(06MR$srLV~^fL+0~i-xo83s)R@GP}_?(^yHm7dXrwsm?9ioY~MKqVa}+E zOBWXcp-rv_&)D~u4&DKFt^0Q_tc!r^krHe;(}b;? zavZNESGSUtwm&kpnNkIT{;h{mz^4^*=Eg`}2LTPT@t%?+eE$Mb-e&DBjxA#Q`h;@f z&CuQfPmKNy54OhUtJEZ3y3GRU^Esqjz2nvhn~mLXCKo&1t*LaoF*RSM!G`z=0TKoQ z#i`GgfnK|96{D}q!EfKdhhD8&yQJfHMLN#JugRFZv@2kWa`r3P(g|kA`?US_{+)<- zZeG*KMpF4G5NT#rfHNG6W-emx+i=hMl-f0#RQJ*AhjIB4-KdQSR5tX*zE_k(*3x=p zRlAgD5~X+08@Bo!RPvt+MXv9`HW`EPh=6#)4wb*ZEV8@vV-gVfi)^kk<>JoBDs8yX z$qfOtqc!4DN<*){(Nd9*rWH~C8ouO2aiBafB{?b6`??b#Ffrz^If7+HGZN|gPDhU4 zkUbvGU%^)Xr=hxkIRExjf57m<1#Hk_@7dH*H^oVghF8PkwyA<7RDGlFBw|;sS;~J! zWD!Co3Zi=dv5W!KV!r1j~qDNY{C?J>nu23bI=SU{N3yNYEH;v-$d1j6cG1K69x>fpiafPIw^9YM~>kn#q`5N=V=qIE5=A2Yd5moB6w6f&mrRCAn_5T zbYws0^1Yzayr}q4m#)3p#v-ic5d(Vqb_0pVulu3%# zsmHLez<2Lp{XGKZD-%EXaoOZdx9#)z75e1um9i@mM5J%u$TM)58ql;dj>8&JCE>db z#;@L&9)EEXd15>*C?YC}NR|^QpxgAfX&rbCHRIq6-W`E@gz!m#_^zcdXTOZDj;+Z~fS>!YEJ+F-8mym?;*BMWgSc4mIuyQKX7-(+zFMUCzo z)}<~CF{DFH{Ss{w%(=A@Y1Fko&x)I3jtx*ohL$aKgjC~;|?u~4n@wq4{vPJ68|6}NIjmI0S0)6`+Z`Xm!N%Z(5XgcE$gC3sUY-g3jAYn}u|#)*M)1(^ zpYFGQ(27ZNeT1=fSr!e7_nyOK5>|V&{*q={gaLvZeWAXY;}fi;90opwXA2n zdGu5mpfE#)qP4^8Nd#DdwoM$pUkQvwRAU)vF9a zOM5NkoFDn>42I4-)kcP!Pl+MCRHL;oQR%POkF;XehI~@6d*mQw@*uKV2Jsxw4)JE@ zBg<-O<~r8Kh7o?RCoJWSRqa0gBZsZ0#1{ve60?du8>2V_6jg(zGp}Dpyh9yYwu(_- zZI7Xpu=>70LDkafdsFuF9%?`G9sUu9)|ydAIR3E1f9>&SIP1`EnIc#W<N*>h6o(o@xUE__Gw!bR=l-;DDCQQB6{6T1jd-KbyYx++f_n315#jmFD^jDu( z$$(V~pevxKu`*ST6mqatWBzM4=|?Lay^v?cSzd;k(MAIin+AZr=Ua5z=BoW5V$)AA zkKcKznZT>*r~7=FTYw8mYZBOlwh&My5U91@yXlvF(L ztIhh)h@b)%rwE<((b`TKazH}9t%hacv_Z~Hj=Oui*Qp78#_k8gGG|?B5$4ZFf%fWs z!K5bN)AreNvBDdDT_ZZ)eET*BV?FFK5lT$IZ{5ZT9pzH3shckT%hJ~;6dCL; zh+%Y4BKiNu1S%K;paKG*cW&1KHSY!5FpL@IjaU)Qz)77SJG|`HV+G=)MwOyp);2`= zA`i-`%z=O3EYTv%+ee0{qLWYG+cw``)qZrZ)qOHuKB+IQ3e^_Ia#r#zEhh2MA6+PO zkIz>GP<(!^w*s^GPgyt)qO1y1jvr>}0yXdcxpsotN{G;V(s8U`bl=nH%vX3;v=Pv~ z=SzAt3oJykI4=!5XPA4!B9~pAAewN9FHiYy;zxZ_9%xEBO@FVcV0wjs3r7a6c^<;> z&g#_}rN5Qn$f#*~fV2ZEiKh-U!$Ks5MY%1<%WvfWn> zCANQhZ8v=+6C&&;VA=63;jaA^{8V1778xjH2B#6~xs)`0M&D`j9h!di-FHIVnrf*Ruitxl$VD_i-~zIJ5Wyb=k@a zakW3GpnrmtV`VJzCH5Aln2J08QIjJ*eq0Ld>k_mj5pc3=A@Uj^`K}*`h@eBWs1u1{ z3F;EgE5hY@CJC}0GTQJcGe|{8%CgIDIElkOnbBVrd?gb2P{)-ISJUxlZhzt%sTg>T z9NOlSZv7zg?(Gr#{pIp(yDhTTuO_&0%*bD+t%GJa_fK!X@*44Dh4A$jIOS~+eNB)) z*HR86XbTo~Vqj|HF1Q8(BRz*BtB;y9hGUuEgD5Xs5blavt(m%=Bblb==fhz5%DRI7 zp1nT8kR|tlW)@rHSc6n=-AteaOgbf3xsQ{?jZf^mzMUkLH<%9$mz&befPL1eW+ zvY}#%%>bhpSq%3-Lbcu3Cb-xpkHtS8F9zU>OzzBQdh7!$-n<@FF!EnaH3+K?6GS?0 zEpiX|r7MzO#SFa}i~ClHp=J@$gqO_mqwBN^wc4SwXryKV8^Oo2)VTE_;XFxXCJ%7N zCm`BDkhXHy45KQw_PQ~)xI28z=bTeO0Kc?5;H9Qk< a^U-n3ru0=@?l#CK>Z(rjv1@~ literal 0 HcmV?d00001