语音命令识别代码生成树莓π

fs = 16000;classificationRate = 20;samplesPerCapture = fs / classificationRate;segmentDuration = 1;segmentSamples =圆(segmentDuration * fs);frameDuration = 0.025;frameSamples =圆(frameDuration * fs);hopDuration = 0.010;hopSamples =圆(hopDuration * fs);地板numSpectrumPerSpectrogram = ((segmentSamples-frameSamples) / hopSamples) + 1;

afe = audioFeatureExtractor (…“SampleRate”fs,…“FFTLength”,512,…“窗口”损害(frameSamples“周期”),…“OverlapLength”frameSamples - hopSamples…“barkSpectrum”,真正的);numBands = 50;setExtractorParameters (afe“barkSpectrum”,“NumBands”numBands,“WindowNormalization”、假);numElementsPerSpectrogram = numSpectrumPerSpectrogram * numBands;

负载(“commandNet.mat”. class)标签= trainedNet.Layers(结束);NumLabels =元素个数(标签);BackGroundIdx =找到(标签= =“背景”);

probBuffer =单(0 ([NumLabels classificationRate / 2]));YBuffer =单(NumLabels * (1, classificationRate / 2));countThreshold =装天花板(classificationRate * 0.2);probThreshold =单(0.7);

adr = audioDeviceReader (“SampleRate”fs,“SamplesPerFrame”samplesPerCapture,“OutputDataType”,“单一”);audioBuffer = dsp.AsyncBuffer (fs);

matrixViewer = dsp.MatrixViewer (“ColorBarLabel”,“权力/乐队(dB /乐队)”,…“包含”,“帧”,…“YLabel”,“汪汪”乐队,…“位置”(400 100 600 250),…“ColorLimits”2.6445 [4],…“AxisOrigin”,“左下角”,…“名称”,“使用深度学习语音命令识别”);timeScope = timeScope (“SampleRate”fs,…“YLimits”[1],…“位置”(400 380 600 250),…“名称”,“使用深度学习语音命令识别”,…“TimeSpanSource”,“财产”,…“时间间隔”,1…“BufferLength”fs,…“YLabel”,“振幅”,…“ShowGrid”,真正的);

显示(timeScope) (matrixViewer)期限= 10;抽搐而isVisible (timeScope) & & isVisible (matrixViewer) & & toc <时限%捕捉音频x = adr ();写(audioBuffer x);fs, y =阅读(audioBuffer fs-samplesPerCapture);%计算听觉功能=特征提取(afe y);+ 1 e-6 auditoryFeatures = log10(特性);%进行预测聚合氯化铝=预测(trainedNet auditoryFeatures);[~,YPredicted] = max(聚合氯化铝);%进行统计后加工YBuffer = [YBuffer(2:结束),YPredicted);probBuffer = [probBuffer(:, 2:结束)、聚合氯化铝(:));[YModeIdx,计数]=模式(YBuffer);maxProb = max (probBuffer (YModeIdx:));如果YModeIdx单一(BackGroundIdx) = = | |单(count) < countThreshold | | maxProb < probThreshold speechCommandIdx = BackGroundIdx;其他的speechCommandIdx = YModeIdx;结束%更新图matrixViewer (auditoryFeatures ');timeScope (x);如果(speechCommandIdx = = BackGroundIdx) timeScope。Title =' ';其他的timeScope。Title =char(labels(speechCommandIdx));结束drawnowlimitrate结束

隐藏(matrixViewer)隐藏(timeScope)

generateMATLABFunction (afe“extractSpeechFeatures”)

hostIPAddress = coder.Constant (“172.18.230.30”);

cfg = coder.config (exe”);cfg。TargetLang =“c++”;

dlcfg = coder.DeepLearningConfig (“arm-compute”);dlcfg。ArmArchitecture =v7的;dlcfg。ArmComputeVersion =“20.02.1”;cfg。DeepLearningConfig = dlcfg;

r = raspi (“raspiname”,“π”,“密码”);

hw = coder.hardware (“树莓π”);cfg。硬件= hw;

buildDir =“~ / remoteBuildDir”;cfg.Hardware。BuildDir = BuildDir;

cfg。GenerateExampleMain =“GenerateCodeAndCompile”;

codegen配置cfgHelperSpeechCommandRecognitionRasPiarg游戏{hostIPAddress}报告- v

applicationName =“HelperSpeechCommandRecognitionRasPi”;applicationDirPaths = raspi.utils.getRemoteBuildDirectory (“applicationName”applicationName);targetDirPath = applicationDirPaths {1} .directory;exeName = strcat (applicationName,“.elf”);命令= [“cd”targetDirPath”;。/”exeName“& > 1 &”];系统(r,命令);

targetIPAddress =“172.18.231.92”;UDPSend = dsp.UDPSender (“RemoteIPPort”,26000,“RemoteIPAddress”,targetIPAddress);

sizeOfFloatInBytes = 4;maxUDPMessageLength =地板(65507 / sizeOfFloatInBytes);samplesPerPacket = 1 + numElementsPerSpectrogram;numPackets =地板(maxUDPMessageLength / samplesPerPacket);bufferSize = numPackets * samplesPerPacket * sizeOfFloatInBytes;UDPReceive = dsp.UDPReceiver (“LocalIPPort”,21000,…“MessageDataType”,“单身”,…“MaximumMessageLength”samplesPerPacket,…“下面的”bufferSize);

UDPSend (0 (samplesPerCapture 1“单身”));

显示(timeScope) (matrixViewer)期限= 20;抽搐而isVisible (timeScope) & & isVisible (matrixViewer) & & toc <时限% RasPi捕捉音频和发送x = adr ();UDPSend (x);%从RasPi接收数据包udpRec = UDPReceive ();如果~ isempty (udpRec)%提取预测指数,最后的样品收到UDP数据包speechCommandIdx = udpRec(结束);%提取听觉谱图规范=重塑(udpRec (1: numElementsPerSpectrogram), [numBands numSpectrumPerSpectrogram]);%显示时域信号和听觉谱图timeScope (x) matrixViewer(规范)如果speechCommandIdx = = BackGroundIdx timeScope。Title =' ';其他的timeScope。Title =char(labels(speechCommandIdx));结束drawnowlimitrate结束结束隐藏(matrixViewer)隐藏(timeScope)

stopExecutable (codertarget.raspi.raspberrypi exeName)发布(UDPSend)发布(UDPReceive)

cfg = coder.config (“自由”,“是”,真正的);cfg。VerificationMode =“公益诉讼”;

dlcfg = coder.DeepLearningConfig (“arm-compute”);cfg。DeepLearningConfig = dlcfg;cfg.DeepLearningConfig。ArmArchitecture =v7的;cfg.DeepLearningConfig。ArmComputeVersion =“19.05”;

如果(~ (“r”,“var”)r = raspi (“raspiname”,“π”,“密码”);结束hw = coder.hardware (“树莓π”);cfg。硬件= hw;

buildDir =“~ / remoteBuildDir”;cfg.Hardware。BuildDir = BuildDir;cfg。TargetLang =“c++”;

cfg。CodeExecutionProfiling = true;codegen配置cfgProfileSpeechCommandRecognitionRaspiarg游戏{兰德(samplesPerCapture 1 '单')}报告- v

testDur = 50 e - 3;我会= 100;为k = 1:我会x = pinknoise (fs * testDur,“单一”);[speechCommandIdx, auditoryFeatures] = ProfileSpeechCommandRecognitionRaspi_pil (x);结束

清晰的ProfileSpeechCommandRecognitionRaspi_pil

executionProfile = getCoderExecutionProfile (“ProfileSpeechCommandRecognitionRaspi”);报告(executionProfile,…“单位”,“秒”,…“ScaleFactor”,“1 e 03”,…“NumericFormat”,' % 0.4 f ')