Voice Recoginition ala Alexa mit FHEM!

[hankie]

Hallo zusammen,

ich nutze FHEM seit ca. 8 Jahre wurde mein Benutzerkonto aber irgendwie deaktiviert. Ich befasse mich gerade mit dem Thema lokale Spracherkennung/Assitenz ohne Google/Amazon und Co.
Ein Kollege von mir hat auf Rasp Snips (https://snips.gitbook.io) gezeigt. Der kann lokal die Sprache analysieren (natürlich nur NLP und keine Kontext) und diese z.b. per MQTT an FHEM schicken.
Ich bin soweit gekommen, dass die USB-Audio funktioniert (abspielen aufnehmen) aber ich bekomme den Snips-Server irgendwie nicht richtig zum laufen.
Hat jemand damit Erfahrung?

Code Auswählen Erweitern

pi@raspberrypi /var/lib/mosquitto $ snips-audio-server -vvv
[12:23:27.576429] DEBUG:snips_common_cli::cli: conf lookup: snips-audio-server.frame -> Ok(None)
[12:23:27.577323] DEBUG:snips_common_cli::cli: conf lookup: snips-common.frame -> Ok(None)
[12:23:27.577512] DEBUG:snips_common_cli::cli: conf lookup: snips-audio-server.hijack -> Ok(None)
[12:23:27.577686] DEBUG:snips_common_cli::cli: conf lookup: snips-common.hijack -> Ok(None)
[12:23:27.577846] DEBUG:snips_common_cli::cli: conf lookup: snips-audio-server.nomike -> Ok(None)
[12:23:27.577990] DEBUG:snips_common_cli::cli: conf lookup: snips-common.nomike -> Ok(None)
[12:23:27.578139] DEBUG:snips_common_cli::cli: conf lookup: snips-audio-server.mike -> Ok(None)
[12:23:27.578277] DEBUG:snips_common_cli::cli: conf lookup: snips-common.mike -> Ok(None)
[12:23:27.578419] DEBUG:snips_common_cli::cli: conf lookup: snips-audio-server.bind -> Ok(None)
[12:23:27.578557] DEBUG:snips_common_cli::cli: conf lookup: snips-common.bind -> Ok(None)
[12:23:27.578713] DEBUG:snips_common_cli::cli: conf lookup: snips-audio-server.bind -> Ok(None)
[12:23:27.578883] DEBUG:snips_common_cli::cli: conf lookup: snips-common.bind -> Ok(None)
[12:23:27.579047] DEBUG:snips_common_cli::cli: conf lookup: snips-audio-server.bus -> Ok(None)
[12:23:27.579186] DEBUG:snips_common_cli::cli: conf lookup: snips-common.bus -> Ok(None)
[12:23:27.579338] DEBUG:snips_common_cli::cli: conf lookup: snips-audio-server.mqtt -> Ok(None)
[12:23:27.579478] DEBUG:snips_common_cli::cli: conf lookup: snips-common.mqtt -> Ok(None)
[12:23:27.580487] DEBUG:snips_common_cli::cli: conf lookup: snips-audio-server.mqtt_username -> Ok(None)
[12:23:27.580787] DEBUG:snips_common_cli::cli: conf lookup: snips-common.mqtt_username -> Ok(None)
[12:23:27.580996] DEBUG:snips_common_cli::cli: conf lookup: snips-audio-server.mqtt_password -> Ok(None)
[12:23:27.581181] DEBUG:snips_common_cli::cli: conf lookup: snips-common.mqtt_password -> Ok(None)
[12:23:27.581365] DEBUG:snips_common_cli::cli: conf lookup: snips-audio-server.mqtt_tls_hostname -> Ok(None)
[12:23:27.581644] DEBUG:snips_common_cli::cli: conf lookup: snips-common.mqtt_tls_hostname -> Ok(None)
[12:23:27.626478] DEBUG:snips_audio_server   : About to start audio main server on MQTT with site-id default
[12:23:27.626852] DEBUG:snips_common_cli::cli: conf lookup: snips-audio-server.disable_playback -> Ok(None)
[12:23:27.627095] DEBUG:snips_common_cli::cli: conf lookup: snips-common.disable_playback -> Ok(None)
[12:23:27.627294] DEBUG:snips_common_cli::cli: conf lookup: snips-audio-server.output -> Ok(None)
[12:23:27.627452] DEBUG:snips_common_cli::cli: conf lookup: snips-common.output -> Ok(None)
[12:23:27.628252] DEBUG:snips_broadcast_mqtt_server: Audio reading started
[12:23:27.636709] DEBUG:snips_audio_portaudio      : Attempt 0
[12:23:27.637109] DEBUG:snips_broadcast_mqtt_server: MQTT Audio forwarding thread started
[12:23:27.637476] DEBUG:snips_audio_portaudio      : Mike source capture started
[12:23:27.737052] DEBUG:snips_audio_portaudio      : Attempt 1
ALSA lib pcm_dsnoop.c:618:(snd_pcm_dsnoop_open) unable to open slave
ALSA lib pcm.c:2239:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.rear
ALSA lib pcm.c:2239:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.center_lfe
ALSA lib pcm.c:2239:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.side
[12:23:27.837419] DEBUG:snips_audio_portaudio      : Attempt 2
ALSA lib pcm.c:2239:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.hdmi
ALSA lib pcm.c:2239:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.hdmi
ALSA lib pcm.c:2239:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.modem
ALSA lib pcm.c:2239:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.modem
ALSA lib pcm.c:2239:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.phoneline
ALSA lib pcm.c:2239:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.phoneline
Cannot connect to server socket err = No such file or directory
Cannot connect to server request channel
jack server is not running or cannot be started
[12:23:27.926388] DEBUG:snips_audio_portaudio      : Portaudio: Ok("PortAudio V19-devel (built Feb 21 2014 06:46:01)")
[12:23:27.926744] DEBUG:snips_audio_portaudio      : Looking for default input device
[12:23:27.926947] INFO :snips_audio_portaudio      : Use input device: "default"
[12:23:27.927210] DEBUG:snips_audio_portaudio      : Start capture: InputSettings { params: Parameters { device: Index(DeviceIndex(8)), channel_count: 1, suggested_latency: 0.008707482993197279, is_interleaved: true, sample_format: PhantomData }, sample_rate: 16000.0, frames_per_buffer: 256, flags:  }
[12:23:27.938186] DEBUG:snips_audio_portaudio      : Attempt 3
[12:23:27.961461] DEBUG:snips_audio_portaudio      : start capture loop
...
[12:23:32.563593] DEBUG:snips_audio_portaudio      : Attempt 49
[12:23:32.664230] DEBUG:snips_broadcast_mqtt_server: MQTT Audio forwarding thread ended
[12:23:32.665264] ERROR:snips_audio_server         : Can not read a stopped source

bzw.

Code Auswählen Erweitern

pi@raspberrypi /var/lib/mosquitto $ sudo systemctl status snips-audio-server -l
● snips-audio-server.service - Snips Audio Server
   Loaded: loaded (/lib/systemd/system/snips-audio-server.service; enabled)
   Active: active (running) since Sun 2018-09-23 12:01:39 CEST; 24min ago
Main PID: 5093 (snips-audio-ser)
   CGroup: /system.slice/snips-audio-server.service
           └─5093 /usr/bin/snips-audio-server

Sep 23 12:01:40 raspberrypi snips-audio-server[5093]: Home directory not accessible: Permission denied
Sep 23 12:01:40 raspberrypi pulseaudio[5125]: [pulseaudio] authkey.c: Failed to open cookie file '/var/empty/.config/pulse/cookie': No such file or directory
Sep 23 12:01:40 raspberrypi pulseaudio[5125]: [pulseaudio] authkey.c: Failed to load authorization key '/var/empty/.config/pulse/cookie': No such file or directory
Sep 23 12:01:40 raspberrypi pulseaudio[5125]: [pulseaudio] authkey.c: Failed to open cookie file '/var/empty/.pulse-cookie': No such file or directory
Sep 23 12:01:40 raspberrypi snips-audio-server[5093]: ALSA lib pulse.c:243:(pulse_connect) PulseAudio: Unable to connect: Connection refused
Sep 23 12:01:40 raspberrypi snips-audio-server[5093]: Cannot connect to server socket err = No such file or directory
Sep 23 12:01:40 raspberrypi snips-audio-server[5093]: Cannot connect to server request channel
Sep 23 12:01:40 raspberrypi snips-audio-server[5093]: jack server is not running or cannot be started
Sep 23 12:01:40 raspberrypi snips-audio-server[5093]: INFO:snips_audio_portaudio: Use input device: "default"
Sep 23 12:25:59 raspberrypi systemd[1]: Started Snips Audio Server.

[MadMax-FHEM]

Hab jetzt nicht im Detail geschaut was du machst/gemacht hast aber das hier kennst du?!

https://forum.fhem.de/index.php/topic,89548.msg820184.html#msg820184

Wobei ich dort (aus Zeitmangel) aktuell nur mitlese...

Gruß, Joachim