Services Plugins FAQs

Voice Recognition with Actions doesn't work on mobile

Plugins
#1

Hi,

I’ve recently installed this plugin for an app I’m building. It works as expected on desktop - no problems at all.

But when I run the app on mobile, it doesn’t work. The app is a voice-enabled chatbot, and I can get it to work the first time I interact with it, but it stops working after the first round of interactions.

This is the workflow at the end of the first round of interaction (user talks → bot responds → reset states)
https://imgur.com/atlJvtr

This is the workflow that detects when the user talked (it seems like this is where it’s breaking, but I can’t be sure)
https://imgur.com/DsWIlBH

I don’t think I’m doing anything wrong here. I’ve tried to debug this with console logs and whatnot, and the states seem to be changing correctly. I can’t figure out the issue.

Thanks.

Edit: adding to this, I’ve also realised that the ControlledByVoice.IsListening value is not set to true when on mobile, if the user is talking. This works correctly on desktop (the value goes to true when the user starts talking)

#2

Hey @gpirescampos ,
Thank you for contacting us.

To better assist you, could you please clarify a few details?

  • Are you running the app as a web app (via the browser) or as a native app on mobile?

  • What device and operating system are you using (i.e., iPhone with iOS or Android)?

  • In which browser did you check?

These details will help us investigate the issue further. Thank you for your patience!

Best regards,
Anton

#3

Hey @AntonZ,

I’ve managed to fix it. The trick was to run Auto Listen Mode only once. That seems to do the trick.

But now I have another problem: when running this on an iPhone 16 (iOS 18), Safari Browser, the plugin isn’t able to pick up on the voice. Hard to debug this, so any input would be great.

Thanks