6

I was in a meeting on Google Meet and saw that you could turn on real time subtitles. They've actually got a demo here on how realtime speech to text can be done, so that bit doesn't confuse me.

I had also been wanting to experiment with WebRTC (which I believe GoogleMeet uses) just to see its capabilities - e.g. the ability to share a screen without any additional screens.

However, I've always been under the impression that a WebRTC video/audio stream is client peer-to-peer. The questions I have therefore are

  • How then are Google able to send the audio stream off to a server for analysis?
  • Is it possible to send the audio stream to the client as well as to a server?
  • Would you have to create two of the same audio stream (i don't know if this is even possible), send one over WebRTC to the other peer(s) and the other to a server for analysis?

How do they achieve this - and if they don't use WebRTC, is it possible to achieve this with WebRTC?

1 Answer 1

8

Google Meet is using WebRTC. The "peer" in that case is a server, not a browser. While six years old and some details have changed, much of this old article is still true. From the server Google can do audio processing.

This video describes the architecture required for speech-to-text (and actually translation + text-to-speech again).

1
  • 1
    Thank you for this. I thought the whole point of WebRTC P2P was to bypass the server and go to the client directly, thus what might have been a silly question. Thank you nonetheless! Mar 27, 2020 at 9:41

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.