ElevenLabs, a startup known for its AI voice cloning and text-to-speech services, has introduced a new feature that allows users to create custom conversational AI bots. |
How does it work? After logging into their ElevenLabs account, users can either choose a template or create a new bot from scratch. They can pick the bot’s language, set the first message, and define its personality. Developers also select a large language model (Gemini, GPT, or Claude), adjust how creative the responses should be, and set limits on token usage. |
There are other settings too, like choosing the bot's voice, managing latency, and deciding how long the conversation can last. Users can add their own content, like a file or a URL, to help the bot respond better. It also supports custom integrations using SDKs for Python, JavaScript, React, and Swift. |
While the company is using its text-to-speech pipeline for the new bots, it still needs to develop speech-to-text capabilities. Currently, the company doesn't offer its speech-to-text API as a standalone product, but it may do so in the future, potentially competing with Google, Microsoft, and Amazon’s speech-to-text services. |