Don't make breaking changes to the Assistants API endpoints

The assistants list API was recently updated to have a different pagination data structure than it had before. My code was working fine and with no heads up, the API is now returning a different data structure than before. There used to be a pagination object with the fields inside. Now the fields are not wrapped in the pagination object.

Backup handling for V2 Voices

On V1 we built our own API endpoint to fallback to when the Synthflow endpoint did not return a 200 to Twilio. Because of the new SIP logic this is not possible in V2. A plan on how to allow the call to not drop when Synthflow returns an error would be great. Especially after a day like today where all calls were dropped between 9AM-1PM.

WhatsApp Calling

The ability to call directly into WhatsApp. Ex: Contact in GHL/CRM has a WhatsApp number, the outbound agent calls directly into the contact's WhatsApp.

Automatic Local Dialing for Outbound Calls

Description: Local Dialing is a feature that allows calls to be made from phone numbers with the same area code as the recipient. This increases the likelihood of the call being answered, as people are more likely to pick up calls from familiar area codes. Benefits: Increased Pickup Rates: Calls from local numbers are perceived as more trustworthy, leading to higher answer rates. Enhanced Customer Trust: Recipients are more likely to trust and engage with calls from local numbers. Improved Conversion Rates: Higher answer rates can lead to better customer interactions and increased conversions.

Language Feature Requests

### Summary of Key Requests and Suggestions #### Language Support: - Arabic: High demand from clients in the Middle East (UAE, Saudi Arabia) for Arabic language support in COD e-commerce stores. - Other Languages: Requests for Portuguese, Romanian, French, Dutch, German, Italian, Hindi, and Spanish. French and Dutch are specifically requested by users in Belgium. - Multilingual Support: General interest in supporting multiple languages to cater to non-English speaking clients. #### Feature Requests:

Allow Calendar Variable

Allow a variable to be passed for Calendar ID (GHL) so that different calendars can be used by a single assistant.

Ability to save and reuse prompts

Please have the ability to have the AI assistant make an outbound call and book the appointment to Calendly

can we change the number of words to interrupt the assistant?

mine keeps getting caught up in backround noise then stopping the conversations then saying "i didnt catch that"

Phone-Press Action, "Press 0 to speak with a live person"

We would like our Assistant to be able to say, ”Press 0 at any time to speak with a live person” so there is a fail-safe way for inbound callers to quickly get through to our office. The people who call back regularly, would also know how to bypass the Assistant/Receptionist using this feature.

Leave a custom VoiceMail

When the AI assistant hits a voicemail, I want to leave a custom voicemail.

language detection

Currently, when creating a multilingual receptionist, I can create a team of which the lead assistants speaks for example english. If the user would like to speak a different language, they have to say that language in englsh. It would be great if the user could simply start talking, and Synthflow automatically detects which language it is (and then either adjusts to this language or forwards to an assistant with that language). This is possible by letting transcribers of multiple languages transcribe the audio, and then scoring the outcomes to see which language is most likely spoken.

Call transfer caller ID to be callee

Is it possible to change the transfer call number to the callee instead of the AI number Here is the documentation on how to do it with Twilio. https://www.twilio.com/docs/sip-trunking/call-transfer#set-callerid-for-call-transfer Payment tier: Agency Severity level: 3 - Medium (P3) - Non-critical bugs impacting specific users or minor features with workarounds available.

French/English Assistant IA

Is it possible to program an AI assistant in French, and if the person calling speaks English, it automatically switches to English ? Because this is a feature I would need, and I don’t think I’m the only one. Thanks guys

dial keypad functionality

it would be useful if the assistant had dial keypad functionality, for example for letting the user input longer numbers. The transcriber sometimes does not identify those numbers correctly.

Ability to Change the button on a widget from "Call"

to something like Talk to Sales or Talk to Support

Ability to add variables to the post call webhook

In the UI, on the deployment tab, there should be a place to add additional variables to the post call webhook data. I am creating custom endpoints that should make updating people’s CRM’s free, but I need some additional info that would not be something you could add in the phone call.

API to including billing information

- for those building out dashboards please open up the billing portion in the API.

- Voicemail Detection - IVR Detection - DO NOT HANGUP - SEND DTMF Tones

Voicemail Detection: Automated detection of voicemail/IVR System and handling automated answering services. FEATURE REQUEST: Allow the AI to listen to the Voicemail/IVR greeting and NOT HANG UP. Voicemails and IVR systems are encountered roughly 80% of the time on outbound calls! Each of these calls are ending after 10 seconds with no ability to wait 5 seconds and simulate pressing a button such as 0 for the Operator. This is a MAJOR ISSUE and severely limits the adoption of this AI tool for outbound BDR since 80%+ of the outbound calls encounter a voicemail/IVR system and SynthFlow currently ends the call abruptly while capturing the Voicemail greeting in the SynthFlow Post Call Transcript. FEATURE REQUEST: Allow the AI to listen and capture the transcript of the greeting and dial (send DTMF tones) for connecting to the right department such as “Press 5 for the Accounting Department”. For example/Use Case, listening to the entire IVR/Voicemail greeting and listening for the words “Customer Service” or “Accounting” and dialing the correct number to connect to the “Customer Service” department or the “Accounting” department. For example, The greeting says “Thank you for calling Acme corporation, Please dial 1 for the dial by name directory, please dial 5 for the Accounting department or Dial 0 to be connected to someone in Customer Service”. If listening for “Accounting” the IVR system says “dial 5 for the Accounting department"” the system listens for the word “Accounting” and dials the appropriate number to be connected to a Live person in that corresponding department(i.e. Accounting Department). Another example/use case, The greeting says “Thank you for calling Acme corporation, Please dial 1 for the dial by name directory, please dial 5 for the Accounting department or Dial 0 to be connected to someone in Customer Service”. If listening for “Customer Service” and the system says “Dial 0 to be connected to Customer Service” SynthFlow dials 0 (Sends DTMF tones for simulating pressing 0) to be connected to a Live person in that corresponding department(i.e. Customer Service).

rebilling in other currencies than USD

we are a German voiceAI agency, and it’s not optimal to let our clients pay in USD (mainly since the exchange rates may vary which can be risky for them). It would be great if we could charge in different currencies like EUR

Set twilio credentials using Sub Account API

Currently, the PUT API for sub accounts does not allow us to set twilio configs (or if it does, it’s not documented). We really need to be able to configure this when provisioning new clients, as it’s the only thing preventing us from fully automating our account creation process

UI to view and manage subaccount payments

Spell Email

It would be incredibly useful if the transcriber would be improved, so that it is able to transcribe names or email adresses reliably.

more transcriber options

It would be great to have more options for transcribers to choose from. We have experienced that the current transcriber sometimes does not work very well for the german language. From our own experience, we know that azure ai speech works well in german.

Add Vonage - phone number provider

Import Action from Agency to Subaccount

Would be great to have the ability to import the following actions from Agency to Subaccount: - Real Time Booking - Call Transfer - Information Extractor - Send SMS

Ability to Copy Transfer Prompts in an Account

I just spent over an hour adding an employee list. Every prompt field was pretty much the same except agent referring to transfer target name. I had to copy/paste, copy/paste, copy/paste, copy/paste, copy/paste 5-6 fields of the same thing within each transfer protocol.

Multi language support for agents

White-Label Chat Widget that shares the Knowledge Base with the Voice. The SMS should be able to make a live API call during chat so we can provide live status checks to users.

Live Routing to multiple different numbers (Inbound Calls)

This is our MOST requested feature from our client base. The current IVR's are a awful experience for callers. Caller Example 1: I'm calling to talk to accounting---- Live routing the call to accounting Caller Example 2: I want to talk to sales--- Live route to sale line Caller Example 3: Can I speak to George McMan--- Live route the call to George number Caller Example 4: Is Jane Palmer around?---- Live route the call to Jane at Number and Extension 104

Integrate with Cartesia - the voices are incredible.

https://play.cartesia.ai/ There's a new player in town that recently released and the voices they have are incredible. Would love to see these brought in.

Make HIPAA compliance possible

This is a must for medical clinics.

Real-Time API Request during Phone Call

Create a custom webhook action to integrate with other platforms.

Time Zone Aware

It would be a great feature is the Ai could have a current time awareness. Perhaps even UTC and we can in the prompt put the current local time zone and office hours. For many of the business we deal with they would like the Ai to be able to advise the caller that the office is currently closed but I'm your Ai assistant how can I help.

Info Extractor Templates

Templates for info extractors so we can use the template in multiple assistants. Also as an agency be able to use those templates in all sub-accounts.

Expanded VoIP/SIP Provider Integration and Customizable Trunk Options

Currently, the platform supports only Twilio for VoIP/SIP services through its integration. While Twilio is a robust and reliable solution, it would be highly advantageous for users to have the flexibility to choose from a variety of VoIP/SIP providers according to their specific needs and preferences. It would be immensely beneficial if the platform could include an option to "Bring Your Own Trunk/Carrier." This feature would allow users to integrate any SIP trunk or VoIP provider of their choice. Here are some of the key benefits: Increased Flexibility: Users could select providers that best meet their cost, feature, and service level agreement (SLA) requirements. Improved Redundancy: Enabling connections to multiple SIP trunks would increase reliability and uptime through redundancy. Optimized Costs: Users could manage costs better by choosing the most economical provider for their geographic region or usage pattern. Enhanced Customization: Specialized needs that might be better served by providers other than Twilio, which may have unique features or regional advantages. Greater Control: Allowing businesses to utilize existing contracts with their preferred SIP trunk providers, ensuring seamless integration with their current telecommunication infrastructure. We believe that expanding the supported VoIP/SIP providers and adding a customizable trunk option would significantly enhance the utility and flexibility of the Synthflow platform, making it an even more powerful tool for businesses with diverse and dynamic communication needs.

Custom Actions Templates

As an agency, be able to use all custom action templates across all sub-accounts.