Text Summarization + External API Use Case

Vectara Platform Q&A
1

Hey all,

I am currently working on developing healthcare chatbot applications related to searching and retrieving information from documents. Recently, I came across one of Vectara’s product demo on YouTube (here) that showcased a feature for summarizing search results, specifically for question and answer purposes. I tried to look through the documentation but was unable to find any information about the summarization API. Can you please guide me to where I can find the documentation or the summarization API? If it is not publicly available, could you provide a timeline for its public release?

Other question: What options does Vecatra has in terms of handling external API data? To provide some context, consider the case of OpenAI’s GPT-3 or GPT-4. You can imagine extracting data from a database using an API, and then using that data as input within a prompt to answer questions based on the pulled data. Does Vectara offer any options to handle this use-case?

Preston

2

Hi hoangpa,

Yes, this is currently in a limited beta but should be launched soon.

For your other question: If I understand correctly, you have a database (outside of Vectara) and would like to pull data from that database to include in the LLM response generation. Is that correct?
Can you provide more details on what the database is, or an example of the type of data you would like to include, and the overall use-case?

3

Hi ofermend - thanks for the response. :grinning:

Yes, this is currently in a limited beta but should be launched soon. Got it makes sense

For your other question: If I understand correctly, you have a database (outside of Vectara) and would like to pull data from that database to include in the LLM response generation. Is that correct? That is correct.

Can you provide more details on what the database is, or an example of the type of data you would like to include, and the overall use-case? This project is for a healthcare client so some of the details are under an NDA. Do you have an e-mail address so we can further discuss with me and some of my other team members?

Preston