Spaces:

huggingchat

/

chat-ui

like 1.09k

Running

Hey, thanks for the feedback! Yes it's indeed something we're aware of, the summarization step takes a long time especially.

I was toying with the idea of using a smaller(&faster) model for tasks like generating the search query and summarizing the content. (or @victor suggested simply using a better webpage parser so that we don't need summarization at all, which would be even better)

So lots of potential improvements still within reach in terms of speed!