Question about config.json

#3
by ajping - opened

Currently getting this error when I try to use as an embedding model in llama_index:

Xenova/text-embedding-ada-002 does not appear to have a file named config.json. Checkout 'https://huggingface.co/Xenova/text-embedding-ada-002/main' for available files.

Is this difficult to fix? Would really love to use it.

Hi there. This repository is only for the text-embedding-ada-002 tokenizer, since the model's weights are not open source. As a result, you unfortunately cannot use it with llama_index.

@Xenova Hello, I'd like to know whether this support for optimum-cli export onnx? I use this optimum-cli export on my mac, but I got that error...

raise EnvironmentError(
OSError: Xenova/text-embedding-ada-002 does not appear to have a file named config.json. Checkout 'https://huggingface.co/Xenova/text-embedding-ada-002/tree/main' for available files.

The full CLI is: optimum-cli export onnx --monolith --optimize O2 --framework pt --model Xenova/text-embedding-ada-002 ./text-embedding-ada-002

Thanks!

Sign up or log in to comment