huggingface/hf-speech-bench · TypeError: string indices must be integers

Hugging Face org Nov 8, 2022

This space throws an error:

TypeError: string indices must be integers
Traceback:

File "/home/user/.local/lib/python3.8/site-packages/streamlit/scriptrunner/script_runner.py", line 554, in _run_script
    exec(code, module.__dict__)
File "/home/user/app/app.py", line 143, in <module>
    dataframe = get_data()
File "/home/user/.local/lib/python3.8/site-packages/streamlit/legacy_caching/caching.py", line 573, in wrapped_func
    return get_or_create_cached_value()
File "/home/user/.local/lib/python3.8/site-packages/streamlit/legacy_caching/caching.py", line 557, in get_or_create_cached_value
    return_value = func(*args, **kwargs)
File "/home/user/app/app.py", line 107, in get_data
    for row in parse_metrics_rows(meta):
File "/home/user/app/app.py", line 72, in parse_metrics_rows
    lang = result["dataset"]["args"]["language"]

hlevring

Nov 24, 2022

https://huggingface.co/spaces/huggingface/hf-speech-bench still throws Error.

@sanchit-gandhi may be a good idea to fix sooner than later since due to your reference in your really great post here
https://huggingface.co/blog/fine-tune-whisper

sanchit-gandhi

Hugging Face org Nov 28, 2022

Hey @hlevring - thanks for checking out the blog post and for flagging this issue! We're exploring moving everything to 'autoevaluate': https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=mozilla-foundation%2Fcommon_voice_11_0&only_verified=0&task=automatic-speech-recognition&config=hi&split=test&metric=wer

It works much more robustly there!

Will keep you in the loop with progress