Spaces:
Running
Running
Commit
•
79b9ec9
1
Parent(s):
f13aea8
Update README.md
Browse files
README.md
CHANGED
|
@@ -7,14 +7,29 @@ sdk: static
|
|
| 7 |
pinned: false
|
| 8 |
---
|
| 9 |
|
| 10 |
-
|
| 11 |
|
| 12 |
-
|
| 13 |
|
| 14 |
-
[
|
| 15 |
-
[Demo video]
|
| 16 |
|
| 17 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 18 |
|
| 19 |
To experiment with the realtime video chat application, you will need to run it locally. We have provided a [docker container](https://hub.docker.com/r/syntheticpatients/base) with the requirements. You will need: API keys for OpenAI and ElevenLabs to run this program; you will be prompted to provide them. You will need an account to both of these services to get the keys and will be charged for usage. These keys will only be stored within your instance of docker and will not be shared.
|
| 20 |
|
|
@@ -32,12 +47,12 @@ This will take a significant amount of time to download, as it currently is arou
|
|
| 32 |
|
| 33 |
This will launch the synthetic patient server using your OpenAI and ElevenLabs API. Once the server has completed launching, direct your browser to http://localhost:5000/client to begin interacting.
|
| 34 |
|
| 35 |
-
|
| 36 |
|
| 37 |
- Because of docker's audio limitations, voice-recognition has been disabled. You will need to input text through a text field.
|
| 38 |
- Depending on the computer running the server, response times may be quite slow.
|
| 39 |
|
| 40 |
-
|
| 41 |
-
|
| 42 |
-
|
| 43 |
|
|
|
|
| 7 |
pinned: false
|
| 8 |
---
|
| 9 |
|
| 10 |
+
# Synthetic Patients
|
| 11 |
|
|
|
|
| 12 |
|
| 13 |
+
|
|
|
|
| 14 |
|
| 15 |
+
# Welcome
|
| 16 |
+
|
| 17 |
+
Welcome to our repository. Here, we have a collection of files and links to share our work on generating a new type of virtual patient with artificial intelligence.
|
| 18 |
+
|
| 19 |
+
## Data
|
| 20 |
+
|
| 21 |
+
- Patient profiles are available in the ```patient_profiles``` folder in this repository.
|
| 22 |
+
- The underlying codebase for our application (excluding external packages) is available in the ```code``` folder of this repository.
|
| 23 |
+
- To experiment with the platform and experience the realtime video chat applicaiton, we suggest using the containerized Docker version of the application.
|
| 24 |
+
|
| 25 |
+
## Links
|
| 26 |
+
|
| 27 |
+
- Our preprint (link pending)
|
| 28 |
+
- A low-resolution demo video is below.
|
| 29 |
+
- [Video demonstration](alxgd.s3.amazonaws.com/demo.mp4) showcasing a prototype of our platform.
|
| 30 |
+
- [Presentation](https://alx.gd/ase_presentation) from the 2024 Association of Surgical Education.
|
| 31 |
+
|
| 32 |
+
# Installation
|
| 33 |
|
| 34 |
To experiment with the realtime video chat application, you will need to run it locally. We have provided a [docker container](https://hub.docker.com/r/syntheticpatients/base) with the requirements. You will need: API keys for OpenAI and ElevenLabs to run this program; you will be prompted to provide them. You will need an account to both of these services to get the keys and will be charged for usage. These keys will only be stored within your instance of docker and will not be shared.
|
| 35 |
|
|
|
|
| 47 |
|
| 48 |
This will launch the synthetic patient server using your OpenAI and ElevenLabs API. Once the server has completed launching, direct your browser to http://localhost:5000/client to begin interacting.
|
| 49 |
|
| 50 |
+
## Notes
|
| 51 |
|
| 52 |
- Because of docker's audio limitations, voice-recognition has been disabled. You will need to input text through a text field.
|
| 53 |
- Depending on the computer running the server, response times may be quite slow.
|
| 54 |
|
| 55 |
+
## V
|
| 56 |
+
<video controls autoplay src="https://cdn-uploads.huggingface.co/production/uploads/6484c2be80f390fe86437928/y0W9bvVVdaz5jkvruMhMe.mp4"></video>
|
| 57 |
+
emo_low_res.mp4…]()
|
| 58 |
|