zhiyucheng commited on
Commit
9e1371e
·
1 Parent(s): 004f3a4

update readme

Browse files
Files changed (1) hide show
  1. README.md +0 -20
README.md CHANGED
@@ -100,26 +100,6 @@ if __name__ == '__main__':
100
  ```
101
 
102
 
103
- * Accuracy evaluation:
104
-
105
- 1) Prepare the MMLU dataset:
106
- ```sh
107
- mkdir data; wget https://people.eecs.berkeley.edu/~hendrycks/data.tar -O data/mmlu.tar
108
- tar -xf data/mmlu.tar -C data && mv data/data data/mmlu
109
- ```
110
-
111
- 2) Measure MMLU:
112
-
113
- ```sh
114
- python examples/mmlu_llmapi.py --data_dir data/mmlu --hf_model_dir nvidia/DeepSeek-R1-FP4 --tp_size 8 --backend=pytorch
115
- ```
116
-
117
- * Throughputs evaluation:
118
-
119
- Please refer to the [TensorRT-LLM benchmarking documentation](https://github.com/NVIDIA/TensorRT-LLM/tree/main/benchmarks) for details.
120
-
121
-
122
-
123
  ## Ethical Considerations
124
 
125
  NVIDIA believes Trustworthy AI is a shared responsibility and we have established policies and practices to enable development for a wide array of AI applications. When downloaded or used in accordance with our terms of service, developers should work with their internal model team to ensure this model meets requirements for the relevant industry and use case and addresses unforeseen product misuse.
 
100
  ```
101
 
102
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
103
  ## Ethical Considerations
104
 
105
  NVIDIA believes Trustworthy AI is a shared responsibility and we have established policies and practices to enable development for a wide array of AI applications. When downloaded or used in accordance with our terms of service, developers should work with their internal model team to ensure this model meets requirements for the relevant industry and use case and addresses unforeseen product misuse.