Morgan Funtowicz's picture

16 1 4

Morgan Funtowicz

mfuntowicz

·

https://github.com/mfuntowicz

AI & ML interests

Model inference low-level optimization, hardware affinity and large-scale distributed training.

Articles

Hugging Face on AMD Instinct MI300 GPU

CPU Optimized Embeddings with 🤗 Optimum Intel and fastRAG

Accelerating SD Turbo and SDXL Turbo Inference with ONNX Runtime and Olive

AMD + 🤗: Large Language Models Out-of-the-Box Acceleration with AMD GPU

Optimum-NVIDIA - Unlock blazingly fast LLM inference in just 1 line of code

Accelerating over 130,000 Hugging Face models with ONNX Runtime

Case Study: Millisecond Latency using Hugging Face Infinity and modern CPUs

Scaling up BERT-like model Inference on modern CPU - Part 2

Introducing Optimum: The Optimization Toolkit for Transformers at Scale

Scaling-up BERT Inference on CPU (Part 1)

Organizations

mfuntowicz's activity

New activity in optimum-nvidia/README 2 days ago

TensorRT-LLM Meetup San Francisco September 18th

#1 opened 2 days ago by

New activity in FacebookAI/roberta-large 8 months ago

Adding ONNX file of this model

#3 opened over 1 year ago by

New activity in distilbert/distilbert-base-multilingual-cased over 1 year ago

Adding ONNX file of this model

#4 opened over 1 year ago by

D3v

New activity in philschmid/distilbert-onnx-banking77 about 2 years ago

Added Infinity endpoint

#1 opened about 2 years ago by