onnxruntime

@onnxruntime

Cross-platform training and inferencing accelerator for machine learning models.

onnxruntime.ai Joined September 2018

42 Following 1.4K Followers 282 Posts

Latest posts 5

onnxruntime @onnxruntime Apr 23, 2024

ONNX Runtime & DirectML now support Phi-3 mini models cross-platforms & devices! Plus, the new ONNX Runtime Generate() API simplifies LLM integration into your apps. Try Phi-3 on your favorite hardware! Read more: onnxruntime.ai/blogs/accelera… #ONNX #DirectML #Phi3

onnxruntime @onnxruntime Oct 16, 2023

Run PyTorch models in the browser, on mobile and desktop, with #onnxruntime, in your language and development environment of choice 🚀onnxruntime.ai/blogs/pytorch-…

onnxruntime @onnxruntime Feb 13, 2023

#ONNX Runtime saved the day with our interoperability and ability to run locally on-client and/or cloud! Our lightweight solution gave them the performance they needed with quantization & configuration tooling. Learn how they achieved this in this blog!
cloudblogs.microsoft.com/opensource/202…

opensource.microsoft.com ONNX Runtime: performant on-device inferencing | Microsoft Open Source Blog The team at Pieces shares the problems and solutions evaluated for their on-device model serving stack and how ONNX Runtime enables their success.

onnxruntime @onnxruntime Feb 8, 2023

Give yourself a treat (like this adorable🐶 deserves) and read this blog on how to use #ONNX Runtime on #Android!

devblogs.microsoft.com/surface-duo/on…

SurfaceDuoDev @surfaceduodev Feb 2, 2023

Quick intro to @onnxruntime and applying #machinelearning on Android

devblogs.microsoft.com/surface-duo/on…
View quoted post on X

onnxruntime @onnxruntime Feb 1, 2023

📢 This new blog by @tryolabs is awesome! Learn how to fine-tune a NLP model and accelerate with #ONNXRuntime!

Tryolabs @tryolabs Jan 30, 2023

Maximize the power of LLMs! 💬 Our step-by-step guide covers fine-tuning for specific NLP tasks w/ GPT-3, OPT, & T5.

We shared everything from building custom datasets to optimizing inf time with @huggingface 🤗Optimum and @onnxai.🚀
https://t.co/7uYwGAVWR1
#LargeLanguageModels
View quoted post on X