@SaiyamPathak Which affordable setup / device would you recommend to run decent inference at home ? DGX Spark is not an option 😁💰
Latest posts 5
I've been diving deeper into how an #LLM works during #inference. This article attempts to demystify these concepts by exploring how a prompt is transformed into generated tokens, explaining prefill, decode, hidden states, attention, ...
exoscale.com/blog/llm-from-…
exoscale.com/blog/llm-from-…
@Proton_Pass any plan to create a provider for External Secret Operator external-secrets.io ?
#Kubernetes
#Kubernetes
I’m a bit worried… last night I dreamt about MIG instances of NVIDIA GPUs 🤔