DEV Community

#gpu

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
How Many Closed Findings Before You Trust a Routing Change
qisuancloud profile

How Many Closed Findings Before You Trust a Routing Change

#llm #ai #gpu #inference
1
Comments
10 min read
GPU Paths Honestly: What csperf Can and Cannot Claim Today
aabhinavg profile

GPU Paths Honestly: What csperf Can and Cannot Claim Today

#gpu #hip #opencl #csperf
Comments
4 min read
Serving Hy-SimulMT live on one 48 GB GPU: the startup spike, the FP8 trap, what to measure
inferencekeydev profile

Serving Hy-SimulMT live on one 48 GB GPU: the startup spike, the FP8 trap, what to measure

#ai #machinelearning #gpu #selfhosted
1
Comments
5 min read
LoRA vs full fine-tuning: when is LoRA good enough?
viswaretas_kotra profile

LoRA vs full fine-tuning: when is LoRA good enough?

#machinelearning #llm #finetuning #gpu
Comments 1
8 min read
Certified kernels, guaranteed at install time
benkelaya profile

Certified kernels, guaranteed at install time

#opensource #machinelearning #python #gpu
Comments
2 min read
A100, H100, H200, B200, B300: which GPU should you pick?
viswaretas_kotra profile

A100, H100, H200, B200, B300: which GPU should you pick?

#gpu #machinelearning #nvidia #ai
Comments
8 min read
Serving Groot-19B-A3B at 256K on one RTX 5090: the memory budget and the thinking trap
inferencekeydev profile

Serving Groot-19B-A3B at 256K on one RTX 5090: the memory budget and the thinking trap

#ai #llm #gpu #selfhosted
Comments
5 min read
Nvidia lost $600B in 4 days, then its CEO resigned
frankchu profile

Nvidia lost $600B in 4 days, then its CEO resigned

#discuss #ai #nvidia #gpu
1
Comments
4 min read
Continuous Batching: Why Your GPU Waits for the Slowest Request
net_satsawat profile

Continuous Batching: Why Your GPU Waits for the Slowest Request

#llm #machinelearning #performance #gpu
Comments
7 min read
B200 vs H200: which is the better GPU for LLM work?
viswaretas_kotra profile

B200 vs H200: which is the better GPU for LLM work?

#gpu #ai #machinelearning #nvidia
Comments
9 min read
What are the best Paperspace alternatives in 2026?
viswaretas_kotra profile

What are the best Paperspace alternatives in 2026?

#gpu #machinelearning #cloud #ai
Comments
8 min read
Parsing a whole PDF in one request with Unlimited OCR 2: the crop_mode setting and a silent cut
inferencekeydev profile

Parsing a whole PDF in one request with Unlimited OCR 2: the crop_mode setting and a silent cut

#ai #machinelearning #python #gpu
Comments
4 min read
Tell Me Your tok/s and I'll Tell You What Your GPU Actually Delivers
jaxsinclair profile

Tell Me Your tok/s and I'll Tell You What Your GPU Actually Delivers

#llm #hardware #performance #gpu
Comments
4 min read
Five-Axis Framework for Comparing AI Inference Chips
rcsxplatform profile

Five-Axis Framework for Comparing AI Inference Chips

#ai #machinelearning #gpu #inference
Comments
13 min read
Why does my PyTorch DataLoader fail when a worker touches CUDA?
cloudgpu_app profile

Why does my PyTorch DataLoader fail when a worker touches CUDA?

#pytorch #python #gpu #machinelearning
Comments
2 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.