Yesterday, 11:52 AM
|
#345 (permalink)
|
|
Music Addict
Join Date: Oct 2026
Posts: 56
|
https://www.youtube.com/watch?v=5b-7UOS-LOs
Quote:
00:00 The Illusion of Thinking: Training vs. Inference
00:55 The Hardware Demands of a Single Prompt
01:33 Inference Timing: Online Inference
02:10 Batch Inference & GPU Utilization
02:48 Micro-Batching for Commercial Chatbots
03:21 Distributed Inference & Data Parallelism
04:08 Pipeline Parallelism
04:51 Tensor Parallelism
05:11 Deployment: Cloud vs. On-Premise
05:46 Edge & On-Device AI Deployment (NPUs)
|
|
|
|