What is Quantization? | IBM
What is Quantization? | IBM
Jul 31, 2024
ibm.com
Deep Network Quantization and Deployment Using Deep Learning Toolbox Model Quantization Library
5:14
Deep Network Quantization and Deployment Using Deep Learning Toolbox Model Quantization Library
Nov 1, 2020
mathworks.com
Quantization for GenAI Models
Quantization for GenAI Models
3.2K viewsNov 5, 2024
git.ir
Post Training Quantization with OpenVINO Toolkit
Post Training Quantization with OpenVINO Toolkit
Aug 9, 2021
learnopencv.com
Quantization in AI: The Secret to Smaller Models #Shorts
0:51
Quantization in AI: The Secret to Smaller Models #Shorts
41 views3 weeks ago
YouTubeAIExplainer
Quantization: What Everyone Gets Wrong (Accuracy Myths)
0:44
Quantization: What Everyone Gets Wrong (Accuracy Myths)
65 views2 weeks ago
YouTubeCode & Capital
How to Quantize Your Own Models using Unsloth
1:00
How to Quantize Your Own Models using Unsloth
1 views2 weeks ago
YouTubeBreaking Divide
0:41
Google magic bullet - TurboQuant #ai #gpu #google #chips #cuda #quantization
1.3K views1 month ago
YouTubeNeural AI Flair
0:33
FPS GPU Optimization Tokens #tokenization #llama #nvidia #ai #rtx #gpu #gaming #gpublock #nvidiagtx
969 views2 weeks ago
YouTubeAmit_Chopra_assruc
3:33
Vector Quantization Techniques | Qdrant Multi-Vector Search
99 views1 month ago
YouTubeQdrant Vector Search
0:16
What is Quantization LLM QUANTIZATION #ai #llm #llms #learning #model #fashion #tech #technology
60 views1 month ago
YouTubeAmit_Chopra_assruc
0:45
Quantization Explained: How LLMs Get Smaller and Faster
88 views1 month ago
YouTubeDev Alpha Lab
7:29
Model Quantization Explained 8 bit, 4 bit & Inference Optimization #genai #aigenerated
29 views1 month ago
YouTubeSmartSkale
1:54
Stop LLM Accuracy Loss: The Ultimate MXFP4 Guide (DuQuant++) #Shorts
15 views2 weeks ago
YouTubeCollapsedLatents
2:36
I added KV caching and INT8 KV quantization to our transformer inference, improving throughput by 35x.All of this was done from scratch in Rust + CUDA, on top of a homemade ML framework.On a 4-token prompt with 252 generated tokens:- Original: 0.76 tok/s- KV cache fp32: 27.21 tok/s- KV cache int8 (quantized): 27.29 tok/sTry it out yourself here: https://t.co/kFS9Z0fs4hIn practice:- KV caching gave us about a 35x end-to-end speedup- INT8 KV cache kept roughly the same speed as fp32 but cut KV cac
48.8K views3 weeks ago
x.comReese Chong
9:33
Model Compression: Kỹ Thuật Giảm Dung Lượng Model
8.4K views4 months ago
TikToktung.in.tech
9:29
5. Quantization - Digital Audio Fundamentals
102.6K viewsSep 9, 2020
YouTubeAkash Murthy
41:59
Sampling Theorem Quantization and Binary Coding
7.1K viewsApr 11, 2021
YouTubeEngineering with Bingabr
19:56
Faster and Lighter Model Inference with ONNX Runtime from Cloud to Client
3.5K viewsOct 16, 2020
YouTubeMicrosoft Developer
8:29
Examples of Quantization & Calculation of Parameters based on Quantization in Digital Communication
99.1K viewsAug 17, 2018
YouTubeEngineering Funda
9:22
Angular Momentum Quantization in Bohr Model, De Broglie's Wave-Particle Duality
40.5K viewsNov 26, 2020
YouTubeElucyda
吴恩达《深入模型量化|Quantization in Depth》中英字幕
18K viewsMay 7, 2024
bilibiliGPT中英字幕课程资源
9:58
SmoothQuant
4.4K viewsOct 25, 2023
YouTubeMIT HAN Lab
31:23
LLM Quantization Explained
412 viewsApr 21, 2025
YouTubeJoydeep Bhattacharjee
4:05
Quantization Part 10: Dynamic range and SNR Example
8.4K viewsNov 4, 2012
YouTubeMadhan Mohan
1:09
WHAT IS MODEL QUANTIZATION?
18 views6 months ago
YouTubeData Science Made Easy
12:10
Optimize Your AI - Quantization Explained
465.1K viewsDec 28, 2024
YouTubeMatt Williams
5:52
I Made The Smallest (And Dumbest) LLM
510.7K views8 months ago
YouTubeCodeically
21:21
GTC 2021: Systematic Neural Network Quantization
3.3K viewsApr 26, 2021
YouTubeAmir Gholaminejad
11:33
Sampling and Quantization in Digital Image Processing
264.4K viewsMar 2, 2021
YouTubeCollege Friendly
See more