🌵 Speculative Speculative DecodingWhat if your draft model could speculate while the target model is still verifying? That's the idea behind Speculative Speculative Decoding (SSD). I've been… | Maxime Labonne | 15 comments
🌵 Speculative Speculative DecodingWhat if your draft model could speculate while the target model is still verifying? That's the idea behind Speculative Speculative Decoding (SSD). I've been… | Maxime Labonne | 15 comments
已浏览 15 次2 个月之前
linkedin.com
Speculative Decoding — Think Fast⚡, Then Think Right✅
Speculative Decoding — Think Fast⚡, Then Think Right✅
2025年4月13日
substack.com
How to Quadruple LLM Decoding Performance with Speculative Decoding (SpD) and Microscaling (MX) Formats on Qualcomm® Cloud AI 100
How to Quadruple LLM Decoding Performance with Speculative Decoding (SpD) and Microscaling (MX) Formats on Qualcomm® Cloud AI 100
2024年8月1日
qualcomm.com
Faster LLMs: Accelerate Inference with Speculative Decoding
Faster LLMs: Accelerate Inference with Speculative Decoding
11 个月之前
ibm.com
Speculative Stock: Meaning and Examples of High-Risk Investments
Speculative Stock: Meaning and Examples of High-Risk Investments
2 个月之前
investopedia.com
面试官问：什么是推测解码（Speculative Decoding）？它的核心作用是什么？
4:34
面试官问：什么是推测解码（Speculative Decoding）？它的核心作用是什么？
已浏览 604 次1 个月前
bilibiliAI大模型面试实战
【AI论文解读】让 speculative decoding 更快更准！任务感知的 Draft 模型优化方案 | TAPS
15:39
【AI论文解读】让 speculative decoding 更快更准！任务感知的 Draft 模型优化方案 | TAPS
1 个月前
bilibili熊二等兵
1:13
Gemma 4 Multi-Token Prediction (MTP) Drafters Explained
已浏览 569 次2 周前
YouTubeStephen W Thomas
6:13
Speculative Decoding: Make AI 2-3x Faster for Free | Tech Decoded
已浏览 3 次1 个月前
YouTubeToc am
8:37
Multi-Token Prediction: Why Your GPU Runs LLMs 3x Faster
已浏览 4 次2 周前
YouTubeDevsplainers
3:08
What is Speculative Decoding ?
已浏览 38 次2 周前
YouTubeDeepManim
7:57
Google Made Gemma 4 Three Times Faster — Then Hid The Best Part
已浏览 6 次2 周前
YouTubeDigital Dreamscapes
7:09
Don't use speculative decoding until you watch this
已浏览 7 次4 周前
YouTubeDigitalOcean
0:49
Why ChatGPT streams faster than it used to: speculative decoding explained in 48 seconds
已浏览 1135 次1 个月前
YouTubeAdam Rosler
1:09
This AI Trick Gives You 3x Speed For FREE
已浏览 98 次1 个月前
YouTubeThe AI Century
0:31
Indian Men's Reality 😱
已浏览 2.6万 次2 周前
YouTubeDecoding India
40:19
Speculation is all you need: Intro to Speculative Decoding for High Performance Inference
已浏览 753 次2 个月之前
YouTubeModal
5:04
Speculative Decoding: 2-3x Faster LLMs for Free
已浏览 1 次1 个月前
YouTubeThe AI Century
5:57
Why LLM Output Tokens Cost 5x-10x More Than Inputs (The Token Economy Explained)
已浏览 3 次2 周前
YouTubeAI & Future Tech
7:59
🤯 I tried New 3X Faster Gemma 4 (MTP Drafters) in Claude Code FREE
已浏览 4202 次2 周前
YouTubeCompile Future
0:59
Speculative Decoding explained in Hindi #aiengineering #datascience #llm #mustdo Interview Question
已浏览 24 次4 个月之前
YouTubeLearn AI with RC
12:45
Speculative Decoding & Inference Speed — 2-3x Faster LLMs With Zero Quality Loss
2 周前
YouTubeJeff Heidelberger
DFVG: A Heterogeneous Architecture for Speculative Decoding with Draft-on-FPGA and Verify-on-GPU | Proceedings of the 31st ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 2
2 个月之前
acm.org
Multi-candidate Speculative Decoding | Natural Language Processing and Chinese Computing
3 个月之前
acm.org
AI INFRA 学习 04 - Speculative Decoding 实现方案
已浏览 4758 次11 个月之前
bilibiliSe7en的架构笔记
12:46
Speculative Decoding
已浏览 328 次2024年8月14日
bilibili竹言见智
1:09:25
Cudamode Lecture 22: Hacker's Guide to Speculative Decoding in VLLM
已浏览 282 次2024年6月11日
bilibilifishlegsky
1:23
Speculative Speculative Decoding for Faster LLM Inference
已浏览 2056 次2 个月之前
YouTubeRajistics - data science, AI, and machine learning
26:28
Digital Communications: Viterbi Algorithm
已浏览 10.6万 次2017年12月3日
YouTubeUConn HKN
6:52
Introduction to Encoders and Decoders
已浏览 285.3万 次2015年1月23日
YouTubeNeso Academy
展开
静态缩略图占位符