Tagged with

knowledge distillation

Explore machine learning papers and reviews related to knowledge distillation. Find insights, analysis, and implementation details.

1

Papers Found

Back to all papers

Papers Related to knowledge distillation

2023

A Survey of Techniques for Optimizing Transformer Inference

Transformers Inference Optimization Pruning Quantization Knowledge Distillation Neural Architecture Search Hardware Acceleration

A comprehensive survey of techniques for optimizing the inference phase of transformer networks.

Read review Original Paper