FloydHub Blog
  • 💥 AI Consulting
  • ✏️ Write For FloydHub
Alex Amadori

Alex Amadori

Alex is a software engineering student at 42, Paris. He’s interested in exploring Deep Learning and striving to gain a better understanding of the field in order to contribute to the research.

Paris •
1 post •
Distilling knowledge from Neural Networks to build smaller and faster models
Deep Learning

Distilling knowledge from Neural Networks to build smaller and faster models

This article discusses GPT-2 and BERT models, as well using knowledge distillation to create highly accurate models with fewer parameters than their teachers

  • Alex Amadori
    Alex Amadori
27 min read
FloydHub Blog © 2021
Latest Posts Facebook Twitter Ghost