Ivan Ilin

MS/PhD student

KAUST AI Initiative

Biography

Ivan Ilin studies Computer Science in the MS/PhD program at the King Abdullah University of Science and Technology. He is a member of the KAUST AI Initiative, advised by Peter Richtárik.

His academic work experience includes:

Undergraduate Research Assistant, Budker Institute of Nuclear Physics, Novosibirsk, Russia, 2020
Deep learning Junior Researcher, ExpaSoft, Novosibirsk, Russia, 2020–2023
Lavrentyev Institute of Hydrodynamics, Novosibirsk, Russia, 2018–2019

Founder of the:

Educational platform ilinblog.ru (2017–Present)
Online school vectozavr.ru (2022–Present)

Interests

Deep Learning & Optimization
3D Graphics & Game Engines
Physics Simulations & Visualization
Design & Advertisement

Education

MS/PhD in Computer Science, 2023–Present
King Abdullah University of Science and Technology, Saudi Arabia
MS in Automation of Physical and Technical Research, 2021–2023
Novosibirsk State University, Novosibirsk, Russia
B.S. in Automation of Physical and Technical Research, 2017–2021
Novosibirsk State University, Novosibirsk, Russia
Physical Mathematical School, 2015–2017
Specialized Educational Scientific Center of NSU, Russia

Publications

Vladimir Malinovskii, Denis Mazur, Ivan Ilin, Denis Kuznedelev, Konstantin Burlachenko, Kai Yi, Dan Alistarh, Peter Richtárik (2024). PV-Tuning: Beyond Straight-Through Estimation for Extreme LLM Compression..

PDF

Alexander Tyurin, Marta Pozzi, Ivan Ilin, Peter Richtárik (2024). Shadowheart SGD: Distributed Asynchronous SGD with Optimal Time Complexity Under Arbitrary Computation and Communication Heterogeneity..

PDF

Jihao Xin, Ivan Ilin, Shunkang Zhang, Marco Canini, Peter Richtárik (2023). Kimad: Adaptive Gradient Compression with Bandwidth Awareness. In Proceedings of the 4th International Workshop on Distributed Machine Learning (pp. 35-48)..

PDF

Projects

Online school “Vectozavr Academy”

An absolutely unique online school on the basics of linear algebra for game developers. The most uncompromising technologies are used to deliver the material. It is planned to expand the school and enter the international market.

3D engine from scratch + FPS Shooter

Simple 3d engine based on SFML library. I tried to make this engine powerful and easy to understand. The main goal - to implement basic 3D graphics from scratch (without OpenGL or any other 3D graphics library)

GameBoy based on Arduino

The resulting gameboy works great, is lightweight and sits comfortably in the hand. There are huge opportunities for expanding the functionality of the firmware and upgrading the device. The charge lasts approximately 2 days of active play.

Pseudo 3D Shooter

I implemented Simple Pseudo-3D Shooter from scratch. With support of uploading two dimensional map, enemy’s and online multiplayer. There are two articles on my website dedicated to this project: Part 1 (Preliminaries) Part 2 (Implementation) And a series of great videos from my YouTube channel:

Design and assembly of a 4-bit adder

A large project to develop and design a binary adder. I have included a full description of this project in two small articles on the Ilinblog website: Part 1 (theory) Part 2 (Practice) There is also a good video on my YouTube channel.

YouTube channel Vectozavr

Vectozavr is a unique non-fiction content. Here I talk about the most interesting things from the world of mathematics, physics, programming and robotics. Sometimes educational and educational projects come out here.

Educational platform ilinblog.ru

ilinblog.ru – educational platform is designed specifically for publishing my research. It was planned to make the platform available to everyone who wants to contribute. The project is currently on hold.