Kamal Acharya

Postdoctoral Research Associate at Baylor University

Blog Topic

Machine Learning Articles

Articles on machine learning, deep learning, forecasting, decision trees, graph neural networks, and knowledge distillation.

August 06, 2024 · 7 min read

Knowledge Distillation and Its Types

A clear guide to knowledge distillation, including response-based, feature-based, relation-based, and symbolic knowledge distillation.

April 17, 2024 · 4 min read

Deep Learning for Flight Demand Forecasting

A readable explanation of using seq2seq and attention-based deep learning models to forecast airport departure demand for strategic planning.

April 08, 2024 · 9 min read

Graph Neural Networks

A practical introduction to graph neural networks, message passing, graph network blocks, and relational inductive bias for learning over structured data.

March 21, 2024 · 9 min read

Budding Trees

A practical explanation of Budding Trees, a differentiable decision-tree model where each node can smoothly move between being a leaf and an internal split.

March 21, 2024 · 8 min read

Adaptive Neural Trees

Explore Adaptive Neural Trees, which combine neural representation learning with conditional tree structures and efficient inference.

March 19, 2024 · 9 min read

Soft Decision Trees

A practical explanation of soft decision trees, where internal nodes route examples probabilistically so every leaf can contribute to the final prediction.

February 25, 2023 · 8 min read

Challenges in Deep Reinforcement Learning

Explore key deep reinforcement learning challenges, including sample efficiency, generalization, reproducibility, interpretability, safety, and deployment.