Kamal Acharya

Postdoctoral Research Associate at Baylor University

Blog Topic

Machine Learning & Modeling Articles

Research notes on machine learning methods, forecasting, decision models, and data-driven analysis.

August 06, 2024 · 7 min read · Technical explainer

Knowledge Distillation and Its Types

A clear guide to knowledge distillation, including response-based, feature-based, relation-based, and symbolic knowledge distillation.

April 17, 2024 · 5 min read · Paper analysis

Flight Demand Forecasting with Transformers

A practical explanation of using Temporal Fusion Transformers to improve multi-horizon airport departure demand forecasting.

April 17, 2024 · 4 min read · Paper analysis

Deep Learning for Flight Demand Forecasting

A readable explanation of using seq2seq and attention-based deep learning models to forecast airport departure demand for strategic planning.

April 08, 2024 · 9 min read · Technical explainer

Graph Neural Networks

A practical introduction to graph neural networks, message passing, graph network blocks, and relational inductive bias for learning over structured data.

March 21, 2024 · 9 min read · Paper analysis

Budding Trees

A practical explanation of Budding Trees, a differentiable decision-tree model where each node can smoothly move between being a leaf and an internal split.

March 21, 2024 · 8 min read · Paper analysis

Adaptive Neural Trees

Explore Adaptive Neural Trees, which combine neural representation learning with conditional tree structures and efficient inference.

March 19, 2024 · 9 min read · Technical explainer

Soft Decision Trees

A practical explanation of soft decision trees, where internal nodes route examples probabilistically so every leaf can contribute to the final prediction.

February 25, 2023 · 8 min read · Technical explainer

Challenges in Deep Reinforcement Learning

Explore key deep reinforcement learning challenges, including sample efficiency, generalization, reproducibility, interpretability, safety, and deployment.