Kamal Acharya

Ph.D. Candidate in Information Systems, UMBC

Blog Topic

Machine Learning Articles

Articles on machine learning, deep learning, forecasting, decision trees, graph neural networks, and knowledge distillation.

August 06, 2024 ยท 7 min read

Knowledge Distillation and Its Types

A clear guide to knowledge distillation, including response-based, feature-based, relation-based, and symbolic knowledge distillation.

April 17, 2024 ยท 4 min read

Deep Learning for Flight Demand Forecasting

A readable explanation of using seq2seq and attention-based deep learning models to forecast airport departure demand for strategic planning.

April 08, 2024 ยท 9 min read

Graph Neural Networks

A practical introduction to graph neural networks, message passing, graph network blocks, and relational inductive bias for learning over structured data.

March 21, 2024 ยท 9 min read

Budding Trees

A practical explanation of Budding Trees, a differentiable decision-tree model where each node can smoothly move between being a leaf and an internal split.

March 21, 2024 ยท 8 min read

Adaptive Neural Trees

A practical explanation of Adaptive Neural Trees, a model that combines the representation learning power of neural networks with the conditional structure and lightweight inference of decision trees.

March 19, 2024 ยท 9 min read

Soft Decision Trees

A practical explanation of soft decision trees, where internal nodes route examples probabilistically so every leaf can contribute to the final prediction.

February 25, 2023 ยท 8 min read

Challenges in Deep Reinforcement Learning

A practical overview of the major challenges in deep reinforcement learning, including sample inefficiency, poor generalization, interpretability, reproducibility, safety, and real-world deployment.