(ICML 2024) Pursuing Overall Welfare in Federated Learning through Sequential Decision Making (https://arxiv.org/abs/2402.14650)

StarCraft II high-level feature extractor and replay visualizer

A project to classification.

code for published paper titled "Optimal CO2 storage management considering safety constraints in multi-stakeholder multi-site GCS projects: a Markov game perspective  "

A personal website made using Jekyll's Ed theme

PyTorch implementation of REACT: longitudinal active feature acquisition with Gumbel-Sigmoid relaxation for cost-aware sequential feature selection with context. ACM BCB 2026.

Implementation of a Decision Transformer for power-grid control in L2RPN. The model learns from offline Tutor/Junior demonstrations and continues training online, serving as a drop-in replacement for PPO in the original pipeline proposed by aspirin96.

Multi-stage Stochastic Programming for Integrated Network Optimization in Hurricane Relief Logistics and Evacuation Planning

Bayesian Optimization

Do humans adapt their planning horizon? - An analysis of sequential decision-making in the videogame Frogger

Autonomous Blue Team agent. Using Deep Reinforcement Learning for sequential intrusion detection and active incident response in simulated enterprise networks (CybORG / CAGE). Moving beyond static classification, this agent learns an interactive, explainable policy to continuously mitigate cyber threats.

Risk-based sequential stopping: when to invoke an LLM in streaming systems. Code for ECML PKDD 2026 (Research Track). DOI: 10.5281/zenodo.20783298