Skip to content
View jackmaiorino's full-sized avatar

Block or report jackmaiorino

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
jackmaiorino/README.md

Jack Maiorino

I build machine-learning systems: reinforcement learning for games, and more recently AI-safety experiments.

Projects

A reinforcement-learning agent that plays full games of Magic: The Gathering through the XMage engine rather than a simplified environment. Transformer policy trained with PPO, self-play with an adaptive curriculum, and population-based training across a pool of Pauper decks, scaled out on a Slurm HPC cluster (one GPU head node feeding 640 parallel game runners on CPU satellites). The long-run benchmark is reliably executing a multi-step combo line, a hard credit-assignment problem. In progress since mid-2024; the repo README covers the architecture, progress history, and how to run it.

Testing failure modes of debate-style AI oversight: an honest and a dishonest LLM debater argue before a weaker judge that can spend a limited budget of oracle verification calls. The pilot found that a small oracle budget made the judge perform worse than none at all. Funded by a Manifund grant; pilot write-up on LessWrong. My contributions: the pilot re-analysis, a code audit that found two data-corrupting bugs in the oracle channel, and the re-judge harness now running the validation experiments.

Predicting Dota 2 match outcomes from OpenDota API data: exploratory analysis, regression, and a Random Forest classifier reaching 85.7% accuracy. Live write-up.

Pinned Loading

  1. mage mage Public

    Forked from magefree/mage

    XMage fork with a self-play reinforcement-learning MTG agent: PPO + population-based training, transformer policy, multi-node training on a Slurm HPC cluster

    Java 2