Skip to content
View arthi-arumugam-git's full-sized avatar
💭
very active almost obsessed
💭
very active almost obsessed

Block or report arthi-arumugam-git

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
arthi-arumugam-git/README.md

Arthi Arumugam

I find numbers that are wrong while nothing raises: eval scores, agent usage, cost accounting.

Twenty merged across twelve organisations, eight of them in the UK AI Security Institute's inspect_evals. Open to senior eval / agent-infrastructure roles, remote or Bengaluru. arthi1805@gmail.com


wrong-numbers : findings across the LLM eval, tracing and cost ecosystem, classified into thirteen recurring defect shapes. Twenty merged upstream after human review; eight shipped in the UK AI Security Institute's inspect_evals. Every finding links to a pull request, most with a test that fails on main. https://github.com/arthi-arumugam-git/wrong-numbers

whatbroke : diff an agent's behaviour between two runs of the same task. Tool calls, arguments, costs, outputs. https://github.com/arthi-arumugam-git/whatbroke

Pinned Loading

  1. wrong-numbers wrong-numbers Public

    Eighty-one pull requests across fifty-one LLM eval, tracing and cost libraries. Most are the same defect: a number comes out wrong and nothing raises. Twenty merged upstream after human review, eac…

    2

  2. whatbroke whatbroke Public

    Diff your AI agent's behavior between two runs. See exactly which tool calls, args, costs and outputs changed when you swap models or edit prompts.

    TypeScript 20 1

  3. gnani gnani Public

    gnani is a spreadsheet tool where every cell thinks. every cell is an AI agent.

    TypeScript 4 1

  4. costctl costctl Public

    cost monitoring and optimization tool

    Python 2 1