ARIS (Auto-Research-In-Sleep) Claude skills

A large markdown skill set for autonomous ML research: idea discovery, experiment runs and cross-model review loops where a second model critiques the first.

Our verdict Recommended with caveats

A deep, actively maintained research workflow, but it depends on a second model, can launch paid compute, logs your prompts locally through hooks, and is large to adopt.

What ARIS (Auto-Research-In-Sleep) does

ARIS is a methodology packaged as roughly 200 skills (the file metrics count 197, averaging 16 KB; the largest, auto-review-loop, is about 75 KB). The central idea is that one model executes while a different model reviews: the executor (Claude Code by default) writes ideas, code, papers and fixes, and an independent reviewer (Codex through an MCP bridge by default, or MiniMax, ModelScope-hosted or other models) scores the work and sends back criticism for another round, up to a maximum number of rounds. Skills cover literature search (arXiv, alphaXiv, DeepXiv), idea generation and ablation planning, experiment bridging and a job queue, result analysis, claims drafting, citation auditing and cross-checking, paper-improvement loops, figure specs, slides and talks. Constants such as CODE_REVIEW and AUTO_DEPLOY control whether reviewed code is launched automatically, and the skills mention Vast.ai and Modal GPU lifecycles and cost checks.

A meta-optimize workflow uses Claude Code hooks to log skill calls, tool failures and your prompts to local events.jsonl files, then proposes reviewed patches to the skills, applied only with your consent. A few Python scripts back the queue, citation checks and figure rendering. The project also ships a standalone CLI and plugins, and the README lists adapters for Codex, Cursor, Copilot CLI and OpenClaw.

Good for

  • ML researchers who want agent-run experiment and paper-revision loops with an independent reviewer model
  • Overnight or multi-hour runs with bounded review rounds
  • Teams comfortable pairing two model providers

Not for

  • People who want a small, single-purpose skill (this is a whole workflow system)
  • Anyone unwilling to let an agent launch GPU jobs or run paid cloud instances
  • Setups without access to a second model for review

What's inside depth 4/5

197 skills averaging 16 KB with long, rule-heavy workflows, a few Python helpers for the queue, citations and figures, and an MCP bridge, but no evals in the repo.

Skills
197
Reference docs
26
Scripts
24
Tests / evals
0
Templates
47
Avg SKILL.md
16.1 KB

Counted from the repository file tree. How we score depth.

Dependencies and costs

  • Claude Code (or Codex and other adapters) as executor
  • A second model for review: Codex CLI via the bundled bridge, MiniMax, ModelScope or another provider key
  • Optional GPU backends such as Vast.ai or Modal, and W&B
  • LaTeX and poppler for paper builds
  • Optional Feishu/Lark config for notifications
  • Telemetry: No remote telemetry found. The meta-optimize hooks write every skill call, tool failure and user prompt to local .aris/meta/events.jsonl files (project and home directory); remove the hooks if you do not want that log.

Security review

Broad access

This skill asks for more access than most, or sends data to another service. That is usually a design choice rather than bad intent, but you should know before you install it.

  • Pre-approves broad shell commandsNearly every SKILL.md (for example arxiv, alphaxiv, auto-review-loop, experiment-queue) pre-approves unrestricted Bash(*) in allowed-tools, so the agent can run any shell command without asking.skills/arxiv/SKILL.md:5

A large research-automation skill suite (literature search, auto review loops, paper and figure tooling, GPU experiment queue) in which almost every skill pre-approves unrestricted Bash. Review loops send your drafts and code to a second model provider, the experiment skills can launch jobs on remote machines over SSH (auto-deploy is on by default in experiment-bridge), and install steps write to your global Claude config and install optional packages unpinned. Local hook logging is opt-in by copying a template; no remote telemetry was found.

Worth knowing

  • Changes files outside your projectInstall steps copy skills into ~/.claude/skills, register a user-scope MCP server with claude mcp add codex -s user, ask you to put API keys in ~/.claude/settings.json, and (for meta-optimize) copy hook settings over .claude/settings.json (README:445).README.md:391
  • Runs remote code at an unpinned versionOptional integrations tell you to run unpinned installs: pip install exa-py, pip install deepxiv-sdk, npm install -g @openai/codex, npm install -g @google/gemini-cli and gemini-mcp-tool.skills/exa-search/SKILL.md:47
  • Installs packages or toolsSkills install Python and npm packages (deepxiv-sdk, exa-py, Codex CLI, Gemini CLI) and README lists LaTeX/poppler system packages via apt.skills/deepxiv/SKILL.md:48
  • Needs an API key for its own serviceReads LLM_API_KEY / MINIMAX_API_KEY (from the environment or ~/.claude/settings.json) and sends it to the configured OpenAI-compatible endpoint; other optional keys (EXA_API_KEY, FIRECRAWL_API_KEY, GEMINI_API_KEY) go to their own services.skills/auto-review-loop-llm/SKILL.md:93
  • Makes network requestsReview-loop skills send your paper drafts, experiment code and notes to an external reviewer model (Codex/GPT, DeepSeek, MiniMax, Gemini or similar); other skills query arXiv, AlphaXiv, Crossref/DBLP, Exa and Firecrawl, and feishu-notify posts to a Feishu webhook if you configure one. alphaxiv/SKILL.md:32 sets a browser User-Agent string to avoid 403s.skills/auto-review-loop-llm/SKILL.md:91
  • Relies on a CLI or package we could not reviewRelies on ssh/scp, screen, nvidia-smi, conda, the Codex and Gemini CLIs, Vast.ai/Modal tooling and LaTeX; experiment-queue copies queue_manager.py to a remote host and starts it with nohup, and experiment-bridge defaults AUTO_DEPLOY = true (SKILL.md:37) to launch jobs after a model review.skills/experiment-queue/SKILL.md:192

What we checked

The repository (761 files) on Oct 29, 2026. Not a full review: 699 of 761 files were not downloaded (large repository; we reviewed the skill folders); we read 2 of 4 code files; it relies on code outside the repository: Codex CLI, Gemini CLI, Exa, DeepXiv, Firecrawl and other packages/services the skills install or call; MCP server code, tools/, templates/ (including claude-hooks/meta_logging.json) and the ARIS runtime described in the README; these paths are not in the local copy (about 700 readable files missing); skills/citation-crosscheck/scripts/cx_verify.py (84 KB) and skills/figure-spec/scripts/figure_renderer.py were only searched by keyword (no network or exec calls beyond rsvg-convert/cairosvg found), not read in full.

NVIDIA SkillSpector static scan: 172 pattern hits (Agent Snooping 106, Data Exfiltration 20, Excessive Agency 17, Rogue Agent 8, Tool Misuse 5, Prompt Injection 3). The 172 hits are mostly skill cross-references and ~/.claude paths where API keys are read, an uninstall one-liner that removes only copied skill folders, 'git reset --hard' and 'rm -rf' listed as prohibited in dse-loop, and the shell=True in queue_manager.py (it runs manifest commands by design). The mermaid-diagram 'hidden instructions' hit is a zero-width space placed before nested code fences in a Markdown example, not an instruction.

A review, not a certification. Skills change after we check them — read the files before installing.

License

MIT — commercial use allowed.

Can it run unattended?

Yes. Review loops have a maximum round count, experiments go through a queue manager, and the README is built around unattended runs, though auto-deploy and paid GPU use should be bounded by you.

Alternatives to ARIS (Auto-Research-In-Sleep)

Academic Research Skills (ARS)

Imbad0202/academic-research-skills

Five very detailed Claude Code skills for the academic pipeline: deep research, paper writing, peer review, revision and systematic-review screening.

With caveats Check first Depth 5/5

AI Research Skills (Orchestra)

Orchestra-Research/AI-Research-SKILLs

98 skills for AI research and ML engineering, plus an autoresearch orchestrator that runs a two-loop experiment and synthesis cycle.

With caveats Broad access Depth 4/5

Co-Researcher

poemswe/co-researcher

Academic research plugin with 15 skills; literature reviews check citations and quotes against OpenAlex, arXiv and Europe PMC.

Recommended Check first Depth 4/5

RigorPilot Skills

lllllllama/RigorPilot-Skills

Eleven skills that reproduce deep-learning repos from their README with a reviewed plan, bounded run and evidence bundle.

With caveats Check first Depth 4/5

FAQ

What is ARIS (Auto-Research-In-Sleep)?

ARIS is an open-source set of markdown skills for autonomous machine-learning research. A main agent does the work and a different model reviews it in loops, covering idea discovery, experiments, result analysis, citation checks and paper revision.

How do I install ARIS?

Clone the repo and copy its skills folder into ~/.claude/skills (global) or a project's skills folder, as the README shows, then register the Codex review bridge from Quick Start. It is also offered as Claude Code and Codex plugins and as a standalone CLI.

Does ARIS run on its own overnight?

That is its design goal: review loops stop at a maximum number of rounds and experiments run through a queue. You should still cap rounds, spending and AUTO_DEPLOY behavior yourself, since it can start jobs and cloud instances.

Is ARIS safe to install?

We found no hidden remote calls, but it is a broad workflow: it can run shell commands for experiments, send content to a second model provider, and hooks log your prompts locally. Review the settings before leaving it unattended.

Sources: GitHub repository (stars, license, file tree, last push Oct 29, 2026). Review based on the README and SKILL.md files as published.