codexplugin
P

Plugin Eval

Official

by OpenAI

Pluginai & agents8.9K stars

Evaluate Codex skills and plugins from chat with local-first reports and token budgets

1. Install now

$ npx codex-marketplace add openai/plugins/plugins/plugin-eval --plugin

2. Verify after restart

Connect Codex to Plugin Eval and show me what actions are available

More verify prompts

Get it working

Install → restart → verify. Stay on this page until Plugin Eval responds.

  1. 01

    Copy the install command

    Use the command on this page — it includes the correct --plugin flag for this plugin.

  2. 02

    Run it in your project terminal

    Execute the command from the directory where you use Codex, not necessarily your home folder.

  3. 03

    Restart or reload Codex

    Restart the Codex CLI or reload your IDE window so the new extension is picked up.

  4. 04

    Verify with a prompt

    Try one of the verify prompts below to confirm Plugin Eval is active.

Verify it works

After install and reload, paste one of these into Codex.

Prompt 1

> Connect Codex to Plugin Eval and show me what actions are available

Prompt 2

> Use Plugin Eval to help with my current coding task

Prompt 3

> What can the Plugin Eval integration do in this project?

If install fails

Fix these common issues before digging into GitHub issues.

  • Command not found or install fails

    Use Node.js 18+ and confirm npx works. Corporate proxies may need HTTPS_PROXY set for GitHub and npm.

  • Installed but Codex ignores it

    Restart the Codex CLI or reload the IDE window. Confirm you used the correct --plugin / --skill / --hook flag.

  • OAuth or sign-in loops

    Clear browser cookies for the provider and retry authorization. Sign in to Codex with the same ChatGPT account you use daily.

Full install & troubleshooting guide

About

Evaluate Codex skills and plugins from chat with local-first reports and token budgets

Plugin Eval is a codex plugin that extends OpenAI Codex with ai & agents capabilities. After install, Codex can use Plugin Eval context and actions during your coding sessions without leaving the conversation.

Source package path: openai/plugins/plugins/plugin-eval on GitHub (openai/plugins).

Key features

  • Official extension maintained for current Codex APIs
  • Adds Plugin Eval capabilities directly inside Codex chat
  • Installs with one npx command — no manual config editing
  • Built for ai & agents workflows

Requirements

  • Node.js 18 or newer with npx available
  • Codex CLI or IDE extension installed and signed in
  • Some official plugins open OAuth in your browser on first use

More from OpenAI

Other plugins by the same author

Related plugins

More in ai & agents