SkillEvaluator
It provides a structured framework for quantifying AI agent performance through semantic overlap and quality gates, reducing the risk of deploying unreliable…
Multi-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior.
- Generate synthetic datasets to test specific data analytics agent skills
- Measure how individual skills impact overall agent behavior and performance
- Detect semantic overlap between different skills to prevent redundant agent capabilities
It provides a structured framework for quantifying AI agent performance through semantic overlap and quality gates, reducing the risk of deploying unreliable autonomous systems into production environments.
AI engineers and research teams building multi-agent systems that require rigorous, automated skill validation and performance benchmarking.
https://github.com/NVIDIA/SkillEvaluator
By NVIDIA
How to Get It
claude plugins install NVIDIA/SkillEvaluator
Tip: Paste this into a Claude Code conversation. Verify command matches your Claude Code version.
Auto-generated from the tool's public listing — not hands-on verified. Cross-check against the source repo's README before running.
After installing, paste this into Claude:
Help me generate synthetic datasets to test specific data analytics agent skills
Trust Signals Auto-scanned
Reviewer notes
Auto-scanned review. These are observations, not a security certification.
Scored from trust signals (evidence-eval-v1): 981 GitHub stars; contributors unknown; last commit 0d ago; license Apache-2.0.
Things to check
- Scanned, not hands-on tested — this entry was auto-scanned from public metadata (GitHub metrics, license, security flags). No reviewer has run it, and no tool-specific limitations have been documented yet.
How to evaluate tools before deploying →
Data shown here comes from public APIs and automated scanning. Reviewer notes reflect one person's experience. This is not a security certification or legal recommendation. Always evaluate tools according to your own organization's policies.
Evaluation
Scored from trust signals (evidence-eval-v1): 981 GitHub stars; contributors unknown; last commit 0d ago; license Apache-2.0.