DeepEval

The LLM Evaluation Framework

Observability & Evaluation Python Grade B Listed Apache-2.0
Listing state
Listed
HVTrust
67.5/100 · Grade B
Last push
2026-06-04 · 0d ago
Recent change
Rank +10

Quick Trust Read

Verdict
Promising trust profile, but some evidence still deserves review.
67.5/100 · Grade B
Strongest Signal
Maintenance
20.0/20
Weakest Signal
Safety / Integrity
6.4/25
What Would Improve It
Publish package provenance or release attestations for stronger supply-chain evidence.
Recent Changes
2026-06-02
Rank Moved
Rank dropped 10 spots (#69 → #79)
2026-06-01
Rank Moved
Rank rose 56 spots (#125 → #69)
2026-06-01
HVTrust Changed
HVTrust up 22.9pts (43.9 → 66.8)
Maintainer Checklist
Raise Scorecard signals Current OSSF Scorecard is 4.0/10. Tighten the weakest checks to improve public safety evidence.
Publish provenance Add package provenance or release attestations so users can verify where shipped artifacts came from.
Increase signed commits Raise the share of verified-signed commits to make maintainer identity and release history easier to trust.
90.0
Activity Score · out of 100
67.5
HVTrust Score · out of 100
#81
Global Rank · of 203
#9

How to read this: HVTrust (0–100) weighs supply-chain signals (provenance, OSSF Scorecard, signed commits, open license) alongside real-world adoption. Grade B reflects the trust score band: A ≥ 80, B ≥ 65, C ≥ 50, D < 50. Full methodology →

Signals refreshed 2026-06-04 20:15 UTC · Repo last pushed today

Rank Trend

2026-05-25 2026-06-04

Activity & Reach

Stars
15.9k
Forks
1.5k
Last Push
2026-06-04
today
Commits (4 wk)
226
Downloads (7d)
1,704,746
pypi
HN mentions (30d)
1
Open Issues
275
Rank Change
▼2
was #79

Analysis

HVTrust Dimensions

67.5 / 100 · 100.0% confidence
Safety / IntegrityOSSF, provenance, signatures
6.4 / 25
Identity / ProvenanceListing and build link
10.8 / 18
TransparencyLicense and public checks
11.9 / 17
MaintenanceFreshness and commits
20.0 / 20
AdoptionStars and downloads
18.4 / 20

Activity Inputs

90.0 / 100
StarsRepository reach
25.2 / 30
FreshnessLast push recency
25.0 / 25
ActivityRecent commits
25 / 25
CommunityFork signal
14.8 / 20

Supply Chain Trust

Package Provenance
None
No package attestations found
OSSF Scorecard
4.0 / 10
via deps.dev · OpenSSF
Signed Commits
28%
of last 100 commits verified
Binary-Artifacts 10
Branch-Protection 0
CI-Tests 10
CII-Best-Practices 0
Code-Review 6
Contributors 10
Dangerous-Workflow 10
Dependency-Update-Tool 0
Fuzzing 0
License 10
Maintained 10
Packaging -1
Pinned-Dependencies 0
SAST 0
Security-Policy 0
Signed-Releases -1
Token-Permissions 0
Vulnerabilities 0

Is DeepEval safe?

DeepEval has a mixed signal profile. Some trust indicators are present, others are missing. Whether it is safe for your use case depends on which gaps matter to you — review the breakdown below before adopting in production.
Does DeepEval publish package provenance?
No published build provenance is currently detected for DeepEval. This is common for open-source projects but means consumers cannot independently verify that the package on the registry matches the GitHub source.
Does DeepEval have an OpenSSF Scorecard?
DeepEval has an OpenSSF Scorecard score of 4.0/10. The Scorecard checks for branch protection, signed releases, dependency updates, fuzzing, code review, and other supply-chain hygiene items. See the full check breakdown on this page.
Is DeepEval actively maintained?
Actively maintained. The repository was pushed to within the last 1 day(s).
What license does DeepEval use?
DeepEval ships under Apache-2.0. A declared, OSI-approved license is one of the transparency signals HVTrust scores.
Are DeepEval's commits signed?
28% of the last 100 commits to DeepEval are verified-signed (GPG, SSH, S/MIME, or GitHub's signing flow). Signed commits help confirm that code was authored by who the commit claims.

Not a safety endorsement. HVTracker describes what public signals show, not whether a project is safe for your use case. Run your own security review before adopting in production.

Runtime trust — coming soon

HVTrust currently scores supply-chain signals. We're adding runtime trust next: what an agent actually does when it runs — what it can reach, which tools it carries, what external services it depends on. Track progress on the roadmap →

  • MCP support
  • Tool / plugin surface
  • External service deps
  • Package provenance drift

Maintain DeepEval?

HVTrust scores DeepEval from public signals only — we never contact maintainers first. If a signal is wrong, stale, or missing (provenance you publish, a Scorecard you run, signed releases), tell us and we'll review it. Corrections are public and tracked on GitHub.

Reputation Timeline

HVTrust 5Rank 3Listed 1Scorecard 1Score 1
2026-06-02
Rank Moved
Rank dropped 10 spots (#69 → #79)
2026-06-01
Rank Moved
Rank rose 56 spots (#125 → #69)
2026-06-01
HVTrust Changed
HVTrust up 22.9pts (43.9 → 66.8)
2026-05-30
Rank Moved
Rank dropped 45 spots (#76 → #121)
2026-05-30
HVTrust Changed
HVTrust down 18.5pts (61.9 → 43.4)
2026-05-29
HVTrust Changed
HVTrust up 9.9pts (52.0 → 61.9)
2026-05-28
HVTrust Changed
HVTrust down 7.3pts (59.3 → 52.0)
2026-05-28
Activity Score Changed
Activity score up 25pts (65 → 90)
2026-05-27
Scorecard Added
OSSF Scorecard: 3.8/10
2026-05-27
HVTrust Changed
HVTrust up 22.5pts (36.8 → 59.3)
2026-05-25
Newly Listed
First tracked at rank #76

Embed Badge Badge guide for maintainers →

HVTrust 67.5 Grade B
Markdown:
[![HVTrust](https://hvtracker.net/badge/deepeval.svg)](https://hvtracker.net/agents/deepeval)
HTML:
<a href="https://hvtracker.net/agents/deepeval"><img src="https://hvtracker.net/badge/deepeval.svg" alt="HVTrust"></a>

Other agents in Observability & Evaluation

Data sources
GitHub REST API (repo, commits, stars, forks, license) · PyPI / pypistats (downloads, provenance) · OSSF Scorecard via deps.dev · Algolia HN Search API
Each agent's signals refresh once daily across 6 staggered batches. Methodology v3.1 · Raw JSON