Skip to content
Eval Suites50

Eval Suites terms and conditions

Updated

You're contracting with Aaron Whitfield, an individual trading as Eval Suites, for access to this service and its products. By continuing to use Eval Suites, you agree to these terms.

What does Eval Suites provide?

Free informational directory and guides

The Eval Suites directory and editorial guides are free to read. Directory entries describe third-party benchmarks and tools and link to their official sources; they do not sell access to those projects. Third-party software and datasets belong to their respective rights holders, and their licenses and terms govern any use you obtain from those sources.

Paid original Pro Starter Packs

Pro Starter Packs contain original synthetic evaluation cases and example configurations created for Eval Suites. We don't bundle or sell the third-party software or benchmark datasets listed in the free directory.

Aaron Whitfield, trading as Eval Suites, supplies the packs as separate digital products. Purchases license the included evaluation scenarios, example scripts, and configurations under the pack-use terms below. You must install any external tools separately.

Listing reviews and sponsorships

Paid listing reviews and sponsorship placements are separate services. They do not transfer rights to a listed project's software or datasets.

You must be legally able to enter this agreement. If you act for an organization, you must have authority to bind it. Keep account credentials confidential and provide accurate contact and order details.

What use is prohibited?

Don't use the service unlawfully, submit fraudulent listings, send spam, infringe intellectual property or privacy rights, or interfere with security. Malware, unauthorized probing, abusive automated scraping, bypassing access controls, and sharing private download links are prohibited.

Security test cases are for systems you own or have explicit permission to test. Don't use them to attack other people or expose personal data.

Who owns the service and submitted content?

Aaron Whitfield retains ownership of the original Eval Suites software, documentation, branding, and pack content. You receive a limited, non-exclusive, non-transferable license to use purchased packs for your own or your organization's evaluation work. You may adapt cases for that work, but may not resell, redistribute, or publish the packs as a competing product. Don't reverse engineer the service or bypass its technical limits.

You retain rights to material you submit. You confirm you have the rights to share it and give us permission to store, review, edit for clarity, and publish listing material to operate the directory. Outputs from your own evaluation systems remain subject to your rights and any applicable third-party terms; buying a pack doesn't transfer ownership of our source content.

Send rights-holder complaints to the contact below with the affected URL, identification of the work, and the basis of your claim. We may remove or restrict disputed content and suspend accounts for repeated or serious infringement.

Do tool references imply affiliation or include third-party software?

Promptfoo, Pytest, Ragas, DeepEval, and GitHub Actions are referenced to identify tools used by the example files. Install those tools separately and follow their own licenses and terms. Tool names and marks belong to their respective owners; Eval Suites is independent and is not affiliated with, sponsored by, or endorsed by those projects.

The pack examples need configuration and adaptation for your environment. No compatibility with every tool version is promised. Buying a pack does not grant a license to third-party software, official benchmark datasets, or third-party trademarks.

How do payments and subscriptions work?

Our order process is conducted by our online reseller Paddle.com. Paddle.com is the Merchant of Record for all our orders. Paddle provides all customer service inquiries and handles returns.

Paddle's Buyer Terms govern payment processing, billing, taxes, subscription cancellation, and refund mechanics. The selected product and checkout show the charge and billing frequency before you pay. Category sponsorship and sponsor bundles renew monthly until cancelled; a weekly digest placement is charged per issue. Pack purchases and fast-track listing reviews are one-time purchases.

Payment confirmation is required before paid downloads become available. Paid listing review doesn't guarantee approval, and sponsorship doesn't change editorial facts or guarantee traffic. Refund requests follow our refund policy. Cancel a subscription using the link in your Paddle email or Paddle support to stop future renewals.

What are the service's limits?

We don't guarantee uninterrupted or error-free performance. Starter commands and evaluation cases need review and adaptation for your environment. Results don't certify that a model is safe, accurate, or compliant, and aren't professional advice. You're responsible for validating results before using them in consequential decisions.

To the extent allowed by applicable law, the service is provided as available without implied warranties of merchantability or fitness for a particular purpose. Nothing here limits rights or liability that the law doesn't allow us to exclude.

When can access be suspended or terminated?

We may suspend or terminate access for material breach, non-payment, security or fraud risks, or repeated or serious policy violations. We may remove unlawful or infringing submissions. Where appropriate, we'll notify you and allow correction; urgent security risks may require immediate action. Contact us about access disputes or data requests.

We may update these terms as the service changes. The date above identifies this version; we'll communicate material changes to account holders where required. Changes don't remove mandatory consumer rights.

How can you contact the seller?

Contact Aaron Whitfield, trading as Eval Suites, at [email protected] for product support, policy questions, privacy requests, or copyright complaints. For payment and refund help, use paddle.net.

Related policies and documentation

  1. 1. Paddle Buyer Terms · Paddle · Official docs · Sources checked
  2. 2. Paddle payment and refund support · Paddle · Official docs · Sources checked