Terms and Conditions

About CLIWatch

CLIWatch is a SaaS platform that evaluates command-line tools against real LLM agents. It is operated from Botterboulevard 95, 2022 GA Haarlem, Netherlands (KvK 98223631, VAT NL005317081B33). By using CLIWatch, you agree to these terms.

Account & Access

You sign in via OAuth (GitHub or Google). Each account belongs to one or more workspaces. You are responsible for keeping your account credentials and API keys secure. Do not share API keys or use another user's account without permission.

Your Data

Benchmark reports you upload remain yours. You retain all rights to your task definitions, eval results, and any content you provide. If you opt in to the public showcase, your CLI's name, pass rates, and aggregated eval scores will be displayed on the CLIWatch leaderboard and landing page.

Acceptable Use

You agree not to abuse the platform. This includes, but is not limited to: automated scraping of eval data, circumventing rate limits, uploading malicious content, or using the service to interfere with other users. We reserve the right to suspend or terminate accounts that violate these rules, with or without prior notice depending on severity.

Eval Data & AI Agents

CLIWatch evals are executed by AI agents that interact with CLIs on your behalf. You should only use non-confidential data in your eval task definitions and CLI configurations. Do not include secrets, credentials, production data, or sensitive personal information. CLIWatch is not liable for any data exposed during eval execution, including data sent to third-party LLM providers as part of agent interactions.

Free Tier

CLIWatch offers a free tier for individuals and open-source projects. The free tier is provided without any service-level agreement, uptime guarantee, or support commitment. We may modify or discontinue the free tier at any time. All other terms in this agreement apply equally to free and paid usage.

Billing

Paid plans are billed through Stripe. Plan limits are soft: we will warn you when you approach your limits, but we will not block your access mid-workflow. If you exceed your plan's limits persistently, we may ask you to upgrade. You can cancel at any time through the billing settings in your workspace. Refunds are handled on a case-by-case basis.

Third-Party Services

CLIWatch integrates with third-party services including GitHub, Google, Stripe, WorkOS, Vercel, and LLM providers (Anthropic, OpenAI, Google). These services operate under their own terms and privacy policies. CLIWatch is not responsible for the availability, accuracy, or conduct of third-party services. Your use of these services is at your own risk.

Intellectual Property

CLIWatch's software, design, documentation, and branding are owned by CLIWatch. Your data, eval results, and task definitions are owned by you. These terms do not transfer ownership in either direction.

Indemnification

You agree to indemnify and hold harmless CLIWatch and its personnel from any claims, damages, losses, or expenses (including reasonable legal fees) arising from: (a) your use of the service, (b) your violation of these terms, (c) content you upload or submit, or (d) your infringement of any third party's rights.

Termination

Either party can terminate this agreement at any time. You can delete your account from your workspace settings. We may suspend or terminate accounts that violate these terms. On termination, we will delete your data on request. Sections that by their nature should survive termination (including Indemnification, Limitation of Liability, and Governing Law) will remain in effect.

Limitation of Liability

CLIWatch is provided “as is” and “as available” without warranty of any kind, express or implied. We do our best to keep the service reliable and your data safe, but we are not liable for indirect, incidental, special, or consequential damages arising from your use of the platform. To the maximum extent permitted by applicable law, our total aggregate liability for any claim arising from or related to these terms or the service is limited to the amount you paid to CLIWatch in the twelve (12) months preceding the claim, or fifty euros (€50), whichever is greater.

Governing Law & Jurisdiction

These terms are governed by the laws of the Netherlands. Any disputes arising from or relating to these terms or your use of CLIWatch will be submitted to the exclusive jurisdiction of the competent courts in Amsterdam, the Netherlands.

Changes to Terms

We may update these terms from time to time. When we do, we will update the “last updated” date at the top of this page and notify you via email or in-app notification. Continued use of CLIWatch after changes take effect constitutes acceptance of the updated terms.

Contact

Questions about these terms? Reach out via our contact page.