Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view

Deliver safe & effective language models

Framework for testing vulnerabilities of large language models (LLM).

MIT-licensed Framework for LLMs, RAGs, Chatbots testing. Configurable via YAML and integrable into CI pipelines for automated testing.

A tool for testing and comparing the performance of different Large Language Model APIs. 一个用于测试和比较不同大语言模型API性能的工具。

Open-source test generation SDK for LLM applications. Access curated test sets. Build context-specific test sets and collaborate with subject matter experts.

Tiny QA Benchmark++ a micro-benchmark suite (52-item gold + on-demand multilingual synthetic packs), generator CLI, and CI-ready eval harness for ultra-fast LLM smoke-testing & regression-catching.

Test your production LLMs and simulate users

Create an evaluation framework for your LLM based app. Incorporate it into your test suite. Lay the monitoring foundation.

LLM Performance Testing | K6 + Grafana + InfluxDB | A tiny toolkit for load testing and benchmarking OpenAI-like inference endpoints using K6 + Grafana + InfluxDB

API Ninja simplifies API testing by allowing users to define test flows in plain English.

The prompt engineering, prompt management, and prompt evaluation tool for Go.

A community-driven archive of AI prompts and responses. Log, compare, and contribute structured examples to build a searchable public prompt-response database.

LLM Testing with gpt4all

Red-team audit on deepseek AI by lala aka NeonXploit (operation dragon Glitch)

Interactive Python toolkit for exploring, testing, and benchmarking LLM tokenization, prompt behaviors, and sequence efficiency in a safe, modular sandbox environment.

A comprehensive corpus of interconnected texts and protocols designed as a conceptual stress-test for advanced AI.

Official public release of MirrorLoop Core (v1.3 – April 2025)