API DIRECTORY · AI APPS, AGENTS AND TOOLS

AI — Observability, Evals, Safety & Fine-Tuning

30 companies and tools in this category. Each listing links to the provider’s own website. Search the full directory

Anthropic SafetySDK/library
Content moderation
Open documentation Pricing — No pricing page listedStatus Details
Official source checked · checked 2026-10-23Programming library or SDK; no hosted API key is implied.
Arize PhoenixSelf-hosted
Open-source tracing/evals
Open documentation Pricing Status — No status page listedDetails
Official source checked · checked 2026-10-23Install and run this software to expose its API.
AxolotlSDK/library
Downloadable fine-tuning
Open documentation Pricing — No pricing page listedStatus — No status page listedDetails
Official source checked · checked 2026-10-23Programming library or SDK; no hosted API key is implied.
BraintrustHosted API
Evals and logging
Set up API access Docs Pricing Status Details
Official source checked · checked 2026-10-23
CometHosted API
Experiment tracking, LLM evals
Open documentation Pricing Status Details
Official source checked · checked 2026-10-23
DeepEvalSDK/library
RAG and LLM evals
Open documentation Pricing — No pricing page listedStatus — No status page listedDetails
Official source checked · checked 2026-10-23Programming library or SDK; no hosted API key is implied.
Guardrails AISDK/library
Guardrails and safety
Open documentation Pricing — No pricing page listedStatus — No status page listedDetails
Official source checked · checked 2026-10-23Programming library or SDK; no hosted API key is implied.
HeliconeHosted API
LLM proxy observability
Open documentation Pricing Status Details
Official source checked · checked 2026-10-23
Hugging Face HubHosted API
Models, datasets, Spaces
Open documentation Pricing — No pricing page listedStatus Details
Official source checked · checked 2026-10-23
Hugging Face TRLSDK/library
Downloadable fine-tuning
Open documentation Pricing — No pricing page listedStatus Details
Official source checked · checked 2026-10-23Programming library or SDK; no hosted API key is implied.
HumanloopAccess needs review
Listed in the supplied document; current public API availability is not confirmed
Open documentation Pricing Status Details
Official source checked · API access unverified · checked 2026-10-23Current public API access is unconfirmed; check the provider’s access options. Official announcement says the team joined Anthropic and the Humanloop platform is being sunset.
KaggleHosted API
Datasets and competitions
Open documentation Pricing — No pricing page listedStatus — No status page listedDetails
Official source checked · checked 2026-10-23
Label StudioSelf-hosted
Self-hosted labeling with API
Open documentation Pricing — No pricing page listedStatus — No status page listedDetails
Official source checked · checked 2026-10-23Install and run this software to expose its API.
LabelboxHosted API
Data labeling
Open documentation Pricing — No pricing page listedStatus Details
Official source checked · checked 2026-10-23
LakeraHosted API
Guardrails and safety
Open documentation Pricing — No pricing page listedStatus — No status page listedDetails
Official source checked · checked 2026-10-23
LangfuseHosted API
Open-source LLM observability
Open documentation Pricing Status Details
Official source checked · checked 2026-10-23
LangSmithHosted API
Tracing and evals
Open documentation Pricing — No pricing page listedStatus — No status page listedDetails
Official source checked · checked 2026-10-23
MLflowSelf-hosted
ML lifecycle tracking
Open documentation Pricing — No pricing page listedStatus — No status page listedDetails
Official source checked · checked 2026-10-23Install and run this software to expose its API.
NeMo GuardrailsSDK/library
Guardrails and safety
Open documentation Pricing — No pricing page listedStatus — No status page listedDetails
Official source checked · checked 2026-10-23Programming library or SDK; no hosted API key is implied.
OpenAI ModerationHosted API
Content moderation
Open documentation Pricing Status Details
Official source checked · checked 2026-10-23
OpenPipeHosted API
Fine-tuning platforms
Open documentation Pricing — No pricing page listedStatus — No status page listedDetails
Official source indexed · retrieval limited · checked 2026-10-23
OpikSelf-hosted
Experiment tracking, LLM evals
Open documentation Pricing — No pricing page listedStatus Details
Official source checked · checked 2026-10-23Install and run this software to expose its API.
PredibaseAccess needs review
Listed in the supplied document; current public API availability is not confirmed
Open documentation Pricing — No pricing page listedStatus — No status page listedDetails
Official source checked · API access unverified · checked 2026-10-23Current public API access is unconfirmed; check the provider’s access options.
PromptfooSDK/library
Open-source eval/red-team
Set up API access Docs Pricing Status Details
Official source checked · checked 2026-10-23Programming library or SDK; no hosted API key is implied.
PromptLayerHosted API
Prompt management
Open documentation Pricing Status Details
Official source checked · checked 2026-10-23
RagasSDK/library
RAG and LLM evals
Open documentation Pricing — No pricing page listedStatus — No status page listedDetails
Official source checked · checked 2026-10-23Programming library or SDK; no hosted API key is implied.
Scale AIPartner access
Data labeling
Set up API access Docs Pricing — No pricing page listedStatus Details
Official source checked · checked 2026-10-23Provider approval or a commercial agreement may be required.
SnorkelPartner access
Data labeling
Open documentation Pricing — No pricing page listedStatus — No status page listedDetails
Official source checked · checked 2026-10-23Provider approval or a commercial agreement may be required.
UnslothSDK/library
Downloadable fine-tuning
Open documentation Pricing — No pricing page listedStatus — No status page listedDetails
Official source checked · checked 2026-10-23Programming library or SDK; no hosted API key is implied.
Weights and Biases WeaveHosted API
Experiments and LLM tracing
Open documentation Pricing — No pricing page listedStatus Details
Official source checked · checked 2026-10-23