API DIRECTORY · AI APPS, AGENTS AND TOOLS

AI — Web Search, Scraping & Crawling for AI

26 companies and tools in this category. Each listing links to the provider’s own website. Search the full directory

ApifyHosted API
Scrapers/actors platform
Open documentation Pricing Status Details
Official source checked · checked 2026-10-23
Azure Grounding with BingHosted API
Microsoft web grounding
Open documentation Pricing — No pricing page listedStatus — No status page listedDetails
Official source checked · checked 2026-10-23
Brave SearchHosted API
Web search integrations
Open documentation Pricing — No pricing page listedStatus — No status page listedDetails
Official source checked · checked 2026-10-23
Bright DataHosted API
Proxies and scraping
Open documentation Pricing — No pricing page listedStatus — No status page listedDetails
Official source checked · checked 2026-10-23
Browser UseHosted API
Agent browser infrastructure
Open documentation Pricing Status Details
Official source checked · checked 2026-10-23
BrowserbaseHosted API
Headless browsers for agents
Open documentation Pricing Status Details
Official source checked · checked 2026-10-23
Common CrawlHosted API
Open web crawl data
Open documentation Pricing — No pricing page listedStatus Details
Official source checked · checked 2026-10-23
Crawl4AISelf-hosted
Open-source LLM-friendly crawler
Open documentation Pricing — No pricing page listedStatus — No status page listedDetails
Official source checked · checked 2026-10-23Install and run this software to expose its API.
DiffbotHosted API
Knowledge graph and extraction
Set up API access Docs Pricing Status Details
Official source checked · checked 2026-10-23
ExaHosted API
Web search services
Open documentation Pricing Status Details
Official source checked · checked 2026-10-23
FirecrawlHosted APIFree option
Crawl/scrape to markdown; self-hostable
Get an API key Docs Pricing Status Details
Official source checked · checked 2026-10-23
HyperbrowserHosted API
Agent browser infrastructure
Set up API access Docs Pricing Status — No status page listedDetails
Official source checked · checked 2026-10-23
Jina ReaderHosted API
URL to LLM-ready text
Open documentation Pricing Status Details
Official source checked · checked 2026-10-23
KagiHosted API
Search and summarizer
Open documentation Pricing Status Details
Official source checked · checked 2026-10-23
LinkupHosted API
Web search APIs for grounded AI applications
Open documentation Pricing Status Details
Official documentation checked · checked 2026-10-23
ParallelHosted API
Web search and research APIs for AI applications
Open documentation Pricing Status Details
Official source checked · checked 2026-10-23
PerplexityHosted API
Search and answer services
Get an API key Docs Pricing Status — No status page listedDetails
Official source checked · checked 2026-10-23
ScraperAPIHosted API
Scraping APIs
Open documentation Pricing Status Details
Official source checked · checked 2026-10-23
ScrapingBeeHosted API
Scraping APIs
Open documentation Pricing Status Details
Official source checked · checked 2026-10-23
SearXNGSelf-hostedOpen source · AGPL-3.0
SearXNG is a free internet metasearch engine which aggregates results from various search services and databases.
Open documentation Pricing — No pricing page listedStatus — No status page listedSource code Details
Official source checked · checked 2026-11-10
SerpApiHosted APIFree option
Search engine results
Open documentation Pricing Status Details
Official source checked · checked 2026-10-23
SerperHosted API
Google SERP API
Open documentation Pricing — No pricing page listedStatus — No status page listedDetails
Official source checked · checked 2026-10-23
SteelHosted API
Agent browser infrastructure
Open documentation Pricing Status Details
Official source indexed · retrieval limited · checked 2026-10-23
TavilyHosted API
Search and content retrieval
Open documentation Pricing Status Details
Official source checked · checked 2026-10-23
You.comHosted API
Search for LLMs
Set up API access Docs Pricing Status — No status page listedDetails
Official source checked · checked 2026-10-23
ZyteHosted API
Scraping APIs
Open documentation Pricing Status Details
Official source checked · checked 2026-10-23