Setup guide

Set up crawl4ai-mcp-server in CrewAI

communityunknownunknownno verified config · noindex

🕷️ A lightweight Model Context Protocol (MCP) server that exposes Crawl4AI web scraping and crawling capabilities as tools for AI agents. Similar to Firecrawl's API but self-hosted and free. Perfect for integrating web scraping into your AI workflows with OpenAI Agents SDK, Cursor, Claude Code, and other MCP-compatible tools.

01Configuration

# crawl4ai-mcp-server via CrewAI
# transport: unknown
# launch: the server's install method

CrewAI connects to MCP servers in code. Use its MCP client with the command/URL below; exact API varies by version.

02Steps

Make sure CrewAI is installed and up to date.
Wire the server into CrewAI using its MCP client API.
Provide any required API keys/credentials as environment variables.
Restart CrewAI and confirm crawl4ai-mcp-server’s tools appear.

03Other runtimes

Claude Desktop Cursor Windsurf Cline Continue Goose VS Code OpenAI Agents SDK LangGraph

04Provenance

config_sourcegenerated from captured install method

last_checked2026-06-29 07:43Z

sourcesGitHub repo search [p4]

Next step

Ship crawl4ai-mcp-server to your agents as a governed Loadout — config, scopes, and approval rules in one place.

Build a Loadout

See also: server page · is it safe? · alternatives