Home › Search & Research › webcrawl-mcp
webcrawl-mcp
Local-first web scraping, search, and crawling. Static pages extracted locally via trafilatura; optional Firecrawl fallback only when JS rendering is needed. Four tools: scrape, search (DuckDuckGo), map, crawl.
Topics: Search & Data Extraction
Connect
See the repository for installation instructions: https://github.com/andyliszewski/webcrawl-mcp
Related servers
Firecrawl MCP Server
MCP server for Firecrawl — web search, scraping, and biomedical/arXiv paper search.
wigolo
Local-first web intelligence MCP server for AI coding agents
exa-mcp-server
Connect AI agents to Exa for web search, content fetching, and multi-step research.
arxiv-mcp-server
Search arXiv papers, download full text, semantic search, citation graphs, and alerts via MCP.
trieve
Crawl, embed, chunk, search, and retrieve information from datasets through [Trieve](https://trieve.ai)
brightdata-mcp
Bright Data's Web MCP server enabling AI agents to search, extract & navigate the web
Listed in punkpeye/awesome-mcp-servers (MIT)