Webcrawl MCP Server
Local-first web scraping, DuckDuckGo search, site mapping and crawling, using trafilatura with an optional Firecrawl fallback for JS-rendered pages.
16Python
context tax
queued
security
queued
cold start
queued
freshness
Maintained36d ago
Install Webcrawl MCP server
No published package or hosted endpoint yet — see the repository README for build-from-source instructions.
Freshness
Maintained — last maintenance signal 36d ago. The newest of the signals below sets the band.
Last commit (default branch)
2026-09-03 · 36d ago · GitHub
Latest release
2026-04-17 · 6mo ago · GitHub · v0.1.0
Package published
no data · npm/PyPI
Registry entry updated
no data · official registry
FAQ
›Is Webcrawl in the official MCP registry?
No. It was indexed from awesome-mcp-servers (punkpeye).
Alternatives to Webcrawl
Other browser automation MCP servers.
Browser UseActiveControl a real Chrome browser to complete any task: fill forms, extract data, book flights.
FetchActiveWeb content fetching and conversion for efficient LLM usage
ScraplingActiveWeb scraping with stealth HTTP, real browsers, and Cloudflare bypass. CSS selectors supported.
BrowserActiveA fast, lightweight MCP server that empowers LLMs with browser automation via Puppeteer’s structured accessibility data, featuring optional vision mode for complex visual understanding and flexible, cross-platform configuration.
PlaywrightActivePlaywright browser automation: interact with web pages through structured accessibility snapshots.
BrowserActiveHeadless browser for AI and web automation with a built-in MCP server.