API and engine to crawl, scrape and extract structured data from websites into clean LLM-ready Markdown, for feeding AI and RAG pipelines.
Open-source project by firecrawl
Open-source, local-first Python crawler and scraper that turns websites into structured LLM-ready Markdown with no external API calls, for those wanting control and low cost.
View resourceAI-powered Python scraper: tell it in plain language what to pull from a site and it returns structured data. An open-source Firecrawl alternative for data extraction and lead lists.
View resourceAdaptive Python web-scraping framework: from a single request to a full-scale crawl, with an anti-block stealth mode and an MCP server to drive it from your AI.
View resource
