XCrawl
Turn any web page into LLM-ready JSON or Markdown
About
XCrawl is a web data API for AI builders. Scrape a URL into Markdown, JSON, HTML or a screenshot, crawl whole sites, map every URL on a domain, and pull structured search results, with proxies and JavaScript rendering handled for you. New accounts get 1,000 free credits.Features
- Scrape any page into clean Markdown or JSON
- Crawl entire sites with depth and scope rules
- Map every URL on a domain
- Structured search results from Google and Bing
- Python and Node.js SDKs, CLI and MCP server