Sealbook / Open source / AI agents & LLM apps

any4ai/AnyCrawl

AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.

ai-scrapingaitoolscrawldatahtml-to-markdownragscrapescrapingserpwebscraper

GitHub ↗Website ↗

License & maintenance

MIT is a permissive license: free to use commercially with attribution.

Last code push 20 days ago.

Similar projects

	Repository	Stars	Language	License	Activity
1	firecrawl/firecrawlSupercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥	★ 192.7k	TypeScript	AGPL-3.0	Active
2	D4Vinci/Scrapling🕷️ A Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg	★ 88.4k	Python	BSD-3-Clause	Active
3	run-llama/llama_indexLlamaIndex is the document processing platform for AI	★ 52.6k	Python	MIT	Active
4	ScrapeGraphAI/Scrapegraph-aiPython scraper based on AI	★ 31.9k	Python	MIT	Active
5	Shubhamsaboo/awesome-llm-apps100+ AI Agents, Agent Skills and RAG Apps - Free and Open Source.	★ 142.2k	Python	Apache-2.0	Active
6	HKUDS/LightRAG[EMNLP2025] LightRAG: Simple and Fast Retrieval-Augmented Generation	★ 40.2k	Python	MIT	Active
7	VectifyAI/PageIndex📑 PageIndex: Document Index for Vectorless, Reasoning-based RAG	★ 39.3k	Python	MIT	Active
8	patchy631/ai-engineering-hubIn-depth tutorials on LLMs, RAGs and real-world AI agent applications.	★ 38.4k	Jupyter Notebook	MIT	Active