NVIDIA-NeMo/Curator

Scalable data pre processing and curation toolkit for LLMs

datadata-curationdata-prepdata-preparationdata-processingdata-processing-pipelinesdata-qualitydatacurationdatarecipesdeduplication

License & maintenance

Apache-2.0 is a permissive license: free to use commercially with attribution.

Last code push today.

	Repository	Stars	Language	License	Activity
1	D4Vinci/Scrapling🕷️ A Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg	★ 88.4k	Python	BSD-3-Clause	Active
2	run-llama/llama_indexLlamaIndex is the document processing platform for AI	★ 52.6k	Python	MIT	Active
3	sinaptik-ai/pandas-aiChat with your database or your datalake (SQL, CSV, parquet). PandasAI makes data analysis conversational using LLMs and RAG.	★ 23.9k	Python	Other	Slowing
4	morluto/reaReverse engineer anything with agents, from app behavior down to native binaries.	★ 319.5k	TypeScript	MIT	Active
5	mattpocock/skillsSkills for Real Engineers. Straight from my .agents directory.	★ 296k	Shell	MIT	Active
6	affaan-m/ECCThe agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Code	★ 283.1k	JavaScript	MIT	Active
7	NousResearch/hermes-agentThe agent that grows with you	★ 254.9k	Python	MIT	Active
8	deepseek-ai/deepseek-harnessDeepSeek Harness: Everything is a Plugin.	★ 253k	TypeScript	MIT	Active