Sealbook / Open source / Learning resources & lists

danielmiessler/RobotsDisallowed

A curated list of the most common and most interesting robots.txt disallowed directories.

License & maintenance

No license stated: by default nobody may reuse the code. Ask the authors before using it in a product.

Last code push 4 years ago.

Similar projects

	Repository	Stars	Language	License	Activity
1	codecrafters-io/build-your-own-xMaster programming by recreating your favorite technologies from scratch.	★ 554.3k	Markdown	—	Slowing
2	sindresorhus/awesome😎 Awesome lists about all kinds of interesting topics [NOTE: Pull requests are temporarily disabled until I have a chance to catch up with t	★ 520.9k	—	CC0-1.0	Active
3	freeCodeCamp/freeCodeCampfreeCodeCamp.org's open-source codebase and curriculum. Learn math, programming, and computer science for free.	★ 457.4k	TypeScript	BSD-3-Clause	Active
4	EbookFoundation/free-programming-books:books: Freely available programming books	★ 399.5k	Python	CC-BY-4.0	Active
5	donnemartin/system-design-primerLearn how to design large-scale systems. Prep for the system design interview. Includes Anki flashcards.	★ 374.6k	Python	Other	Active
6	nilbuild/developer-roadmapInteractive roadmaps, guides and other educational content to help developers grow in their careers.	★ 369.8k	TypeScript	Other	Active
7	jwasham/coding-interview-universityA complete computer science study plan to become a software engineer.	★ 362.8k	—	CC-BY-SA-4.0	Stale
8	vinta/awesome-pythonThe definitive list that answers "I want to do X in Python, which tool should I use?"	★ 328.4k	Python	Other	Active