Sealbook / Open source / Developer tools, CLI & editors

apache/stormcrawler

A scalable, mature and versatile web crawler based on Apache Storm

apache-stormcrawlerdistributedjavastormcrawlerweb-crawler

GitHub ↗Website ↗

License & maintenance

Apache-2.0 is a permissive license: free to use commercially with attribution.

Last code push today.

Similar projects

	Repository	Stars	Language	License	Activity
1	ssssssss-team/spider-flow新一代爬虫平台，以图形化方式定义爬虫流程，不写代码即可完成爬虫。	★ 11.4k	Java	MIT	Stale
2	iawia002/lux👾 Fast and simple video download library and CLI tool written in Go	★ 31.8k	Go	MIT	Slowing
3	oracle/graalGraalVM compiles applications into native executables that start instantly, scale fast, and use fewer compute resources 🚀	★ 21.7k	Java	Other	Active
4	projectdiscovery/katanaA next-generation crawling and spidering framework.	★ 17.7k	Go	MIT	Active
5	binux/pyspiderA Powerful Spider(Web Crawler) System in Python.	★ 16.8k	Python	Apache-2.0	Archived
6	mockito/mockitoMost popular Mocking framework for unit tests written in Java	★ 15.5k	Java	MIT	Active
7	codelucas/newspapernewspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:	★ 15.2k	Python	MIT	Active
8	shengqiangzhang/examples-of-web-crawlers一些非常有趣的python爬虫例子,对新手比较友好,主要爬取淘宝、天猫、微信、微信读书、豆瓣、QQ等网站。(Some interesting examples of python crawlers that are friendly to beginners. )	★ 14.7k	HTML	MIT	Stale