Sealbook
Sealbook / Open source / Developer tools, CLI & editors

hu17889/go_spider

[爬虫框架 (golang)] An awesome Go concurrent Crawler(spider) framework. The crawler is flexible and modular. It can be expanded to an Individualized crawler easily or you can use the default crawl components only.

crawlergopipelineschedulespider
GitHub ↗

License & maintenance

MPL-2.0 is a copyleft license: products that include or modify it may have to publish their code.

Last code push 8 years ago.

Similar projects

RepositoryStarsLanguageLicenseActivity
1iawia002/lux👾 Fast and simple video download library and CLI tool written in Go★ 31.8kGoMITSlowing
2shengqiangzhang/examples-of-web-crawlers一些非常有趣的python爬虫例子,对新手比较友好,主要爬取淘宝、天猫、微信、微信读书、豆瓣、QQ等网站。(Some interesting examples of python crawlers that are friendly to beginners. )★ 14.7kHTMLMITStale
3ssssssss-team/spider-flow新一代爬虫平台，以图形化方式定义爬虫流程，不写代码即可完成爬虫。★ 11.4kJavaMITStale
4junegunn/fzf:cherry_blossom: A command-line fuzzy finder★ 83.6kGoMITActive
5spf13/cobraA Commander for modern Go CLI interactions★ 44.7kGoApache-2.0Slowing
6kovidgoyal/kittyIf you live in the terminal, kitty is made for you! Cross-platform, fast, feature-rich, GPU based.★ 35.3kPythonGPL-3.0Active
7micro-editor/microA modern and intuitive terminal-based text editor★ 29.7kGoMITActive
8stretchr/testifyA toolkit with common assertions and mocks that plays nicely with the standard library★ 26.2kGoMITActive