crawlab-team/crawlab

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架

crawlabcrawlercrawling-tasksdockergoplatformscrapyscrapyd-uispiderspiders-management

License & maintenance

BSD-3-Clause is a permissive license: free to use commercially with attribution.

Last code push 8 months ago.

	Repository	Stars	Language	License	Activity
1	moby/mobyThe Moby Project - a collaborative project for the container ecosystem to assemble container-based systems	★ 72.2k	Go	Apache-2.0	Active
2	traefik/traefikThe Cloud Native Application Proxy	★ 65.3k	Go	MIT	Active
3	harness/harnessHarness Open Source is an end-to-end developer platform with Source Control Management, CI/CD Pipelines, Hosted Developer Environments, and	★ 38.6k	Go	Apache-2.0	Active
4	docker/composeDefine and run multi-container applications with Docker	★ 38.4k	Go	Apache-2.0	Active
5	air-verse/air☁️ Live reload for Go apps	★ 24.1k	Go	GPL-3.0	Active
6	jhao104/proxy_poolPython ProxyPool for web spider	★ 23.8k	Python	MIT	Slowing
7	pranshuparmar/witrWhy is this running? Trace any process, port, container, or file back to what started it - CLI + TUI.	★ 22.7k	Go	Apache-2.0	Active
8	semaphoreui/semaphoreModern UI and powerful API for Ansible, Terraform/OpenTofu/Terragrunt, PowerShell and other DevOps tools.	★ 14.3k	Go	MIT	Active