Sealbook / Open source / Developer tools, CLI & editors

apify/crawlee-python

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy ro

apifyautomationbeautifulsoupcrawlercrawlingheadlessheadless-chromeparselpipplaywright

GitHub ↗Website ↗

License & maintenance

Apache-2.0 is a permissive license: free to use commercially with attribution.

Last code push 2 days ago.

Similar projects

	Repository	Stars	Language	License	Activity
1	microsoft/playwrightPlaywright is a framework for Web Testing and Automation. It allows testing Chromium, Firefox and WebKit with a single API.	★ 98k	TypeScript	Apache-2.0	Active
2	puppeteer/puppeteerJavaScript API for Chrome and Firefox	★ 95.7k	TypeScript	Apache-2.0	Active
3	ariya/phantomjsScriptable Headless Browser	★ 29.4k	C++	BSD-3-Clause	Archived
4	projectdiscovery/katanaA next-generation crawling and spidering framework.	★ 17.7k	Go	MIT	Active
5	codelucas/newspapernewspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:	★ 15.2k	Python	MIT	Active
6	FujiwaraChoki/MoneyPrinterV2Automate the process of making money online.	★ 32.1k	Python	AGPL-3.0	Active
7	iawia002/lux👾 Fast and simple video download library and CLI tool written in Go	★ 31.8k	Go	MIT	Slowing
8	hashicorp/vagrantVagrant is a tool for building and distributing development environments.	★ 27.2k	Ruby	Other	Active