san089/goodreads_etl_pipeline

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

airflowairflow-dagapache-airflowapache-sparkdata-engineeringdata-engineering-pipelinedata-lakedata-migrationemr-clusteretl-framework

License & maintenance

MIT is a permissive license: free to use commercially with attribution.

Last code push 6 years ago.

	Repository	Stars	Language	License	Activity
1	treeverse/lakeFSlakeFS - Data version control for your data lake \| Git for data	★ 5.6k	Go	Other	Active
2	dlt-hub/dltdata load tool (dlt) is an open source Python library that makes data loading easy 🛠️	★ 6k	Python	Apache-2.0	Active
3	pathwaycom/pathwayPython ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.	★ 62.1k	Python	Other	Active
4	Avaiga/taipyTurns Data and AI algorithms into production-ready web applications in no time.	★ 19.4k	Python	Apache-2.0	Active
5	andkret/CookbookThe Data Engineering Cookbook	★ 15.5k	Python	Apache-2.0	Active
6	risingwavelabs/risingwaveEvent streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.	★ 9.4k	Rust	Apache-2.0	Active
7	redpanda-data/connectFancy stream processing made operationally mundane	★ 8.8k	Go	—	Active
8	supabase/supabaseThe Postgres development platform. Supabase gives you a dedicated Postgres database to build your web, mobile, and AI applications.	★ 111.7k	TypeScript	Apache-2.0	Active