SSealbook
Sealbook / Open source / Databases & data engineering

Top open-source databases & data engineering on GitHub

2,010 repositories with 1,000+ stars, ranked by stars. Leading: supabase, django, advanced-java.

RepositoryStarsLanguageLicenseActivity
1051plv8/plv8 V8 Engine Javascript Procedural Language add-on for PostgreSQL★ 2.1kC++OtherActive
10523masterplus/bookBook PDF★ 2.1kPHP—Stale
1053cmu-db/pelotonThe Self-Driving Database Management System★ 2.1kC++Apache-2.0Archived
1054DTStack/flinkStreamSQL基于开源的flink，对其实时sql进行扩展；主要实现了流与维表的join，支持原生flink SQL所有的语法★ 2kJavaApache-2.0Stale
1055jeffknupp/sandman2Automatically generate a RESTful API service for your legacy database. No code required!★ 2kPythonApache-2.0Active
1056RedisGraph/RedisGraphA graph database as a Redis module★ 2kCOtherStale
1057data-engineering-community/data-engineering-wikiThe best place to learn data engineering. Built and maintained by the data engineering community.★ 2kCSSCC0-1.0Active
1058Qihoo360/QuicksqlA Flexible, Fast, Federated(3F) SQL Analysis Middleware for Multiple Data Sources★ 2kJavaMITStale
1059elastic/rallyMacrobenchmarking framework for Elasticsearch★ 2kPythonApache-2.0Active
1060pimusicbox/pimusicboxAn image (SD-card) to turn the Raspberry Pi into an easy to use MusicBox with Spotify playback and AirTunes streaming★ 2kShellApache-2.0Archived
10611602/jugglingdbMulti-database ORM for nodejs: redis, mongodb, mysql, sqlite3, postgresql, arango, in-memory...★ 2kJavaScript—Stale
1062hua1995116/webchat:speaker: Websocket project based on vue（基于vue2.0的实时聊天项目）★ 2kJavaScriptMITStale
1063apache/drillApache Drill is a distributed MPP query layer for self describing data★ 2kJavaApache-2.0Active
1064librats/rats-searchrats-search: BitTorrent P2P multi-platform search engine for Desktop and Web servers with integrated torrent client★ 2kC++MITActive
1065yuhonas/free-exercise-dbOpen Public Domain Exercise Dataset in JSON format, over 800 exercises with a browsable public searchable frontend★ 2kVueUnlicenseActive
1066apache/bookkeeperApache BookKeeper - a scalable, fault tolerant and low latency storage service optimized for append-only workloads★ 2kJavaApache-2.0Active
1067zfoo-project/zfoo💡Extremely fast enterprise server framework, can be used in RPC, game server, web server.★ 2kJavaApache-2.0Slowing
1068jaredwray/cacheablea robust, scalable, and maintained set of caching packages★ 2kTypeScriptMITActive
1069fede1024/rust-rdkafkaA fully asynchronous, futures-based Kafka client library for Rust based on librdkafka★ 2kRustMITSlowing
1070broadinstitute/gatkOfficial code repository for GATK versions 4 and up★ 2kJavaOtherActive
1071asg017/sqlite-vssA SQLite extension for efficient vector search, based on Faiss!★ 2kC++MITStale
1072pravega/pravegaPravega - Streaming as a new software defined storage primitive★ 2kJavaApache-2.0Stale
1073oxigraph/oxigraphSPARQL graph database★ 2kRustApache-2.0Active
1074aickin/react-dom-streamA streaming server-side rendering library for React.★ 2kJavaScript—Stale
1075sewenew/redis-plus-plusRedis client written in C++★ 2kC++Apache-2.0Active
1076samyk/slipstreamNAT Slipstreaming allows an attacker to remotely access any TCP/UDP services bound to a victim machine, bypassing the victim’s NAT/firewall,★ 2kPerl—Stale
1077mysql2sqlite/mysql2sqliteConverts MySQL dump to SQLite3 compatible dump★ 2kAwkMITStale
1078mike-marcacci/node-redlockA node.js redlock implementation for distributed, highly-available redis locks★ 2kTypeScriptMITSlowing
1079Qihoo360/poseidonA search engine which can hold 100 trillion lines of log data.★ 2kGoBSD-3-ClauseStale
1080liyupi/yu-ai-code-mother编程导航 AI + 微服务全栈新项目，基于 Spring Boot 3 + LangChain4j 的大厂 AI 应用生成平台，支持多种模式的智能代码生成、可视化编辑预览、一键部署分享、应用管理、AI 智能路由等。覆盖 AI 智能体开发、LangGraph4j 工作流、Tool ★ 2kJava—Active
1081elastic/search-uiSearch UI. Libraries for the fast development of modern, engaging search experiences.★ 2kTypeScriptApache-2.0Active
1082elastic/elasticsearch-rubyRuby integrations for Elasticsearch★ 2kRubyApache-2.0Active
1083shzlw/poliAn easy-to-use BI server built for SQL lovers. Power data analysis in SQL and gain faster business insights.★ 2kJavaMITStale
1084mafintosh/torrent-streamThe low level streaming torrent engine that peerflix uses★ 2kJavaScriptMITStale
1085white-cat/ThinkAndroidThinkAndroid是一个免费的开源的、简易的、遵循Apache2开源协议发布的Android开发框架，其开发宗旨是简单、快速的进行 Android应用程序的开发，包含Android mvc、简易sqlite orm、ioc模块、封装Android httpclitent的h★ 2kJava—Stale
1086jdesboeufs/connect-mongoMongoDB session store for Express★ 2kTypeScriptMITSlowing
1087gridex/gridexA native macOS / windows / Linux database IDE built with Swift and AppKit. Connect to PostgreSQL, MySQL, SQLite, and Redis from a single app★ 2kC++Apache-2.0Active
1088javahongxi/whatsmarsJava生态研究(Spring Boot + Redis + Dubbo + RocketMQ + Elasticsearch)🔥🔥🔥🔥🔥★ 2kJavaApache-2.0Active
1089mirage/irminIrmin is a distributed database that follows the same design principles as Git★ 2kOCamlISCActive
1090atjiu/pybbs更实用的Java开发的社区(论坛)，Better use of Java development community (forum)★ 2kJavaAGPL-3.0Slowing
1091darold/pgFormatterA PostgreSQL SQL syntax beautifier that can work as a console program or as a CGI. On-line demo site at http://sqlformat.darold.net/★ 2kPLpgSQLPostgreSQLActive
1092openresty/lua-resty-redisLua redis client driver for the ngx_lua based on the cosocket API★ 2kLua—Active
1093mackyle/sqliteUnofficial git mirror of SQLite sources (see link for build instructions)★ 2kCOtherActive
1094apache/cassandra-spark-connectorApache Spark to Apache Cassandra connector★ 2kScalaApache-2.0Stale
1095rq/django-rqA simple app that provides django integration for RQ (Redis Queue)★ 2kPythonMITActive
1096rueckstiess/mtoolsA collection of scripts to set up MongoDB test environments and parse and visualize MongoDB log files.★ 2kPythonApache-2.0Active
1097microsoft/DiskANNA vector indexing library to bring fast, fresh and filtered search to your database★ 1.9kRustMITActive
1098piccolo-orm/piccoloA fast, user friendly ORM and query builder which supports asyncio.★ 1.9kPythonMITActive
1099diego3g/rocketredisA beautiful Redis GUI :fire: (under development)★ 1.9kTypeScriptMITActive
1100mattgallagher/AudioStreamerA streaming audio player class (AudioStreamer) for Mac OS X and iPhone.★ 1.9kObjective-C—Stale