r/dataengineering

News & discussion on Data Engineering topics, including but not limited to: data pipelines, databases, data formats, storage, data modeling, data governance, cleansing, NoSQL, distributed systems, streaming, batch, Big Data, and workflow engines.

Subscribers

454.5K

454,458 total

Subscriber history

Overview

Subreddit

r/dataengineering

Subscribers

454,458

Tracked posts

4 shown (top 10)

Data points

Most popular posts

Title	Upvotes	Comments	Date
Composite primary key or Unique index	12	13	Feb 25, 2023
I finished my first streaming pipeline!	9	1	May 16, 2026
We created an open-source semantic search package on top of PostgreSQL	8	4	Jul 31, 2023
Best Practices for Semantic Search on 200k vectors (30GB) Worth of Embeddings?	7	4	Jan 28, 2024