DEV Community

# bigdata

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Top 12 Spark Interview Problems for Data Engineers, With Answers

Top 12 Spark Interview Problems for Data Engineers, With Answers

Comments
10 min read
Does Early Dragon Control Help Scaling Compositions? A Big Data Analysis of League of Legends

Does Early Dragon Control Help Scaling Compositions? A Big Data Analysis of League of Legends

9
Comments 4
4 min read
Why Big Tech is Migrating from Traditional Databases to NewSQL

Why Big Tech is Migrating from Traditional Databases to NewSQL

1
Comments
1 min read
The Future of Query Optimization: AI-Driven Insights in Big Data

The Future of Query Optimization: AI-Driven Insights in Big Data

Comments
7 min read
Predictive Maintenance in 2026: How AI, Edge Computing, and Agentic Systems Turn Detection Into Action

Predictive Maintenance in 2026: How AI, Edge Computing, and Agentic Systems Turn Detection Into Action

Comments
14 min read
Migrating a ScyllaDB Cluster the “Brain Transplant” Way

Migrating a ScyllaDB Cluster the “Brain Transplant” Way

Comments
6 min read
"We Have DevOps, So Why Not DataOps?"

"We Have DevOps, So Why Not DataOps?"

Comments
2 min read
Valentina Studio v17.3 supports new VARIANT field type of DuckDB v1.5

Valentina Studio v17.3 supports new VARIANT field type of DuckDB v1.5

Comments
1 min read
The Data Refinery: Why Apache Spark is the Engine Behind Real-World Big Data Use Cases

The Data Refinery: Why Apache Spark is the Engine Behind Real-World Big Data Use Cases

Comments
2 min read
The Next Decade of Data Engineering: From Modern Data Stack to Data Engineering Harness

The Next Decade of Data Engineering: From Modern Data Stack to Data Engineering Harness

Comments 1
8 min read
Processing High Frequency Solar Data Without HPC: Real Constraints and Design Decisions in MackSun

Processing High Frequency Solar Data Without HPC: Real Constraints and Design Decisions in MackSun

Comments
3 min read
Fentanyl Poverty: Building a Big Data Pipeline to Map America's Overdose Epidemic

Fentanyl Poverty: Building a Big Data Pipeline to Map America's Overdose Epidemic

5
Comments 4
3 min read
ETL vs ELT: Which One Should You Use and Why?

ETL vs ELT: Which One Should You Use and Why?

Comments
5 min read
Infrastructure Design for Credit Risk Modeling

Infrastructure Design for Credit Risk Modeling

Comments
1 min read
CONNECTING POSTGRESQL WITH POWERBI (FOR A LOAN PERFORMANCE DASHBOARD)

CONNECTING POSTGRESQL WITH POWERBI (FOR A LOAN PERFORMANCE DASHBOARD)

1
Comments
4 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.