DEV Community

#bigdata

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Apache Spark RDDs vs DataFrames
godofgeeks profile

Apache Spark RDDs vs DataFrames

#bigdata #data #performance
Comments
8 min read
Moving Big Data from AWS to GCP: Redshift, EMR and Glue
emmanuelldev profile

Moving Big Data from AWS to GCP: Redshift, EMR and Glue

#aws #googlecloud #dataengineering #bigdata
Comments
21 min read
Building a Hadoop + Spark Data Warehouse with a Text-to-SQL AI Assistant
3254988796aaacode profile

Building a Hadoop + Spark Data Warehouse with a Text-to-SQL AI Assistant

#showdev #dataengineering #bigdata #ai
1
Comments
2 min read
AWS Glue Concurrent Execution: What Happens When Multiple Jobs Write to the Same S3 Location?
rahul_r15 profile

AWS Glue Concurrent Execution: What Happens When Multiple Jobs Write to the Same S3 Location?

#aws #bigdata #python #awsdatalake
Comments
8 min read
HDFS Architecture
godofgeeks profile

HDFS Architecture

#architecture #bigdata #data
Comments
7 min read
Hadoop Ecosystem Overview
godofgeeks profile

Hadoop Ecosystem Overview

#bigdata #data #dataengineering
Comments
8 min read
How Big Data Is Transforming Business Operations
adrian_rolex_363888578ea9 profile

How Big Data Is Transforming Business Operations

#bigdata #startup #analytics #ai
Comments
7 min read
Apache Data Lakehouse Weekly: October 21-28, 2026
alexmercedcoder profile

Apache Data Lakehouse Weekly: October 21-28, 2026

#bigdata #data #database #opensource
Comments
29 min read
Moving Big Data from GCP to AWS: BigQuery, Dataproc and Dataflow
emmanuelldev profile

Moving Big Data from GCP to AWS: BigQuery, Dataproc and Dataflow

#aws #googlecloud #dataengineering #bigdata
Comments
16 min read
From API to Business Insights: Building a Medallion Pipeline on AWS
rahul_r15 profile

From API to Business Insights: Building a Medallion Pipeline on AWS

#aws #bigdata #python #architecture
Comments
11 min read
Como aprendi Apache Spark — Parte 5: Joins — Shuffle, Broadcast e estratégias de execução
renanpyd profile

Como aprendi Apache Spark — Parte 5: Joins — Shuffle, Broadcast e estratégias de execução

#dataengineering #bigdata #spark #cluster
Comments
14 min read
Como aprendi Apache Spark — Parte 4: Shuffle — onde a performance começa a ficar avançada
renanpyd profile

Como aprendi Apache Spark — Parte 4: Shuffle — onde a performance começa a ficar avançada

#dataengineering #bigdata #pyspark #spark
Comments
13 min read
Próximo: Parte 2 — Por dentro da arquitetura do Apache Spark: Driver, Executors, Jobs, Stages e Tasks
renanpyd profile

Próximo: Parte 2 — Por dentro da arquitetura do Apache Spark: Driver, Executors, Jobs, Stages e Tasks

#pyspark #bigdata #dataengineering #spark
Comments
10 min read
Como aprendi Apache Spark — Parte 3: Partições, paralelismo e performance
renanpyd profile

Como aprendi Apache Spark — Parte 3: Partições, paralelismo e performance

#dataengineering #bigdata #pyspark #spark
Comments
13 min read
Apache Data Lakehouse Weekly: October 14-21, 2026
alexmercedcoder profile

Apache Data Lakehouse Weekly: October 14-21, 2026

#bigdata #data #opensource
Comments
8 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.