DEV Community

Aniket Abhishek Soni profile picture

Aniket Abhishek Soni

Senior Data Engineer at Cognizant with 7+ years in ETL pipelines, AI-driven analytics, and cloud-native systems (Databricks, PySpark, Snowflake, AWS). Writing about data engineering, AI & cloud.

Location Brooklyn, New York, United States of America Joined Joined on  Personal website https://aniketsoni.com

Education

MS Computer Science - Southern Arkansas University

Pronouns

He/Him/His

Work

Senior Data Engineer at Cognizant Technology Solutions

Why your Iceberg catalog choice is costing you more than your storage
aniketsoni profile

Why your Iceberg catalog choice is costing you more than your storage

#iceberg #data #architecture #storage
1
Comments
5 min read
Text-to-SQL is a solved problem: why you’re about to leak your PII
aniketsoni profile

Text-to-SQL is a solved problem: why you’re about to leak your PII

#sql #llm #security #data
1
Comments
5 min read
Time Travel isn't a Debugging Luxury: Why Delta and Iceberg are Compliance Essentials
aniketsoni profile

Time Travel isn't a Debugging Luxury: Why Delta and Iceberg are Compliance Essentials

#data #engineering #iceberg #delta
1
Comments
4 min read
Is BigLake the End of Your Vendor Lock-in Delusion?
aniketsoni profile

Is BigLake the End of Your Vendor Lock-in Delusion?

#gcp #bigquery #iceberg #dataengineering
1
Comments
5 min read
Querying Petabytes of Iceberg Tables via BigLake without Breaking Production
aniketsoni profile

Querying Petabytes of Iceberg Tables via BigLake without Breaking Production

#dataengineering #gcp #iceberg #bigquery
1
Comments
4 min read
Why I’m finally ditching Hive Metastore for BigLake Iceberg
aniketsoni profile

Why I’m finally ditching Hive Metastore for BigLake Iceberg

#gcp #iceberg #bigquery #dataengineering
1
Comments
5 min read
How I Finally Killed the Full-Refresh Silver Layer
aniketsoni profile

How I Finally Killed the Full-Refresh Silver Layer

#delta #databricks #spark #dataengineering
Comments
5 min read
Cutting Snowflake compute costs 40 percent: warehouse sizing, auto-suspend, and query pruning
aniketsoni profile

Cutting Snowflake compute costs 40 percent: warehouse sizing, auto-suspend, and query pruning

#snowflake #cloud #data #engineering
Comments
5 min read
Streaming Tables vs. Materialized Views: Stop Guessing Your Databricks Refresh Strategy
aniketsoni profile

Streaming Tables vs. Materialized Views: Stop Guessing Your Databricks Refresh Strategy

#databricks #dataengineering #spark #delta
Comments
5 min read
Stop Burning Cash: Databricks Cost Optimization Patterns That Actually Work
aniketsoni profile

Stop Burning Cash: Databricks Cost Optimization Patterns That Actually Work

#databricks #cloud #finops #dataengineering
Comments
5 min read
Navigating Schema Shifts: Keeping Your Streaming Pipeline Smooth for Everyone
aniketsoni profile

Navigating Schema Shifts: Keeping Your Streaming Pipeline Smooth for Everyone

#streaming #schema #data #engineering
Comments
4 min read
The Silent Killer in Your Streaming Pipeline: Schema Evolution Without Tears
aniketsoni profile

The Silent Killer in Your Streaming Pipeline: Schema Evolution Without Tears

#schema #streaming #datapipelines #production
Comments
10 min read
Zero to Hardened: A Practical Migration Playbook for Docker Hardened Images in Regulated Industries
aniketsoni profile

Zero to Hardened: A Practical Migration Playbook for Docker Hardened Images in Regulated Industries

#docker #security #devops #containers
Comments
7 min read
It Works on My Cluster: Containerizing Spark and Lakehouse Development with Docker
aniketsoni profile

It Works on My Cluster: Containerizing Spark and Lakehouse Development with Docker

#docker #dataengineering #spark #devops
Comments
7 min read
Biohack Your Brain with Neural Implants: Why Silicon Valley's Elite Are Betting Big in 2026
aniketsoni profile

Biohack Your Brain with Neural Implants: Why Silicon Valley's Elite Are Betting Big in 2026

#ai #neuroscience #technology #future
Comments
5 min read
loading...