DEV Community

Tony Wang profile picture

Tony Wang

A Passionate Programmer Loving k8s, Golang,Python, JS/TS. Email: hi@tonywang.io. Welcome to support me here: bit.ly/mydevto

Seven Year Club
Six Year Club
Five Year Club
Writing Debut
Four Year Club
Three Year Club
Two Year Club
One Year Club
The State of Web Scraping & Anti-Bot 2026

The State of Web Scraping & Anti-Bot 2026

Comments
6 min read

Want to connect with Tony Wang?

Create an account to connect with Tony Wang. You can also sign in below to proceed if you already have an account.

Already have an account? Sign in
We Mapped the Salary You Need to Buy a Home in Every US State (2026 Data)

We Mapped the Salary You Need to Buy a Home in Every US State (2026 Data)

Comments
18 min read
You Now Need 11 Streaming Services (~$152/mo) to Watch 2026's Most-Popular Titles — We Mapped 1,771 Offers

You Now Need 11 Streaming Services (~$152/mo) to Watch 2026's Most-Popular Titles — We Mapped 1,771 Offers

Comments
12 min read
We Fingerprinted 978K Websites: Cloudflare, WordPress, and the CAPTCHA Cross-Check

We Fingerprinted 978K Websites: Cloudflare, WordPress, and the CAPTCHA Cross-Check

Comments
8 min read
Airbnb's Global Supply Map: Where 7.85M Listings Actually Are

Airbnb's Global Supply Map: Where 7.85M Listings Actually Are

Comments
9 min read
We Followed 173 Million Domains for 8 Years. ~40M Died.

We Followed 173 Million Domains for 8 Years. ~40M Died.

Comments
10 min read
The AI App Graveyard: 8,505 Apps, and the Median Has 10 Ratings

The AI App Graveyard: 8,505 Apps, and the Median Has 10 Ratings

Comments
7 min read
How Many AI Apps Are on the App Store? 1,490 Analyzed (2026)

How Many AI Apps Are on the App Store? 1,490 Analyzed (2026)

Comments
12 min read
The Podcast Gold Rush and the Graveyard You Can't See

The Podcast Gold Rush and the Graveyard You Can't See

Comments
15 min read
The State of Steam 2026: What 10,000 Games Reveal

The State of Steam 2026: What 10,000 Games Reveal

Comments
12 min read
Are Songs Really Getting Shorter? 6,618 Hot 100 Hits, 1959–2025

Are Songs Really Getting Shorter? 6,618 Hot 100 Hits, 1959–2025

Comments
11 min read
Codex vs Claude Code: What 1,828 Posts and Reviews Say That User Counts Cannot

Codex vs Claude Code: What 1,828 Posts and Reviews Say That User Counts Cannot

Comments
13 min read
X's App Store Rating Hasn't Moved Since Musk Bought It. The Reviews Have.

X's App Store Rating Hasn't Moved Since Musk Bought It. The Reviews Have.

Comments
10 min read
AI vs Traditional Web Scraping: Which Wins, When

AI vs Traditional Web Scraping: Which Wins, When

Comments
8 min read
Best SERP APIs in 2026 for Rank Tracking and Search Data

Best SERP APIs in 2026 for Rank Tracking and Search Data

Comments
10 min read
Proxies for Web Scraping, Explained (2026)

Proxies for Web Scraping, Explained (2026)

Comments
4 min read
World Cup 2026 TikTok Creators by the Numbers

World Cup 2026 TikTok Creators by the Numbers

Comments
10 min read
The TikTok World Cup: Who the Internet Actually Talks About

The TikTok World Cup: Who the Internet Actually Talks About

Comments
9 min read
Product Hunt Trends 2013–2026: How AI Agents Took Over Startup Launches

Product Hunt Trends 2013–2026: How AI Agents Took Over Startup Launches

Comments
16 min read
14% of the Web Is Actually Dead — But Not How You Think (We Scanned 10M Domains)

14% of the Web Is Actually Dead — But Not How You Think (We Scanned 10M Domains)

1
Comments 1
18 min read
Why Reddit Blocked Unauthenticated JSON in 2026 (and How to Still Get Reddit Data)

Why Reddit Blocked Unauthenticated JSON in 2026 (and How to Still Get Reddit Data)

Comments
8 min read
Best AI Web Scraping Tools in 2026: How to Choose

Best AI Web Scraping Tools in 2026: How to Choose

Comments
9 min read
How Paywalls Actually Work: The Engineering Behind Them

How Paywalls Actually Work: The Engineering Behind Them

2
Comments
14 min read
Give Your AI Agent Live Web Data with MCP

Give Your AI Agent Live Web Data with MCP

1
Comments 1
8 min read
27.6% of the Top 10 Million Sites are Dead

27.6% of the Top 10 Million Sites are Dead

Comments
6 min read
The Architecture of a Web Crawler: Building a Google-Inspired Distributed Web Crawler. Part 1

The Architecture of a Web Crawler: Building a Google-Inspired Distributed Web Crawler. Part 1

5
Comments
6 min read
How to efficiently scrape millions of Google Businesses on a large scale using a distributed crawler

How to efficiently scrape millions of Google Businesses on a large scale using a distributed crawler

Comments
7 min read
loading...