DEV Community

#webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Merging overlapping scrape results without double counting: 1,869 rows in, 1,671 out

Merging overlapping scrape results without double counting: 1,869 rows in, 1,671 out

Comments
7 min read
Scrape German Impressum pages into a clean company CSV (VAT ID, register, address), and stay on the right side of GDPR

Scrape German Impressum pages into a clean company CSV (VAT ID, register, address), and stay on the right side of GDPR

Comments
8 min read
How we built Bytewells: open-source foundations, our own stack, and a marketplace that does not force a fork

How we built Bytewells: open-source foundations, our own stack, and a marketplace that does not force a fork

Comments
9 min read
Getting eBay search results and prices as JSON with Python (no API key, no browser)

Getting eBay search results and prices as JSON with Python (no API key, no browser)

Comments
5 min read
677 of 785 Telegram Reaction Chips Counted Zero. The Custom Emoji and the Paid Stars Were Fine

677 of 785 Telegram Reaction Chips Counted Zero. The Custom Emoji and the Paid Stars Were Fine

Comments
7 min read
Scrapling in Practice: A Hands-On Look at a 97k-Star Python Scraping Project

Scrapling in Practice: A Hands-On Look at a 97k-Star Python Scraping Project

Comments
8 min read
Where salaries show up in Google Jobs: a 6-market snapshot (and why Singapore stands out)

Where salaries show up in Google Jobs: a 6-market snapshot (and why Singapore stands out)

Comments
4 min read
A year of Google searches for 7 AI chatbots: ChatGPT's share fell from 67% to 54%, and Claude's interest more than tripled

A year of Google searches for 7 AI chatbots: ChatGPT's share fell from 67% to 54%, and Claude's interest more than tripled

Comments
4 min read
Wireless earbuds on four Amazons: Japan rates about half a star lower, Mexico shows the biggest discounts

Wireless earbuds on four Amazons: Japan rates about half a star lower, Mexico shows the biggest discounts

Comments
4 min read
Scraping Capterra Reviews Without Logging In: Next.js Page Data, Cloudflare and the 375-Review Wall

Scraping Capterra Reviews Without Logging In: Next.js Page Data, Cloudflare and the 375-Review Wall

Comments
3 min read
¿Qué ofertas de empleo publican el salario? Cómo leer los rangos salariales de Greenhouse, Lever y Ashby

¿Qué ofertas de empleo publican el salario? Cómo leer los rangos salariales de Greenhouse, Lever y Ashby

Comments
7 min read
One Live Palantir Posting Is Dated December 2009. 535 of My 2,207 Lever Jobs Are Over a Year Old

One Live Palantir Posting Is Dated December 2009. 535 of My 2,207 Lever Jobs Are Over a Year Old

Comments
7 min read
I pointed raw requests at 8 anti-bot-protected sites, then tested every proxy route — here's what actually worked

I pointed raw requests at 8 anti-bot-protected sites, then tested every proxy route — here's what actually worked

Comments 1
4 min read
An IT Jobs Filter Can Exclude a Bank's Engineers

An IT Jobs Filter Can Exclude a Bank's Engineers

Comments
6 min read
What We Learned Building a DIY Web Scraper published

What We Learned Building a DIY Web Scraper published

5
Comments
10 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.