DEV Community

#webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Scraping bilingual data: the Arabic/English traps that quietly corrupt your dataset

Scraping bilingual data: the Arabic/English traps that quietly corrupt your dataset

Comments
4 min read
I tested 42 large employers to see which ones you can actually scrape. Only 7 worked.

I tested 42 large employers to see which ones you can actually scrape. Only 7 worked.

Comments
4 min read
The same job is posted on three boards. Here's how to deduplicate job listings properly.

The same job is posted on three boards. Here's how to deduplicate job listings properly.

Comments
3 min read
How to find Dubai jobs before they appear on job boards

How to find Dubai jobs before they appear on job boards

Comments
3 min read
Web Scraping with Playwright: Handle Any Website

Web Scraping with Playwright: Handle Any Website

Comments
4 min read
Reducing Browser Fingerprint Detection Starts With Consistency

Reducing Browser Fingerprint Detection Starts With Consistency

Comments
5 min read
Track new job postings the week they appear, with a scheduled scraper and a diff

Track new job postings the week they appear, with a scheduled scraper and a diff

Comments
4 min read
How to Collect Product Data from a Website with Python

How to Collect Product Data from a Website with Python

Comments
3 min read
Trendigger – Aggregated Google Trends with AI keyword summaries and daily historical archives

Trendigger – Aggregated Google Trends with AI keyword summaries and daily historical archives

Comments
1 min read
Your scraping framework already exists: it's Scrapy

Your scraping framework already exists: it's Scrapy

1
Comments
14 min read
How to use Camoufox with Scrapy (New EASY Method)

How to use Camoufox with Scrapy (New EASY Method)

Comments
7 min read
Your proxy connected. That doesn't mean it hid your IP.

Your proxy connected. That doesn't mean it hid your IP.

Comments
4 min read
Why I only track one bookmaker for my odds-movement signal (and it's not the popular one)

Why I only track one bookmaker for my odds-movement signal (and it's not the popular one)

Comments
2 min read
Getting past Binance and Bybit's datacenter IP blocks without overpaying for proxies

Getting past Binance and Bybit's datacenter IP blocks without overpaying for proxies

Comments
2 min read
Build a SHEIN price tracker in 20 minutes with n8n and an Apify actor

Build a SHEIN price tracker in 20 minutes with n8n and an Apify actor

Comments
4 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.