DEV Community

#webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Three Playwright/Apify bugs that took me way too long to find (and the fixes)

Three Playwright/Apify bugs that took me way too long to find (and the fixes)

Comments
3 min read
Web Scraping for OSINT: Start With the API, Not the HTML

Web Scraping for OSINT: Start With the API, Not the HTML

Comments
6 min read
Scraping 150k+ Instagram followers reliably: batching, resume-on-error, and enrichment

Scraping 150k+ Instagram followers reliably: batching, resume-on-error, and enrichment

Comments
2 min read
I measured what my 11 Actors cost to run. The 96x spread was mostly one config field.

I measured what my 11 Actors cost to run. The 96x spread was mostly one config field.

1
Comments
6 min read
Tennis, football and basketball results as clean JSON, without a sports data contract

Tennis, football and basketball results as clean JSON, without a sports data contract

Comments
4 min read
How to find every Shopify store in a list of 10,000 domains

How to find every Shopify store in a list of 10,000 domains

Comments
3 min read
Local Business Lead Scrapers on Apify Compared (September 2026)

Local Business Lead Scrapers on Apify Compared (September 2026)

Comments
7 min read
Remote Job Aggregators on Apify Compared (September 2026)

Remote Job Aggregators on Apify Compared (September 2026)

Comments
6 min read
How We Built Perceive: Web Content Extraction for RAG Pipelines

How We Built Perceive: Web Content Extraction for RAG Pipelines

Comments
8 min read
Why crawler reliability lives outside the scraper

Why crawler reliability lives outside the scraper

Comments
9 min read
Cómo solucionar el error \"Enable JavaScript and cookies to continue\"

Cómo solucionar el error \"Enable JavaScript and cookies to continue\"

Comments
3 min read
I scraped 100 Brazilian tech job listings to measure what companies actually pay

I scraped 100 Brazilian tech job listings to measure what companies actually pay

Comments
4 min read
I Measured 900 Apify Actors and Got the Price Wrong by 100x. Here's the Corrected Data

I Measured 900 Apify Actors and Got the Price Wrong by 100x. Here's the Corrected Data

Comments
6 min read
Competitive Intelligence Is a Freshness Problem, Not a Dashboard Problem

Competitive Intelligence Is a Freshness Problem, Not a Dashboard Problem

Comments
4 min read
Firecrawl Pricing: How to Calculate the Real Cost Per Usable Page

Firecrawl Pricing: How to Calculate the Real Cost Per Usable Page

Comments
8 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.