Scrapingdog

479 posts

Scrapingdog banner
Scrapingdog

Scrapingdog

@scrapingdog

Web scraping API for scalable data extraction

Katılım Nisan 2020
47 Takip Edilen1.4K Takipçiler
Scrapingdog
Scrapingdog@scrapingdog·
Weekly Scrapingdog update 🚀 The X Profile Scraper API faster, added sponsored products and ads extraction to Google AIO and AI Mode APIs, launched the TikTok Ads Scraper on the dashboard, and fixed 400 errors in the Immersive Product API. Try it here: scrapingdog.com
English
0
1
3
60
Scrapingdog
Scrapingdog@scrapingdog·
Here we have mentioned 7 status codes that every scraper developer should be aware of.  We've also mentioned how can you handles those codes correctly. Checkout the post for more information and tell us which status code has caused you the most pain? Comment the number below.
Scrapingdog tweet media
English
0
0
2
61
Scrapingdog
Scrapingdog@scrapingdog·
Scraping Google Search with Node.js sounds simple… Until Google starts throwing CAPTCHAs, blocks your IP, changes the DOM, or hides data behind JavaScript. So I wrote a practical guide. Read the full guide here: scrapingdog.com/blog/scrape-go…
English
0
0
3
60
sam
sam@samgrows·
BREAKING: Claude can now watch videos for you! You can plug in a YouTube, Tiktok or Instagram URL and let Claude break it down for you Live now inside of Algrow
English
181
393
6.3K
726.4K
Scrapingdog
Scrapingdog@scrapingdog·
Scrapingdog Weekly Updates: Standard plan credit rollover, Google Immersive API empty response fix, and improved Google AI Mode & AI Overview API data completeness. Try Scrapingdog with 1,000 free credits.
English
0
1
5
99
Scrapingdog
Scrapingdog@scrapingdog·
Stop paying for rank trackers. Build your own in Python using Scrapingdog's Google SERP API — in under 50 lines of code. ✅ Track any keyword ✅ Real-time Google rankings ✅ No CAPTCHA, no blocks ✅ Schedule daily with a cron job Full video tutorial 👇
English
0
1
4
116
Scrapingdog retweetledi
Manthan Koolwal
Manthan Koolwal@KoolwalManthan·
🚀Just launched: TikTok Scraping API by @scrapingdog Extract TikTok profiles, videos, hashtags & trends, at scale, without blocks. ✅ No proxy management ✅ Structured JSON output ✅ Simple REST API Perfect for analytics tools, trend trackers & research platforms.
English
1
1
4
490
Scrapingdog
Scrapingdog@scrapingdog·
Until the website throws a 403 error, CAPTCHA, verification code, or some random block at you. That’s why Scrapingdog exists. Send one API request. Get clean, structured data back. No proxy setup. No browser headache. No anti-bot. Start scraping in minutes with 1000 free credits
English
0
1
4
108
Scrapingdog
Scrapingdog@scrapingdog·
Most people use scraping and crawling like they’re the same thing. They’re not. A crawler finds pages. A scraper extracts data from pages. If your tool follows links, it’s crawling. If it pulls structured data from a known page, it’s scraping. So… what are you building?
Scrapingdog tweet media
English
1
0
4
60
Scrapingdog
Scrapingdog@scrapingdog·
Scrapingdog weekly update is here and it's a big one: Google Lite Search API latency dropped. Screenshot API now supports format & quality parameters TikTok Profile & Post Scraper APIs are LIVE on dashboard + docs Faster APIs. More control.
English
0
1
3
92
Scrapingdog
Scrapingdog@scrapingdog·
We built a web scraping API for data engineers. Someone used it to track flight prices for his entire extended family and WhatsApp alert them when prices drop. Built it in a weekend. Zero scraping experience. That's how you know your abstraction is actually working.
English
0
1
3
104
Scrapingdog
Scrapingdog@scrapingdog·
Not all scraping APIs are the same. Before you sign anything, ask these 6 questions: Most APIs fail at least 2 of these. Drop a comment and we'll answer all 6 for Scrapingdog. You are out of free messages until 6:30 PM
Scrapingdog tweet media
English
0
0
3
64
Scrapingdog
Scrapingdog@scrapingdog·
Just built a tool 𝗕𝗿𝗮𝗻𝗱𝗣𝘂𝗹𝘀𝗲 𝗪𝗵𝗼 𝗶𝘀 𝘁𝗵𝗶𝘀 𝗳𝗼𝗿? → Founders tracking their own name or startup → PR agencies managing client reputation → Marketers monitoring campaign coverage → Agencies doing competitor research Link: lnkd.in/gJftBhiz
English
0
0
3
79
Scrapingdog
Scrapingdog@scrapingdog·
@arjunaditya_ Interesting. We may consider integrating this into our system for Indian customers.
English
0
0
1
93
Arjun Aditya
Arjun Aditya@arjunaditya_·
If you're an indian d2c brand Just switch from cashfree / razorpay to phonepe's free payment gateway 🤷
Arjun Aditya tweet media
English
29
14
454
42.4K
Scrapingdog retweetledi
Manthan Koolwal
Manthan Koolwal@KoolwalManthan·
The evolution of a web scraper: Week 1: “Just fetch the HTML.” Week 2: Proxies. Week 3: Browser fingerprints. Week 4: “Buy Now” button only appears when the stars align. At this point, you’re not an engineer. You’re an astronomer with a grudge. That’s why we built @scrapingdog.
English
0
1
1
97
Scrapingdog
Scrapingdog@scrapingdog·
3 issues fixed at Scrapingdog this week: Google Maps API, LinkedIn Post Scraper, Google AIO API
English
0
0
2
87
Scrapingdog
Scrapingdog@scrapingdog·
Web scraping is easy until it isn’t. CAPTCHAs. Blocks. Empty responses. Missing data. Rotating tokens. These 5 sites break more scrapers than anything else. Build around it or skip the headache. Save this for later
Scrapingdog tweet media
English
0
0
6
94
Scrapingdog
Scrapingdog@scrapingdog·
Web scraping just got government-approved. India's Home Ministry told a Parliamentary Standing Committee something the industry has known for years that scraping publicly available data doesn't violate privacy. Not a loophole. An official position. thefederal.com/category/news/…
English
0
0
2
98
Scrapingdog retweetledi
Ritik Bhardwaj
Ritik Bhardwaj@RitikBh19434795·
@scrapingdog amazing Super easy APIs, reliable scraping, and saves tons of dev time. If you're working with data extraction, this is a no-brainer.
English
0
1
2
94