Screaming Frog

41.6K posts

Screaming Frog banner
Screaming Frog

Screaming Frog

@screamingfrog

Run by Founder Dan Sharp of Screaming Frog, a UK search marketing agency & developer of the SEO Spider. Gooner. SEO. & Philanthropist.

Henley-on-Thames, Oxon, UK. Katılım Eylül 2008
1.2K Takip Edilen78.5K Takipçiler
Sabitlenmiş Tweet
Screaming Frog
Screaming Frog@screamingfrog·
Just released @screamingfrog SEO Spider v.23: screamingfrog.co.uk/blog/seo-spide… Includes - 💡Lighthouse & PSI Updated to Insight Audits ⚙️Crawl Retention Config 🧑‍🤝‍🧑Semantic Similarity Embedding Rules 📊Display All Links in Visualisations 🍇Links in Content Cluster Diagram & more!
Screaming Frog tweet media
English
8
25
109
10.7K
Screaming Frog
Screaming Frog@screamingfrog·
@Polo_Seo Not sure I understand what you're asking. But welcome to send anything through to support@screamingfrog.co.uk? A live example is always helpful.
English
1
0
0
91
Screaming Frog
Screaming Frog@screamingfrog·
@Caner80 Not directly in the UI, you'll need to use the 'Reports > Redirects > All Redirects' report (or we have specific ones for 'Redirects to Error' etc). If you want it to follow external URLs, then you'll need to enable 'Always Follow Redirects' via 'Config > Spider > Adv' as well.
English
1
0
0
19
Caner Acikkol
Caner Acikkol@Caner80·
@screamingfrog when I crawl, isn’t it possible to let the frog follow redirect chains and show the chain in separate columns like redirect 1 + statuscode, redirect 2 + statuscode, and so on, to see directly if the last part of the chain is 200 or 404?
English
1
0
0
28
Screaming Frog
Screaming Frog@screamingfrog·
@IrishWonder Cheers for the suggestion! We flag issues like indexable search results pages, so could possibly help. Obv concern would be anyone taking it too literally! 👍👌
English
1
0
5
1.1K
IrishWonder
IrishWonder@IrishWonder·
Feature suggestion @screamingfrog : let me build a robots.txt file for a site based on the crawl results/analysis
English
1
0
4
1.3K
Screaming Frog retweetledi
Chris Long
Chris Long@chris_nectiv·
Technical SEO Tip: Screaming Frog has the power to build custom extraction commands. Simply click on a page element...and it writes extractions:
GIF
English
15
9
61
4.1K
Screaming Frog
Screaming Frog@screamingfrog·
@effi_10 Sorry, bit late seeing this, but - #why-do-i-get-a-429-too-many-requests-error-response-crawling-a-shopify-site" target="_blank" rel="nofollow noopener">screamingfrog.co.uk/seo-spider/faq…
English
1
0
1
168
Cédric G. / effi10
Cédric G. / effi10@effi_10·
Sur #Shopify pour un crawl Screaming Frog il y a une astuce pour ne pas avoir d'erreurs 429 ? Ou c'est lié au site / thème ? Pas possible que ça rame comme ça -_-
Français
6
0
1
1.3K
Screaming Frog
Screaming Frog@screamingfrog·
@s_matharu Yeah, it only applies to Internal URLs - so use 'Config > CDNs' to make them Internal, and it should work nicely!
English
1
0
1
15
Sunny Matharu 💬
Sunny Matharu 💬@s_matharu·
@screamingfrog I'm using the image alt generator, but my images are held on a CDN through a different host URL. How do I generate alt descriptions for these, as it seems to be only generating for what images it finds via the Internal tab?
English
1
0
0
36
Sunny Matharu 💬
Sunny Matharu 💬@s_matharu·
@screamingfrog I might have read it before but is it possible run an OpenAI prompt against an existing crawl? Example, missing alt text generation
English
1
0
1
50
Screaming Frog
Screaming Frog@screamingfrog·
@seo_sitch I've added a vote in for you for that one! Cheers for the feedback.
English
0
0
0
15
Mike M.
Mike M.@seo_sitch·
@screamingfrog I would +1 that feature request, I'm building workflows around these now.
English
1
0
1
22
Mike M.
Mike M.@seo_sitch·
@screamingfrog Is there a way to save all n-grams at once, rather than URL by URL?
English
1
0
0
20
Screaming Frog retweetledi
Metehan Yesilyurt
Metehan Yesilyurt@metehan777·
Everyone talks about Google Discover like it's a black box. Post great content. Use big images. Hope for the best. That's the advice. That's been the advice for years. I decided to take a different approach. Instead of guessing, I went into Google's own SDK and read what it actually exposes during normal operation. Event constants. Telemetry counters. Configuration values. Things that are sitting right there if you know where to look. What came out was a picture of a 9-stage content pipeline, and it changed how I think about Discover entirely. Knowledge Graph entities? I need to look carefully! Here is the part that surprised me most: the collection-level filter runs before interest matching. Before the pCTR model. Before any ranking happens at all. If a publisher is blocked at that stage, Google never even evaluates whether their content matches what the user wants. It is binary. One article generates enough negative feedback, and the entire domain gets suppressed. There is no equivalent blanket boost. The penalty surface is wider than the reward surface. Some other things the telemetry confirms: og:title is not just a display label, it feeds directly into the predicted click-through rate model. The first 7 days carry the highest freshness weight. After 30 days, continuous staleness decay begins, tracked in hours. And dismissed content never comes back, tombstones are permanent records stored on-device. There are also 276 event constants, 150 concurrent A/B experiments running on a single session, and a system called NAIADES that most publishers have never heard of. The full breakdown, with every finding traced to a specific string or event, is on my blog. I also created a dashboard with all specifications with a FREE pCTR tool. Link is in the first thread!
Metehan Yesilyurt tweet media
English
15
26
115
20.9K
Screaming Frog
Screaming Frog@screamingfrog·
@seo_sitch Awesome. Yeah, you do for each n-gram still I’m afraid. We might introduce an ‘all’ filter, it’s on the list!
English
1
0
0
17
Mike M.
Mike M.@seo_sitch·
@screamingfrog Thanks, that was surprisingly simple and I was overthinking it. It does look like I still need to go one at a time for 2-gram, 3-gram, etc.?
English
1
0
0
24
Screaming Frog retweetledi
Chris Long
Chris Long@chris_nectiv·
Technical SEO Tip: By enabling Screaming Frog's JavaScript crawling, you can take fully-rendered screenshots of every single page on your site:
GIF
English
13
9
55
4K
Screaming Frog
Screaming Frog@screamingfrog·
@stonetatara Cheers for the suggestion, we do have this on the 'todo' list, so will add a vote in for you. Thank you!
English
1
0
2
273
Mollo sur le Destroy
Mollo sur le Destroy@stonetatara·
Hi @screamingfrog , I miss a shorcut to create Segment from url (Right click on a url + Create segment) Hope you'll validate this AMAZING feature to the roadmap 🙏
English
1
0
0
316
Screaming Frog
Screaming Frog@screamingfrog·
@BKureishi We stagger it a little. You're welcome to update via the site though!
English
0
0
0
92
Screaming Frog
Screaming Frog@screamingfrog·
Just released a small update to 23.3 of the @screamingfrog SEO Spider - #23.3" target="_blank" rel="nofollow noopener">screamingfrog.co.uk/blog/seo-spide…. Includes an update to issue 'HTML Document Over 2MB' with Google's update on file size limits, alongside small improvements and bug fixes.
Screaming Frog tweet media
English
5
13
49
3.4K