SEOkicks.de

Umzug auf neue Server abgeschlossen seokicks.de/news/202205/um…

@domainsgeneral Our database is updated several times a day. However, if and when new links are found depends on many factors. Basically: For technical and legal reasons, we cannot permanently crawl every single page, so we crawl different domains differently often and deeply.

How up to date is @SEOkicks "domain pop" data? I looked several domains and it seems it doesn't find any of the recent links pointing to it. When I compare the numbers with other sources, there seem to be quite some differences. This data isn't accurate or I'm wrong on this?

Kostenloser Download: Top 50.000 DE-Domains als CSV-Export seokicks.de/news/202106/ko…

@iphigenie @Doopie_NL This is definitely important, crawling such pages is of course without any value for us. So we are always grateful for hints where something doesn't work well, so we can improve our crawling algorithm.

@SEOkicks @Doopie_NL I can confirm it was a decent pace. Had your crawler stayed out of filters in the "layered navigation" on the listings page, might not have been bothered at all. You should find ways to make sure it avoids them, filtered results list not any value to your link checking anyway

Will the badly designed bots ever stop? @SEOkicks you are hereby blocked as not both respecting robots.txt and unable to deal with layered navigation. What an embarrassingly bad bot. So many bots pop up every week I'm so tired of it.

@Doopie_NL @iphigenie The same offer to you: If you think we should improve anything, please send me the affected domain and we will check the logs in detail. In case of blocking, please use robots.txt, as this works regardless of the IP address we are using. I would naturally prefer an investigation.

@SEOkicks @iphigenie Last week we banned seokicks bot too on our servers! It was hammering the sites like crazy. Basically it was a DDOS like attack. After we banned it all the sites went back to normal and no problems ever since. We keep them banned, all new servers will be preconfigured to ban them

@iphigenie Of course you are free to block our crawler partially or completely via robots.txt. If you want us to investigate if there is an error on our site, just tell us the domain and we will look at the crawling log in detail.

@SEOkicks got tangled into "multi selecting" options on our layered navigation that aren't actually multi select (human in browser cannot select more than one) longer and longer urls all with no results. I am not your customer why would I let you in spy on our content for our competitors?

Blackhat Linkbuilding: Google Platz 1 durch Typo3 Sicherheitslücke und Cloaking seokicks.de/news/202004/bl…

Die meistverlinkten Affiliate Programme im AWIN Netzwerk: seokicks.de/news/201912/di…

Die neue SEOkicks Affiliate-Suche listet Publisher-Websites für Affiliate-Programme im AWIN Netzwerk: seokicks.de/news/201904/ne…

@danatello Sure, done! :)

Folgen der DSGVO: Anzahl deutscher Websites sinkt um gut 20 Prozent seokicks.de/news/201810/fo…

Just write us an e-mail, that's 100% fine :) twitter.com/pialabet/statu…

Negative SEO: Porno-Verlinkungen auf hunderte deutsche Websites seokicks.de/news/201712/ne…

@pauldambra Please send your domain name to info@seokicks.de and we'll investigate what's going on there. Sorry for the inconvenience!

@olivertrebes Webmaster sind sicher in der Lage dem Link zu Wikipedia zu folgen ;) Vollsperrung für Einzelcrawler ist meist der falsche Weg.

@olivertrebes Zb alle 12 Std würde netzweit zu vielen Mio. zusätzlichen Abrufen/Monat führen & im Einzelfall nur wenige Zugriffe zu sparen.

@olivertrebes Zu Beginn eines Crawls und dann alle 24 Stunden ist zu selten? Erklärung & Links zur robots.txt finden sich auf der Infoseite.

Neu: Extern verlinkte Fehlerseiten und lange Redirectketten einfach erkennen mit der HTTP Status Code Analyse. seokicks.de/news/201701/ht…