schmuddelecke.net
robots.txt

Robots Exclusion Standard data for schmuddelecke.net

Resource Scan

Scan Details

Site Domain schmuddelecke.net
Base Domain schmuddelecke.net
Scan Status Ok
Last Scan2024-06-01T02:56:01+00:00
Next Scan 2024-06-02T02:56:01+00:00

Last Scan

Scanned2024-06-01T02:56:01+00:00
URL https://www.schmuddelecke.net/robots.txt
Domain IPs 195.58.165.174
Response IP 195.58.165.174
Found Yes
Hash 80064d99ce1fc116d00c4e9043fae7d41cd3bf8a125a491b9227623c9f310d78
SimHash 7b1cd787a6a0

Groups

googlebot

Rule Path
Disallow /*www.facebook.com/plugins/
Disallow /www.tripple.net/tools/
Disallow /www.tripple.net/contator/schmuddelecke/videoshow.asp
Disallow /contator/schmuddelecke/porno-link.asp
Disallow /dispatcher/

googlebot-news

Rule Path
Disallow /contator/schmuddelecke/
Disallow /contator/grlz/
Disallow /contator/anna/
Disallow /grlz/
Disallow /contator/centropero/

googlebot-image

Rule Path
Disallow /

lcc

Rule Path
Disallow /

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

blexbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 60

seekportbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

dataforseobot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

serpstatbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

amazonbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

*

Rule Path
Disallow /test/
Disallow /tools/
Disallow /tools2/
Disallow /tripple/
Disallow /contator/webwizard/bookmark.asp
Disallow /www.tripple.net/tools/
Disallow /*.jpeg$
Disallow /*.jpg$
Disallow /*.png$
Disallow /*.gif$

Other Records

Field Value
sitemap https://www.tripple.net/sitemapindex.asp
sitemap https://www.auto.at/sitemapindexauto.asp
sitemap https://www.style.at/sitemapindexstyle.asp
sitemap https://www.shoppingcity.at/sitemapindexshoppingcity.asp
sitemap https://www.seminar.at/sitemapindexseminar.asp
sitemap https://www.journal.at/sitemapindexjournal.asp
sitemap https://www.webwizard.at/sitemapindexwebwizard.asp
sitemap https://www.schmuddelecke.net/sitemapindexschmuddelecke.asp
sitemap https://www.player.at/sitemapindexplayer.asp
sitemap https://www.musical.at/sitemapindexmusical.asp
sitemap https://www.pressrelease.at/sitemapindexpressrelease.asp
sitemap https://www.sem-seo.at/sitemapindexsemseo.asp
sitemap https://www.semantic.at/sitemapindexsemantic.asp
sitemap https://www.1080-wien.at/sitemapindex1080.asp
sitemap https://www.marketing-content.at/sitemapindexcontentmarketing.asp
sitemap https://www.grlz.eu/sitemapindexgrlz.asp
sitemap https://www.famili.at/sitemapindexfamili.asp
sitemap https://www.advent.at/sitemapindexadvent.asp
sitemap https://www.kinofilm.at/sitemapindexkinofilm.asp

Comments

  • Crawl-Delay: 1

Warnings

  • 2 invalid lines.