gutscheinrausch.de
robots.txt

Robots Exclusion Standard data for gutscheinrausch.de

Resource Scan

Scan Details

Site Domain gutscheinrausch.de
Base Domain gutscheinrausch.de
Scan Status Ok
Last Scan2024-09-28T10:51:29+00:00
Next Scan 2024-10-28T10:51:29+00:00

Last Scan

Scanned2024-09-28T10:51:29+00:00
URL https://gutscheinrausch.de/robots.txt
Domain IPs 2a01:4f8:211:1f06::2, 5.9.75.251
Response IP 5.9.75.251
Found Yes
Hash 52d1a8527af2f172ff16bf1bc305a4092d8412cde844bd031462f34c0a88a561
SimHash 2d715e19c25a

Groups

googlebot
googlebot-image
mediapartners-google
feedfetcher-google
googlebot-mobile
adsbot-google
bingbot
msnbot
slurp
teoma
is_archiver

Rule Path
Disallow /gutschein/
Disallow /go/
Disallow /ajax-code/
Disallow /gutschein-anzeigen/
Disallow /gutschein-einloesen/
Disallow /abo-anzeigen/
Disallow /zum-shop/
Disallow /*.pdf$
Disallow /*.php$
Disallow /trackback/
Disallow */trackback/
Disallow /wp-admin/
Disallow /zur-gratisprobe/
Disallow /mirror/apache/*/
Disallow /mirror/archlinux/*/
Disallow /mirror/cygwin/*/
Disallow /mirror/gnu/*/
Disallow /mirror/raspbian/*/
Disallow /mirror/xubuntu/*/

sistrix
strucr
mj12bot
ahrefsbot
seokicks-robot
xovi
searchmetricsbot
backlinkcrawler

Rule Path
Disallow /gutschein/
Disallow /go/
Disallow /gutschein-anzeigen/
Disallow /gutschein-einloesen/
Disallow /abo-anzeigen/
Disallow /zum-shop/
Disallow /ajax-code/

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap https://www.gutscheinrausch.de/sitemap_index.xml