versandkostenfrei-kaufen.com
robots.txt

Robots Exclusion Standard data for versandkostenfrei-kaufen.com

Resource Scan

Scan Details

Site Domain versandkostenfrei-kaufen.com
Base Domain versandkostenfrei-kaufen.com
Scan Status Ok
Last Scan2024-09-17T21:45:38+00:00
Next Scan 2024-10-17T21:45:38+00:00

Last Scan

Scanned2024-09-17T21:45:38+00:00
URL https://versandkostenfrei-kaufen.com/robots.txt
Domain IPs 85.13.163.221
Response IP 85.13.163.221
Found Yes
Hash 1393913266d860fdd34504d0d1bd85fe943a351534ba2acedb6abc3e9fb95c86
SimHash 2a711a935290

Groups

scrapy

Rule Path
Allow /

googlebot
googlebot-image
mediapartners-google
feedfetcher-google
googlebot-mobile
adsbot-google
bingbot
msnbot
slurp
teoma
is_archiver

Rule Path
Disallow /gutschein/
Disallow /go/
Disallow /gutschein-anzeigen/
Disallow /gutschein-anzeigen/*
Disallow /abo-anzeigen/
Disallow /zum-shop/
Disallow /*.pdf$
Disallow /*.php$
Disallow /trackback/
Disallow */trackback/
Disallow /wp-admin/

sistrix
strucr
mj12bot
ahrefsbot
seokicks-robot
xovi
searchmetricsbot
backlinkcrawler

Rule Path
Allow /

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.versandkostenfrei-kaufen.com/sitemap.xml