kuponhub.se
robots.txt

Robots Exclusion Standard data for kuponhub.se

Resource Scan

Scan Details

Site Domain kuponhub.se
Base Domain kuponhub.se
Scan Status Ok
Last Scan2024-10-22T13:04:36+00:00
Next Scan 2024-11-21T13:04:36+00:00

Last Scan

Scanned2024-10-22T13:04:36+00:00
URL https://www.kuponhub.se/robots.txt
Domain IPs 13.33.88.102, 13.33.88.111, 13.33.88.129, 13.33.88.26, 2600:9000:223b:1a00:10:abbe:dd40:93a1, 2600:9000:223b:5200:10:abbe:dd40:93a1, 2600:9000:223b:8a00:10:abbe:dd40:93a1, 2600:9000:223b:9c00:10:abbe:dd40:93a1, 2600:9000:223b:9e00:10:abbe:dd40:93a1, 2600:9000:223b:a000:10:abbe:dd40:93a1, 2600:9000:223b:b200:10:abbe:dd40:93a1, 2600:9000:223b:f800:10:abbe:dd40:93a1
Response IP 13.33.88.26
Found Yes
Hash 58ccbb3c706f47e36bbe7653842add5e5a9705bb6cc6361bb8c96845138f58d1
SimHash 6850df954293

Groups

*

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

mediapartners-google

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

adsbot-google

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

googlebot-image

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

googlebot-mobile

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

msnbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

bingbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

slurp

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

yahoo! slurp

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.kuponhub.se/sitemap/kuponhub.se.xml