kupongi-koodid.ee
robots.txt

Robots Exclusion Standard data for kupongi-koodid.ee

Resource Scan

Scan Details

Site Domain kupongi-koodid.ee
Base Domain kupongi-koodid.ee
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-09-12T18:29:27+00:00
Next Scan 2024-10-12T18:29:27+00:00

Last Successful Scan

Scanned2024-08-14T13:53:24+00:00
URL https://www.kupongi-koodid.ee/robots.txt
Domain IPs 13.33.88.33, 13.33.88.34, 13.33.88.49, 13.33.88.53, 2600:9000:223b:0:1b:601b:80c0:93a1, 2600:9000:223b:1e00:1b:601b:80c0:93a1, 2600:9000:223b:5e00:1b:601b:80c0:93a1, 2600:9000:223b:7e00:1b:601b:80c0:93a1, 2600:9000:223b:8000:1b:601b:80c0:93a1, 2600:9000:223b:8a00:1b:601b:80c0:93a1, 2600:9000:223b:9000:1b:601b:80c0:93a1, 2600:9000:223b:cc00:1b:601b:80c0:93a1
Response IP 13.33.88.33
Found Yes
Hash d3e119f347c8587ed53b9a6dd82fe9414a1d04e4c851c90ebf95e84e1f463496
SimHash 680cdb34c2b1

Groups

*

Rule Path
Disallow /api
Disallow /dashboard

mediapartners-google

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

googlebot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

adsbot-google

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

googlebot-image

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

googlebot-mobile

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

msnbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

bingbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

slurp

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

yahoo! slurp

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.kupongi-koodid.ee/sitemap.xml