wanhatkupit.fi
robots.txt

Robots Exclusion Standard data for wanhatkupit.fi

Resource Scan

Scan Details

Site Domain wanhatkupit.fi
Base Domain wanhatkupit.fi
Scan Status Ok
Last Scan2024-10-07T02:17:10+00:00
Next Scan 2024-11-06T02:17:10+00:00

Last Scan

Scanned2024-10-07T02:17:10+00:00
URL https://wanhatkupit.fi/robots.txt
Redirect https://www.wanhatkupit.fi/robots.txt
Redirect Domain www.wanhatkupit.fi
Redirect Base wanhatkupit.fi
Domain IPs 2a04:3545:1000:720:cc6e:e8ff:fe52:459f, 94.237.16.79
Redirect IPs 2a04:3545:1000:720:cc6e:e8ff:fe52:459f, 94.237.16.79
Response IP 94.237.16.79
Found Yes
Hash 1c6f9baa3d5897568142e7e046e4b82ac9832f485b98446f121735c4c0c181c7
SimHash 49549c63f393

Groups

*

Rule Path
Disallow /wp/wp-admin/
Allow /wp/wp-admin/admin-ajax.php
Disallow /*sf_paged

Other Records

Field Value
crawl-delay 60

googlebot

Rule Path
Disallow /wp/wp-admin/
Allow /wp/wp-admin/admin-ajax.php
Disallow /*sf_paged

Other Records

Field Value
crawl-delay 60

googlebot-image

Rule Path
Disallow /wp/wp-admin/
Allow /wp/wp-admin/admin-ajax.php
Disallow /*sf_paged

Other Records

Field Value
crawl-delay 60

ahrefsbot

Rule Path
Disallow /wp/wp-admin/
Allow /wp/wp-admin/admin-ajax.php
Disallow /*sf_paged

Other Records

Field Value
crawl-delay 60

semrushbot

Rule Path
Disallow /

yandexcalendar

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

geedoproductsearch

Rule Path
Disallow /

ahrefssiteaudit

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.wanhatkupit.fi/sitemap.xml