wanhatkupit.fi
robots.txt
Robots Exclusion Standard data for wanhatkupit.fi
Resource Scan
Scan Details
Site Domain | wanhatkupit.fi |
Base Domain | wanhatkupit.fi |
Scan Status | Ok |
Last Scan | 2024-10-07T02:17:10+00:00 |
Next Scan | 2024-11-06T02:17:10+00:00 |
Last Scan
Scanned | 2024-10-07T02:17:10+00:00 |
URL | https://wanhatkupit.fi/robots.txt |
Redirect | https://www.wanhatkupit.fi/robots.txt |
Redirect Domain | www.wanhatkupit.fi |
Redirect Base | wanhatkupit.fi |
Domain IPs | 2a04:3545:1000:720:cc6e:e8ff:fe52:459f, 94.237.16.79 |
Redirect IPs | 2a04:3545:1000:720:cc6e:e8ff:fe52:459f, 94.237.16.79 |
Response IP | 94.237.16.79 |
Found | Yes |
Hash | 1c6f9baa3d5897568142e7e046e4b82ac9832f485b98446f121735c4c0c181c7 |
SimHash | 49549c63f393 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp/wp-admin/ |
Allow | /wp/wp-admin/admin-ajax.php |
Disallow | /*sf_paged |
Other Records
Field | Value |
---|---|
crawl-delay | 60 |
googlebot
Rule | Path |
---|---|
Disallow | /wp/wp-admin/ |
Allow | /wp/wp-admin/admin-ajax.php |
Disallow | /*sf_paged |
Other Records
Field | Value |
---|---|
crawl-delay | 60 |
googlebot-image
Rule | Path |
---|---|
Disallow | /wp/wp-admin/ |
Allow | /wp/wp-admin/admin-ajax.php |
Disallow | /*sf_paged |
Other Records
Field | Value |
---|---|
crawl-delay | 60 |
Other Records
Field | Value |
---|---|
sitemap | https://www.wanhatkupit.fi/sitemap.xml |