turfpronos.fr
robots.txt
Robots Exclusion Standard data for turfpronos.fr
Resource Scan
Scan Details
Site Domain | turfpronos.fr |
Base Domain | turfpronos.fr |
Scan Status | Ok |
Last Scan | 2024-05-12T22:56:30+00:00 |
Next Scan | 2024-05-19T22:56:30+00:00 |
Last Scan
Scanned | 2024-05-12T22:56:30+00:00 |
URL | https://turfpronos.fr/robots.txt |
Redirect | https://www.turfpronos.fr/robots.txt |
Redirect Domain | www.turfpronos.fr |
Redirect Base | turfpronos.fr |
Domain IPs | 213.186.33.17 |
Redirect IPs | 213.186.33.17 |
Response IP | 213.186.33.17 |
Found | Yes |
Hash | 834eb3c697fdcd4a52f6872fda574b5cfad39399737c9c5d6e8cee2229c6a4ac |
SimHash | bc149d194764 |
Groups
*
Rule | Path |
---|---|
Disallow | /includes/ |
Disallow | /misc/ |
Disallow | /modules/ |
Disallow | /profiles/ |
Disallow | /scripts/ |
Disallow | /themes/ |
Disallow | /CHANGELOG.txt |
Disallow | /INSTALL.txt |
Disallow | /LICENSE.txt |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Comments