whmatters.co.uk
robots.txt
Robots Exclusion Standard data for whmatters.co.uk
Resource Scan
Scan Details
Site Domain | whmatters.co.uk |
Base Domain | whmatters.co.uk |
Scan Status | Ok |
Last Scan | 2024-09-13T08:22:19+00:00 |
Next Scan | 2024-10-13T08:22:19+00:00 |
Last Scan
Scanned | 2024-09-13T08:22:19+00:00 |
URL | https://whmatters.co.uk/robots.txt |
Redirect | https://www.whmatters.co.uk/robots.txt |
Redirect Domain | www.whmatters.co.uk |
Redirect Base | whmatters.co.uk |
Domain IPs | 75.2.28.136 |
Redirect IPs | 23.215.7.21, 23.215.7.27 |
Response IP | 23.59.168.138 |
Found | Yes |
Hash | 22a65e63a18f987c3a91fbd72a5c824a8b9c149e8956366f3de662e4074e092f |
SimHash | 3d12bd490504 |
Groups
*
Rule | Path |
---|---|
Allow | /core/*.css$ |
Allow | /core/*.css? |
Allow | /core/*.js$ |
Allow | /core/*.js? |
Allow | /core/*.gif |
Allow | /core/*.jpg |
Allow | /core/*.jpeg |
Allow | /core/*.png |
Allow | /core/*.svg |
Allow | /profiles/*.css$ |
Allow | /profiles/*.css? |
Allow | /profiles/*.js$ |
Allow | /profiles/*.js? |
Allow | /profiles/*.gif |
Allow | /profiles/*.jpg |
Allow | /profiles/*.jpeg |
Allow | /profiles/*.png |
Allow | /profiles/*.svg |
Disallow | /core/ |
Disallow | /profiles/ |
Disallow | /README.txt |
Disallow | /web.config |
Disallow | /admin/ |
Disallow | /comment/reply/ |
Disallow | /filter/tips |
Disallow | /node/add/ |
Disallow | /search/ |
Disallow | /user/register/ |
Disallow | /user/password/ |
Disallow | /user/login/ |
Disallow | /user/logout/ |
Disallow | /index.php/admin/ |
Disallow | /index.php/comment/reply/ |
Disallow | /index.php/filter/tips |
Disallow | /index.php/node/add/ |
Disallow | /index.php/search/ |
Disallow | /index.php/user/password/ |
Disallow | /index.php/user/register/ |
Disallow | /index.php/user/login/ |
Disallow | /index.php/user/logout/ |
Disallow | /sites/g/files/*.jpeg |
Disallow | /sites/g/files/*.gif |
Disallow | /sites/g/files/*.png |
Disallow | /sites/g/files/*.txt |
Disallow | /sites/g/files/*.doc |
Disallow | /sites/g/files/*.docx |
Disallow | /sites/g/files/*.xls |
Disallow | /sites/g/files/*.xlsx |
Disallow | /sites/g/files/*.pdf |
Disallow | /sites/g/files/*.ppt |
Disallow | /sites/g/files/*.pptx |
Disallow | /sites/g/files/*.pps |
Disallow | /sites/g/files/*.ppsx |
Disallow | /sites/g/files/*.odt |
Disallow | /sites/g/files/*.ods |
Disallow | /sites/g/files/*.odp |
Disallow | /sites/g/files/*.mp3 |
Disallow | /sites/g/files/*.mov |
Disallow | /sites/g/files/*.mp4 |
Disallow | /sites/g/files/*.m4a |
Disallow | /sites/g/files/*.m4v |
Disallow | /sites/g/files/*.mpeg |
Disallow | /sites/g/files/*.avi |
Disallow | /sites/g/files/*.ogg |
Disallow | /sites/g/files/*.oga |
Disallow | /sites/g/files/*.ogv |
Disallow | /sites/g/files/*.weba |
Disallow | /sites/g/files/*.webp |
Disallow | /sites/g/files/*.webm |
Other Records
Field | Value |
---|---|
sitemap | https://www.whmatters.co.uk/sitemap.xml |
Warnings
- 2 invalid lines.
Comments