londonspeakerhire.com
robots.txt
Robots Exclusion Standard data for londonspeakerhire.com
Resource Scan
Scan Details
Site Domain | londonspeakerhire.com |
Base Domain | londonspeakerhire.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-04-15T21:15:54+00:00 |
Next Scan | 2024-07-14T21:15:54+00:00 |
Last Successful Scan
Scanned | 2023-05-29T17:40:13+00:00 |
URL | https://londonspeakerhire.com/robots.txt |
Redirect | https://www.londonspeakerhire.com/robots.txt |
Redirect Domain | www.londonspeakerhire.com |
Redirect Base | londonspeakerhire.com |
Domain IPs | 172.66.40.242, 172.66.43.14 |
Redirect IPs | 172.66.40.242, 172.66.43.14 |
Response IP | 172.66.43.14 |
Found | Yes |
Hash | 5e5d5a5b35d2d0919c3df5ac58596466c540c286b2dfe5c7fc7eb0634344d392 |
SimHash | 855070dc69bd |
Groups
*
Rule | Path |
---|---|
Disallow | /config |
Disallow | /controllers |
Disallow | /elements |
Disallow | /helpers |
Disallow | /jobs |
Disallow | /languages |
Disallow | /libraries |
Disallow | |
Disallow | /models |
Disallow | /page_types |
Disallow | /single_pages |
Disallow | /tools |
Disallow | /index.php/tools |
Disallow | /blocks/*.php$ |
Disallow | /blocks/*.xml$ |
Disallow | /concrete/*.php$ |
Disallow | /concrete/*.xml$ |
Disallow | /packages/*.php$ |
Disallow | /packages/*.xml$ |
Disallow | /updates/*.php$ |
Disallow | /updates/*.xml$ |