digitalcatapultcentre.org.uk
robots.txt
Robots Exclusion Standard data for digitalcatapultcentre.org.uk
Resource Scan
Scan Details
| Site Domain | digitalcatapultcentre.org.uk |
| Base Domain | digitalcatapultcentre.org.uk |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't establish SSL connection. |
| Last Scan | 2024-08-15T17:42:41+00:00 |
| Next Scan | 2024-10-14T17:42:41+00:00 |
Last Successful Scan
| Scanned | 2024-06-17T17:41:56+00:00 |
| URL | http://digitalcatapultcentre.org.uk/robots.txt |
| Domain IPs | 52.208.189.35, 54.171.20.39 |
| Response IP | 54.171.20.39 |
| Found | Yes |
| Hash | fa30ec087141354f5f4439e148945287bc6c8089fefd250beb352a4c7e2ed4d8 |
| SimHash | cd205c5146f0 |
Groups
*
| Rule | Path |
|---|---|
| Allow | *.js |
| Allow | *.css |
| Disallow | *search?q |
| Disallow | */preview/ |
| Disallow | /test$ |
| Disallow | /tag/ |
| Disallow | /xmlrpc.php |
| Disallow | /profile |
| Disallow | /cgi-bin/ |
| Disallow | /tmp/ |
| Disallow | /junk/ |
| Disallow | /index.php?* |
| Disallow | /trackback/ |
| Disallow | /administrator/ |
| Disallow | */trackback/ |
| Disallow | /license.txt |
| Disallow | /*.php$ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.houseandgarden.co.za/sitemap.xml |