ukhillwalking.com
robots.txt
Robots Exclusion Standard data for ukhillwalking.com
Resource Scan
Scan Details
| Site Domain | ukhillwalking.com |
| Base Domain | ukhillwalking.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-13T15:37:52+00:00 |
| Next Scan | 2024-12-12T15:37:52+00:00 |
Last Successful Scan
| Scanned | 2024-05-17T10:48:47+00:00 |
| URL | https://ukhillwalking.com/robots.txt |
| Redirect | https://www.ukhillwalking.com/robots.txt |
| Redirect Domain | www.ukhillwalking.com |
| Redirect Base | ukhillwalking.com |
| Domain IPs | 109.108.136.253 |
| Redirect IPs | 109.108.136.253 |
| Response IP | 109.108.136.253 |
| Found | Yes |
| Hash | 89a2eaf88b313f41823f2dfd8379a07b1de16447dcbe4b7e7cf7668dabd532ef |
| SimHash | 0c4011364112 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi |
| Disallow | /forums/t.php?n= |
| Disallow | *%26new%3D |
| Disallow | *%26delete%3D |
| Disallow | /forums/info/search.php? |
| Disallow | /forums/info/abuse.php? |
| Disallow | /forums/post.php? |
| Disallow | /forums/email.php? |
| Disallow | /forums/? |
| Disallow | /forums/index.php? |
| Disallow | /forums/r.php? |
| Disallow | /forums/info/profiles.php?keyword= |
| Disallow | /forums/submit.php |
| Disallow | /forums/rss.php? |
| Disallow | /forums/s.php |
| Disallow | /databases/crags/weather.php? |
| Disallow | /photos/author.php? |
| Disallow | /photos/random.php |
| Disallow | /photos/search.php? |
| Disallow | /photos/comments.php? |
| Disallow | /photos/addcomment.php? |
| Disallow | /photos/newphoto |
| Disallow | /photos/editphoto |
| Disallow | /photos/piclens.php? |
| Disallow | *%26sort%3D |
| Disallow | /images/dbpage.php? |
| Disallow | *%26p%3D1 |
| Disallow | /logbook/addclimb.php |
| Disallow | /logbook/addlog.php |
| Disallow | /logbook/addlogs.php |
| Disallow | /logbook/editclimb.php |
| Disallow | /logbook/editlog.php |
| Disallow | /logbook/moderate.php |
| Disallow | /logbook/options.php |
| Disallow | /logbook/partners.php |
| Disallow | /logbook/rsspartner.php |
| Disallow | /logbook/uploadclimbs.php |
| Disallow | /logbook/uploadlogs.php |
| Disallow | /logbook/showgraph.php |
| Disallow | /logbook/map/large.php |
| Disallow | /logbook/hill/large.php |
| Disallow | /logbook/rss.php |
| Disallow | /articles/send.php |
| Disallow | /gear/send.php |
| Disallow | /gear/preview.php |
| Disallow | /articles/preview.php |
| Disallow | /news/sendnews.php |
| Disallow | /news/sendevent.php |
| Disallow | /news/preview.php |
| Disallow | /news/lnk.php?i= |
| Disallow | /listings/add.php |
| Disallow | /listings/addcomment.php |
| Disallow | /listings/largemap.php |
| Disallow | /listings/click.php |
| Disallow | /listings/appxml.php |
| Disallow | /favicon.gif |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.hillwalking.com/forums/sitemap.php |
Warnings
- `user-agency` is not a known field.
Comments