ukclimbing.com
robots.txt

Robots Exclusion Standard data for ukclimbing.com

Resource Scan

Scan Details

Site Domain ukclimbing.com
Base Domain ukclimbing.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-17T07:53:29+00:00
Next Scan 2024-12-16T07:53:29+00:00

Last Successful Scan

Scanned2024-05-21T01:04:04+00:00
URL https://ukclimbing.com/robots.txt
Redirect https://www.ukclimbing.com/robots.txt
Redirect Domain www.ukclimbing.com
Redirect Base ukclimbing.com
Domain IPs 109.108.136.253
Redirect IPs 109.108.136.253
Response IP 109.108.136.253
Found Yes
Hash 3b9b022ff1efac3415c555f516ffb796ed7b54ce22780350c3de4de66a5a088e
SimHash 0c4011364112

Groups

*

Rule Path
Disallow /cgi
Disallow /forums/t.php?n=
Disallow *%26new%3D
Disallow *%26delete%3D
Disallow /forums/info/search.php?
Disallow /forums/info/abuse.php?
Disallow /forums/post.php?
Disallow /forums/email.php?
Disallow /forums/?
Disallow /forums/index.php?
Disallow /forums/r.php?
Disallow /forums/info/profiles.php?keyword=
Disallow /forums/submit.php
Disallow /forums/rss.php?
Disallow /forums/s.php
Disallow /databases/crags/weather.php?
Disallow /photos/author.php?
Disallow /photos/random.php
Disallow /photos/search.php?
Disallow /photos/comments.php?
Disallow /photos/addcomment.php?
Disallow /photos/newphoto
Disallow /photos/editphoto
Disallow /photos/piclens.php?
Disallow *%26sort%3D
Disallow /images/dbpage.php?
Disallow *%26p%3D1
Disallow /logbook/addclimb.php
Disallow /logbook/addlog.php
Disallow /logbook/addlogs.php
Disallow /logbook/editclimb.php
Disallow /logbook/editlog.php
Disallow /logbook/guidebook_correction.php
Disallow /logbook/moderate.php
Disallow /logbook/options.php
Disallow /logbook/partners.php
Disallow /logbook/rsspartner.php
Disallow /logbook/uploadclimbs.php
Disallow /logbook/uploadlogs.php
Disallow /logbook/showgraph.php
Disallow /logbook/map/large.php
Disallow /logbook/hill/large.php
Disallow /logbook/rss.php
Disallow /articles/send.php
Disallow /gear/send.php
Disallow /gear/preview.php
Disallow /articles/preview.php
Disallow /news/sendnews.php
Disallow /news/sendevent.php
Disallow /news/preview.php
Disallow /news/lnk.php?i=
Disallow /listings/add.php
Disallow /listings/addcomment.php
Disallow /listings/largemap.php
Disallow /listings/click.php
Disallow /listings/appxml.php
Disallow /favicon.gif

googlebot-image

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-news

Rule Path
Disallow /

baiduspider-favo

Rule Path
Disallow /

baiduspider-cpro

Rule Path
Disallow /

baiduspider-ads

Rule Path
Disallow /

baidu

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

Other Records

Field Value
sitemap http://www.ukclimbing.com/forums/sitemap.php

Comments

  • Baiduspider
  • https://developer.amazon.com/support/amazonbot

Warnings

  • `user-agency` is not a known field.