cyclingforfun.org
robots.txt

Robots Exclusion Standard data for cyclingforfun.org

Resource Scan

Scan Details

Site Domain cyclingforfun.org
Base Domain cyclingforfun.org
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-04-30T03:41:33+00:00
Next Scan 2025-05-30T03:41:33+00:00

Last Successful Scan

Scanned2025-04-01T01:41:50+00:00
URL https://cyclingforfun.org/robots.txt
Domain IPs 75.102.58.53
Response IP 75.102.58.53
Found Yes
Hash 95b1197d4b5ff3744b05503a6afa24492fbb99bdc36aa4844505b1f2117bdadc
SimHash 01869b068155

Groups

*

Rule Path
Disallow /smf/attachments/
Disallow /smf/Packages/
Disallow /smf/avatars/
Disallow /smf/imagenes/
Disallow /smf/activate/
Disallow /smf/admin/
Disallow /smf/calendar/
Disallow /smf/collapse/
Disallow /smf/deletemsg/
Disallow /smf/editpoll/
Disallow /smf/help/
Disallow /smf/helpadmin/
Disallow /smf/lock/
Disallow /smf/login/
Disallow /smf/logout/
Disallow /smf/markasread/
Disallow /smf/mergetopics/
Disallow /smf/mlist/
Disallow /smf/modifykarma/
Disallow /smf/movetopic/
Disallow /smf/notify/
Disallow /smf/notifyboard/
Disallow /smf/pm/
Disallow /smf/post/
Disallow /smf/profile/
Disallow /smf/register/
Disallow /smf/removetopic2/
Disallow /smf/reporttm/
Disallow /smf/search/
Disallow /smf/sendtopic/
Disallow /smf/splittopics/
Disallow /smf/stats/
Disallow /smf/sticky/
Disallow /smf/trackip/
Disallow /smf/unread/
Disallow /smf/unreadreplies/
Disallow /smf/who/
Disallow /smf/Themes/
Disallow /smf/index.php?action=activate
Disallow /smf/index.php?action=admin
Disallow /smf/index.php?action=arcade
Disallow /smf/index.php?action=calendar
Disallow /smf/index.php?action=collapse
Disallow /smf/index.php?action=deletemsg
Disallow /smf/index.php?action=editpoll
Disallow /smf/index.php?action=help
Disallow /smf/index.php?action=helpadmin
Disallow /smf/index.php?action=lock
Disallow /smf/index.php?action=login
Disallow /smf/index.php?action=logout
Disallow /smf/index.php?action=markasread
Disallow /smf/index.php?action=mergetopics
Disallow /smf/index.php?action=mlist
Disallow /smf/index.php?action=modifykarma
Disallow /smf/index.php?action=movetopic
Disallow /smf/index.php?action=notify
Disallow /smf/index.php?action=notifyboard
Disallow /smf/index.php?action=pm
Disallow /smf/index.php?action=post
Disallow /smf/index.php?action=profile
Disallow /smf/index.php?action=register
Disallow /smf/index.php?action=removetopic2
Disallow /smf/index.php?action=reporttm
Disallow /smf/index.php?action=search
Disallow /smf/index.php?action=sendtopic
Disallow /smf/index.php?action=splittopics
Disallow /smf/index.php?action=stats
Disallow /smf/index.php?action=sticky
Disallow /smf/index.php?action=trackip
Disallow /smf/index.php?action=unread
Disallow /smf/index.php?action=unreadreplies
Disallow /smf/index.php?action=who
Disallow /smf/*.msg
Disallow /smf/msg/
Disallow /smf/Robots.txt

googlebot
slurp
bingbot

Rule Path
Allow /

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://cyclingforfun.org/lego/sitemap.xml