ridemonkey.com
robots.txt

Robots Exclusion Standard data for ridemonkey.com

Resource Scan

Scan Details

Site Domain ridemonkey.com
Base Domain ridemonkey.com
Scan Status Ok
Last Scan2024-06-03T16:50:12+00:00
Next Scan 2024-06-10T16:50:12+00:00

Last Scan

Scanned2024-06-03T16:50:12+00:00
URL https://ridemonkey.com/robots.txt
Redirect https://ridemonkey.bikemag.com/robots.txt
Redirect Domain ridemonkey.bikemag.com
Redirect Base bikemag.com
Domain IPs 52.40.188.77, 54.148.5.227
Redirect IPs 108.138.246.108, 108.138.246.26, 108.138.246.92, 108.138.246.97
Response IP 18.165.171.105
Found Yes
Hash fc5a0deb5be7beb21abbcfdc4c474f06580b31cf39f76e02913a21bea3229471
SimHash 2d1dd156e313

Groups

boardreader

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

*

Rule Path
Disallow /forums/admin.php
Disallow /members/
Disallow /forums/calendar.php*
Disallow /goto/
Disallow /blogs/
Disallow /reviews/
Disallow /mountain-bike-photos/
Disallow /forums/search.php*
Allow /

Other Records

Field Value
sitemap http://www.ridemonkey.com/sitemap.php