Log In Sign Up

hikingbook.net
robots.txt

Robots Exclusion Standard data for hikingbook.net

Resource Scan

Scan Details

Site Domain hikingbook.net
Base Domain hikingbook.net
Scan Status Ok
Last Scan2024-10-31T13:25:34+00:00
Next Scan 2024-11-07T13:25:34+00:00

Last Scan

Scanned2024-10-31T13:25:34+00:00
URL https://hikingbook.net/robots.txt
Domain IPs 104.21.15.22, 172.67.161.11, 2606:4700:3035::ac43:a10b, 2606:4700:3036::6815:f16
Response IP 172.67.161.11
Found Yes
Hash f799f135f376665c28374827a75d7073ea3506eb57a7ed889ca326974950dbd5
SimHash 3a1149526da1

Groups

*

Rule Path
Disallow /admins
Disallow /routes/
Disallow /hikes/*/download
Disallow /search/
Disallow /cdn-cgi/

semrushbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

butterfly

Rule Path
Disallow /

exabot

Rule Path
Disallow /

ginxbot

Rule Path
Disallow /

metauri

Rule Path
Disallow /

postrank

Rule Path
Disallow /

scoutjet

Rule Path
Disallow /

thingfetcher

Rule Path
Disallow /

tweetmemebot

Rule Path
Disallow /

tagoobot

Rule Path
Disallow /

mxbot

Rule Path
Disallow /

twitturls

Rule Path
Disallow /

radian6

Rule Path
Disallow /

viralheat

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

twingly recon

Rule Path
Disallow /

moreoverbot

Rule Path
Disallow /

purebot

Rule Path
Disallow /

twitturly

Rule Path
Disallow /

oneriot

Rule Path
Disallow /

feedtrace

Rule Path
Disallow /

fairshare

Rule Path
Disallow /

njuicebot

Rule Path
Disallow /

semiocast

Rule Path
Disallow /

typhoeus

Rule Path
Disallow /

my6sense

Rule Path
Disallow /

twitmatic

Rule Path
Disallow /

blogpulselive

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

discobot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

tweetedtimes bot

Rule Path
Disallow /

nhn corp

Rule Path
Disallow /

bender

Rule Path
Disallow /

proximic

Rule Path
Disallow /

netseer

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

birubot

Rule Path
Disallow /

showyoubot

Rule Path
Disallow /

suggybot

Rule Path
Disallow /

botw spider

Rule Path
Disallow /

summify

Rule Path
Disallow /

tanner

Rule Path
Disallow /

gosospider

Rule Path
Disallow /

expo9

Rule Path
Disallow /

nutch

Rule Path
Disallow /

crowsnest

Rule Path
Disallow /

docomo

Rule Path
Disallow /

percbotspider

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

knowaboutbot

Rule Path
Disallow /

atomic_email_hunter

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://hikingbook.net/sitemaps/sitemap.xml.gz
Back to top