localmint.com
robots.txt

Robots Exclusion Standard data for localmint.com

Resource Scan

Scan Details

Site Domain localmint.com
Base Domain localmint.com
Scan Status Ok
Last Scan2024-05-09T16:45:37+00:00
Next Scan 2024-05-16T16:45:37+00:00

Last Scan

Scanned2024-05-09T16:45:37+00:00
URL https://localmint.com/robots.txt
Redirect https://www.localmint.com/robots.txt
Redirect Domain www.localmint.com
Redirect Base localmint.com
Domain IPs 15.197.142.173, 20.107.224.4, 3.33.152.147
Redirect IPs 20.107.224.4
Response IP 20.107.224.4
Found Yes
Hash f14bbc07575e243cd4e757c9059c830e820f50fe58e7625a11a852f7e44ca351
SimHash 407c58c16571

Groups

*

Rule Path
Disallow /store/
Disallow /__utm.gif
Disallow /home/editbusiness
Disallow /home/reportproblem
Disallow /search/

googlebot
bingbot

Rule Path
Disallow

baiduspider

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

genieo

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

netseer

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

plukkie

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

httrack

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

criteobot/0.1

Rule Path
Disallow /

Comments

  • check here for use of robots txt
  • http://support.google.com/webmasters/bin/answer.py?hl=en&answer=1061943