Log In Sign Up

localitydetails.com
robots.txt

Robots Exclusion Standard data for localitydetails.com

Resource Scan

Scan Details

Site Domain localitydetails.com
Base Domain localitydetails.com
Scan Status Ok
Last Scan2024-11-02T20:38:52+00:00
Next Scan 2024-11-09T20:38:52+00:00

Last Scan

Scanned2024-11-02T20:38:52+00:00
URL https://localitydetails.com/robots.txt
Domain IPs 20.235.139.53
Response IP 20.235.139.53
Found Yes
Hash 2d5bee268f946e3dfd92c2643d2b18b9d2b0168096f1d7ad56eb54be61bc65b9
SimHash 4951438246a1

Groups

adsbot-google

Rule Path
Allow /
Disallow /*?

alexabot

Rule Path
Allow /
Disallow /*?

qwantify

Rule Path
Disallow /

architextspider

Rule Path
Allow /
Disallow /*?

bender

Rule Path
Allow /
Disallow /*?

bingbot

Rule Path
Allow /
Disallow /*?

birubot

Rule Path
Allow /
Disallow /*?

blogpulselive

Rule Path
Allow /
Disallow /*?

coccoc

Rule Path
Allow /
Disallow /*?

daumoa

Rule Path
Allow /
Disallow /*?

duckduckbot

Rule Path
Allow /
Disallow /*?

fast

Rule Path
Allow /
Disallow /*?

feedfetcher-google

Rule Path
Allow /
Disallow /*?

googlebot

Rule Path
Allow /
Disallow /*?

googlebot-image

Rule Path
Allow /
Disallow /*?

googlebot-mobile

Rule Path
Allow /
Disallow /*?

googlebot-smartphone

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

gulliver

Rule Path
Allow /

ia_archiver

Rule Path
Allow /

iisbot

Rule Path
Allow /

jikespider

Rule Path
Allow /

lycos_spider_(t-rex)

Rule Path
Allow /

mail.ru_bot

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

msnbot

Rule Path
Allow /

msnbot-media

Rule Path
Allow /

msnptc

Rule Path
Allow /

naverbot

Rule Path
Allow /

nutch

Rule Path
Allow /

quickobot

Rule Path
Allow /

rogerbot

Rule Path
Allow /

scooter

Rule Path
Allow /

seznambot

Rule Path
Allow /

semrushbot

Rule Path
Disallow /

slurp

Rule Path
Allow /

stackrambler

Rule Path
Allow /

surveybot

Rule Path
Allow /

teoma

Rule Path
Allow /

twitterbot/1.0

Rule Path
Allow /

vscooter

Rule Path
Allow /

yandex

Rule Path
Disallow /

trovitbot

Rule Path
Allow /

yeti

Rule Path
Allow /

zyborg

Rule Path
Allow /

ahrefssiteaudit

Rule Path
Allow /

googlebot
googlebot-mobile

Rule Path Comment
Disallow /*? -
Disallow *?* -
Disallow * *
Back to top