mx.elabogado.com
robots.txt

Robots Exclusion Standard data for mx.elabogado.com

Resource Scan

Scan Details

Site Domain mx.elabogado.com
Base Domain elabogado.com
Scan Status Ok
Last Scan2024-09-24T01:46:57+00:00
Next Scan 2024-10-24T01:46:57+00:00

Last Scan

Scanned2024-09-24T01:46:57+00:00
URL https://mx.elabogado.com/robots.txt
Domain IPs 104.21.66.130, 172.67.204.18, 2606:4700:3034::ac43:cc12, 2606:4700:3036::6815:4282
Response IP 104.21.66.130
Found Yes
Hash 2347a3ca8aea0a6e3dcb76703c627ec2299bc28262f81b07f8401f9ca348ccbf
SimHash cf5d1d01e55a

Groups

sogou web spider

Rule Path
Disallow /

sogou inst spider

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

crawl

Rule Path
Disallow /

spider

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

bitlybot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /session/sessionResolver
Disallow /message/*
Disallow /opinar/*
Disallow /login/*

Other Records

Field Value
crawl-delay 5

yandexbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

ahrefsbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Disallow /session/sessionResolver
Disallow /message/create/phone
Disallow /message/send/*
Disallow /message/tracingContacted/*
Disallow /opinar/*
Disallow /login/*
Disallow /preferences/preferences_edit
Disallow /message/create/*

adsbot-google

Rule Path
Disallow /session/sessionResolver
Disallow /message/*
Disallow /opinar/*
Disallow /login/*

googlebot-image

Rule Path
Disallow /session/sessionResolver
Disallow /message/*
Disallow /opinar/*
Disallow /login/*

facebookexternalhit

Rule Path
Disallow /message/*
Disallow /opinar/*
Disallow /login/*

*

Rule Path
Disallow /session/sessionResolver
Disallow /message/create/phone
Disallow /message/create/form
Disallow /message/send/*
Disallow /message/tracingContacted/*
Disallow /opinar/*
Disallow /login/*