diagnostic-world.com
robots.txt

Robots Exclusion Standard data for diagnostic-world.com

Resource Scan

Scan Details

Site Domain diagnostic-world.com
Base Domain diagnostic-world.com
Scan Status Ok
Last Scan2024-09-22T23:36:08+00:00
Next Scan 2024-10-22T23:36:08+00:00

Last Scan

Scanned2024-09-22T23:36:08+00:00
URL https://diagnostic-world.com/robots.txt
Domain IPs 5.57.59.183
Response IP 5.57.59.183
Found Yes
Hash 1eae2057a0a27dbbac0e138f82a5898550b84504ac15d2e2e990170c220717fe
SimHash 4b565f227aa1

Groups

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

yandexbot/3.0

Rule Path
Disallow /

blexbot/1.0

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

*

Rule Path
Disallow /pages/health_advice*
Disallow /pages/health_az*
Disallow /pages/health_news*
Disallow /pages/az_health_directory*
Disallow /health_advice*
Disallow /health_az*
Disallow /health_news*
Disallow /az_health_directory*
Disallow /pages/health-advice*
Disallow /pages/health-az*
Disallow /pages/health-news*
Disallow /pages/az-health-directory*
Disallow /health-advice*
Disallow /health-az*
Disallow /health-news*
Disallow /az-health-directory*
Disallow /pages/health-directory*
Disallow /health-directory*
Disallow /pages/health_directory*
Disallow /health_directory*
Disallow /pages/az_health_advice*
Disallow /az_health_advice*
Disallow /pages/members*
Disallow /members*
Disallow /az_health*
Disallow /pages/az_health*