ukprodiagnostics.co.uk
robots.txt

Robots Exclusion Standard data for ukprodiagnostics.co.uk

Resource Scan

Scan Details

Site Domain ukprodiagnostics.co.uk
Base Domain ukprodiagnostics.co.uk
Scan Status Ok
Last Scan2024-09-30T12:25:09+00:00
Next Scan 2024-10-30T12:25:09+00:00

Last Scan

Scanned2024-09-30T12:25:09+00:00
URL http://ukprodiagnostics.co.uk/robots.txt
Domain IPs 5.57.59.183
Response IP 5.57.59.183
Found Yes
Hash 1eae2057a0a27dbbac0e138f82a5898550b84504ac15d2e2e990170c220717fe
SimHash 4b565f227aa1

Groups

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

yandexbot/3.0

Rule Path
Disallow /

blexbot/1.0

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

*

Rule Path
Disallow /pages/health_advice*
Disallow /pages/health_az*
Disallow /pages/health_news*
Disallow /pages/az_health_directory*
Disallow /health_advice*
Disallow /health_az*
Disallow /health_news*
Disallow /az_health_directory*
Disallow /pages/health-advice*
Disallow /pages/health-az*
Disallow /pages/health-news*
Disallow /pages/az-health-directory*
Disallow /health-advice*
Disallow /health-az*
Disallow /health-news*
Disallow /az-health-directory*
Disallow /pages/health-directory*
Disallow /health-directory*
Disallow /pages/health_directory*
Disallow /health_directory*
Disallow /pages/az_health_advice*
Disallow /az_health_advice*
Disallow /pages/members*
Disallow /members*
Disallow /az_health*
Disallow /pages/az_health*