ncuk.com
robots.txt

Robots Exclusion Standard data for ncuk.com

Resource Scan

Scan Details

Site Domain ncuk.com
Base Domain ncuk.com
Scan Status Ok
Last Scan2025-12-05T01:36:10+00:00
Next Scan 2026-01-04T01:36:10+00:00

Last Scan

Scanned2025-12-05T01:36:10+00:00
URL https://ncuk.com/robots.txt
Domain IPs 2a02:68:0:1112::, 80.249.96.54
Response IP 80.249.96.54
Found Yes
Hash 5d2758e08e330bc0619462fef88dcb195f258459a9b0aadeffeb72eca294f183
SimHash 581c8d42c2f0

Groups

*

Rule Path
Disallow /payment*
Disallow /terms*
Disallow /legal*

aboutusbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

panopta.com

Rule Path
Disallow /

searchmetrics

Rule Path
Disallow /

lipperhey

Rule Path
Disallow /

dataprovider.com

Rule Path
Disallow /

yandex

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

doubt

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

alexibot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

xenu's

Rule Path
Disallow /

xenu's link sleuth 1.1c

Rule Path
Disallow /