rf-cleaning.co.uk
robots.txt

Robots Exclusion Standard data for rf-cleaning.co.uk

Resource Scan

Scan Details

Site Domain rf-cleaning.co.uk
Base Domain rf-cleaning.co.uk
Scan Status Ok
Last Scan2025-04-01T07:56:39+00:00
Next Scan 2025-05-01T07:56:39+00:00

Last Scan

Scanned2025-04-01T07:56:39+00:00
URL http://rf-cleaning.co.uk/robots.txt
Domain IPs 2001:8d8:100f:f000::271, 217.160.0.106
Response IP 217.160.0.106
Found Yes
Hash d6f297e6feb1900560d37dfd2744cdb3ff87ca038c481160a2c2261feae4d212
SimHash 481c9d706e13

Groups

baiduspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

*

Rule Path
Allow /

Other Records

Field Value
sitemap http://rf-cleaning.co.uk/?feed=xmlsitemap001