vcol.co.uk
robots.txt

Robots Exclusion Standard data for vcol.co.uk

Resource Scan

Scan Details

Site Domain vcol.co.uk
Base Domain vcol.co.uk
Scan Status Ok
Last Scan2026-02-25T12:45:16+00:00
Next Scan 2026-03-27T12:45:16+00:00

Last Scan

Scanned2026-02-25T12:45:16+00:00
URL https://www.vcol.co.uk/robots.txt
Domain IPs 45.60.79.192
Response IP 45.60.79.192
Found Yes
Hash b0ef0c12ee06810ee52c97c9afb3f87798b8e23ce7d84542b87664cdc34f0bb5
SimHash 400ede0047a3

Groups

*

Rule Path
Disallow /
Allow /home/default.vco
Allow /home/login.vco
Allow /home/about-vco.vco
Allow /home/new-features.vco
Allow /home/help-and-support.vco

alexibot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

xenu's

Rule Path
Disallow /

sogou

Rule Path
Disallow /

seokicks-robots

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

bingbot

Rule Path
Disallow /
Allow /home/default.vco
Allow /home/login.vco
Allow /home/about-vco.vco
Allow /home/new-features.vco
Allow /home/help-and-support.vco

Other Records

Field Value
crawl-delay 5

slurp

Rule Path
Disallow /
Allow /home/default.vco
Allow /home/login.vco
Allow /home/about-vco.vco
Allow /home/new-features.vco
Allow /home/help-and-support.vco

Other Records

Field Value
crawl-delay 10

duckduckbot

Rule Path
Disallow /
Allow /home/default.vco
Allow /home/login.vco
Allow /home/about-vco.vco
Allow /home/new-features.vco
Allow /home/help-and-support.vco

Other Records

Field Value
crawl-delay 20

ia_archiver

Rule Path
Disallow /
Allow /home/default.vco
Allow /home/login.vco
Allow /home/about-vco.vco
Allow /home/new-features.vco
Allow /home/help-and-support.vco

Other Records

Field Value
crawl-delay 20

Comments

  • VF Robots.txt for https://www.vcol.co.uk
  • Block specific path for all crawlers
  • Block not wanted search engines
  • Specify Crawl Delay for minor search engines