Log In Sign Up

skylinecms.co.uk
robots.txt

Robots Exclusion Standard data for skylinecms.co.uk

Resource Scan

Scan Details

Site Domain skylinecms.co.uk
Base Domain skylinecms.co.uk
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-07-20T20:14:26+00:00
Next Scan 2025-08-03T20:14:26+00:00

Last Successful Scan

Scanned2025-06-12T06:03:52+00:00
URL https://www.skylinecms.co.uk/robots.txt
Domain IPs 128.199.57.38, 142.93.38.243
Response IP 128.199.57.38
Found Yes
Hash 9cbeb266e4e655887f1bd6b677bb43a36129f7df06fbfbb14e61323cc73cded9
SimHash 4815d800e390

Groups

googlebot

Rule Path
Disallow /

googlebot
adsbot-google

Rule Path
Disallow /

*

Rule Path
Disallow /
Back to top

Comments

  • Example 1: Block only Googlebot
  • Example 2: Block Googlebot and Adsbot
  • Example 3: Block all crawlers except AdsBot (AdsBot crawlers must be named explicitly)
Back to top