digitalnow.co.uk
robots.txt

Robots Exclusion Standard data for digitalnow.co.uk

Resource Scan

Scan Details

Site Domain digitalnow.co.uk
Base Domain digitalnow.co.uk
Scan Status Ok
Last Scan2024-09-26T01:06:24+00:00
Next Scan 2024-10-26T01:06:24+00:00

Last Scan

Scanned2024-09-26T01:06:24+00:00
URL https://digitalnow.co.uk/robots.txt
Domain IPs 185.151.30.131, 2a07:7800::131
Response IP 185.151.30.131
Found Yes
Hash 23970619f99456c3f99ac72ad43045ce2ac198f97a2af2bf44b2cc4dd41dde17
SimHash 884942502b31

Groups

scrapy

Rule Path
Allow /

googlebot

Rule Path
Disallow /sites/
Allow *.css*
Allow *.js*

*

Rule Path
Disallow /sites/
Disallow /account/
Disallow /wp-admin/
Disallow /wp-includes/
Allow /wp-includes/js/
Allow /wp-content/plugins/
Allow /wp-content/themes/
Allow /wp-content/cache/
Disallow /xmlrpc.php

Comments

  • Googlebot
  • Global