artificiallawn.co.uk
robots.txt

Robots Exclusion Standard data for artificiallawn.co.uk

Resource Scan

Scan Details

Site Domain artificiallawn.co.uk
Base Domain artificiallawn.co.uk
Scan Status Ok
Last Scan2024-04-26T23:39:29+00:00
Next Scan 2024-05-26T23:39:29+00:00

Last Scan

Scanned2024-04-26T23:39:29+00:00
URL https://artificiallawn.co.uk/robots.txt
Redirect https://www.artificiallawn.co.uk/robots.txt
Redirect Domain www.artificiallawn.co.uk
Redirect Base artificiallawn.co.uk
Domain IPs 104.21.49.130, 172.67.163.47, 2606:4700:3030::ac43:a32f, 2606:4700:3034::6815:3182
Redirect IPs 104.21.49.130, 172.67.163.47, 2606:4700:3030::ac43:a32f, 2606:4700:3034::6815:3182
Response IP 172.67.163.47
Found Yes
Hash 8d0b507d6fcf2a73b76e1368c15364ccc06574a3734afd0daa95419edc2d4390
SimHash 8b0c58bac2d1

Groups

*

Rule Path
Allow /
Allow /case-studies/?keyword=&category=9&sort=
Allow /case-studies/?keyword=&category=10&sort=
Allow /case-studies/?keyword=&category=11&sort=
Disallow /account/
Disallow /cart/
Disallow /enquiry-thank-you/
Disallow /qoute-thank-you/
Disallow /widgets/?*
Disallow /subscribe-thankyou/
Disallow *keyword%3D
Disallow *rpp%3D
Disallow *sort%3D
Disallow *category%3D
Disallow *tag%3D
Disallow *q%3D
Disallow *year%3D
Disallow *letter%3D
Disallow *cateogry_id%3D
Disallow /sitemap/

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.artificiallawn.co.uk/sitemap.xml