partsgateway.co.uk
robots.txt

Robots Exclusion Standard data for partsgateway.co.uk

Resource Scan

Scan Details

Site Domain partsgateway.co.uk
Base Domain partsgateway.co.uk
Scan Status Ok
Last Scan2024-09-23T06:36:22+00:00
Next Scan 2024-09-30T06:36:22+00:00

Last Scan

Scanned2024-09-23T06:36:22+00:00
URL https://partsgateway.co.uk/robots.txt
Redirect https://www.partsgateway.co.uk/robots.txt
Redirect Domain www.partsgateway.co.uk
Redirect Base partsgateway.co.uk
Domain IPs 185.162.227.94
Redirect IPs 185.162.227.94
Response IP 185.162.227.94
Found Yes
Hash e01d695ab9b6069548d84e82c72cbfd1808c8c10d658c127e5fd2366c9172fc0
SimHash bc5d12206eb1

Groups

*

Rule Path
Disallow /presults
Disallow /pgadmin
Disallow /ajax
Disallow /myp
Disallow /dm
Disallow /dm-new

urlmetrics

Rule Path
Disallow /

updownerbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot;

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.partsgateway.co.uk/sitemapindex.xml