ford-quote.uk
robots.txt

Robots Exclusion Standard data for ford-quote.uk

Resource Scan

Scan Details

Site Domain ford-quote.uk
Base Domain ford-quote.uk
Scan Status Ok
Last Scan2024-09-19T14:33:39+00:00
Next Scan 2024-09-26T14:33:39+00:00

Last Scan

Scanned2024-09-19T14:33:39+00:00
URL https://ford-quote.uk/robots.txt
Domain IPs 46.101.66.178, 67.207.69.172
Response IP 46.101.66.178
Found Yes
Hash be68005b974c4df1a2bbdf54175832142ecc8f805856d0a4a44c663ae1f96838
SimHash 601cd4006295

Groups

dirbuster

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

slurp

Rule Path
Disallow

Other Records

Field Value
crawl-delay 30

yandex

Rule Path
Disallow

Other Records

Field Value
crawl-delay 30

bingbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

msnbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /*?*Filters=1
Disallow /newcar/companycar/editor/
Disallow /newcar/companycar/editor_old/
Disallow