money.co.uk
robots.txt

Robots Exclusion Standard data for money.co.uk

Resource Scan

Scan Details

Site Domain money.co.uk
Base Domain money.co.uk
Scan Status Ok
Last Scan2024-10-19T14:55:11+00:00
Next Scan 2024-11-18T14:55:11+00:00

Last Scan

Scanned2024-10-19T14:55:11+00:00
URL https://money.co.uk/robots.txt
Redirect https://www.money.co.uk/robots.txt
Redirect Domain www.money.co.uk
Redirect Base money.co.uk
Domain IPs 151.101.130.132, 151.101.194.132, 151.101.2.132, 151.101.66.132
Redirect IPs 151.101.130.132, 151.101.194.132, 151.101.2.132, 151.101.66.132
Response IP 199.232.46.132
Found Yes
Hash 7519c71a6b1e5bff492d1d6dfca86c3d2dac63466bd9e9754a881091f434df9f
SimHash e8088451825a

Groups

*

Rule Path
Disallow /clk/*
Disallow /banner.htm
Disallow /search.htm
Disallow /guides-results.htm
Disallow /answers-results.htm
Disallow /discuss-results.htm
Disallow /reviews-results.htm
Disallow /articles-results.htm
Disallow /press-results.htm
Disallow /blogs-results.htm
Disallow /companies/Norton-Finance.htm
Disallow /loans/loan-lenders/Norton-Finance-Loan.htm
Disallow /loans/loan-details/Norton-Finance/Secured-Loan.htm
Disallow /branch/
Disallow /provider-product-preview.htm

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

rogerbot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.money.co.uk/sitemap.xml