register.fca.org.uk
robots.txt

Robots Exclusion Standard data for register.fca.org.uk

Resource Scan

Scan Details

Site Domain register.fca.org.uk
Base Domain fca.org.uk
Scan Status Ok
Last Scan2024-09-23T21:00:36+00:00
Next Scan 2024-10-07T21:00:36+00:00

Last Scan

Scanned2024-09-23T21:00:36+00:00
URL https://register.fca.org.uk/robots.txt
Domain IPs 104.17.106.103, 104.17.107.103
Response IP 104.17.106.103
Found Yes
Hash c3a7c2f8423a719a395866d5db556ba840f3684c6199d65aa58181a2e266a8f5
SimHash 6740db2d4db1

Groups

*

Product Comment
* applies to all robots
Rule Path Comment
Allow / allow all
Disallow */secur/forgotpassword.jsp?* -

Other Records

Field Value
sitemap https://register.fca.org.uk/BenchmarksRegister/s/sitemap.xml
sitemap https://register.fca.org.uk/Developer/s/sitemap.xml
sitemap https://register.fca.org.uk/directory/s/sitemap.xml
sitemap https://register.fca.org.uk/s/sitemap.xml

Comments

  • default robots.txt for sfdc communities sites
  • For use by salesforce.com