saru-umbraco.azurewebsites.net
robots.txt

Robots Exclusion Standard data for saru-umbraco.azurewebsites.net

Resource Scan

Scan Details

Site Domain saru-umbraco.azurewebsites.net
Base Domain saru-umbraco.azurewebsites.net
Scan Status Ok
Last Scan2025-07-18T17:23:50+00:00
Next Scan 2025-08-17T17:23:50+00:00

Last Scan

Scanned2025-07-18T17:23:50+00:00
URL https://saru-umbraco.azurewebsites.net/robots.txt
Domain IPs 52.174.181.178
Response IP 52.174.181.178
Found Yes
Hash 563be15a909d3fde5abe715fa75c535657dc6a12b5c160e5aaa7755337255540
SimHash 3a1251472d31

Groups

*

Rule Path
Disallow /bin/
Disallow /config/
Disallow /umbraco/
Disallow /views/

Other Records

Field Value
sitemap https://www.sarugby.co.za/sitemap

Comments

  • To add a comment to the file, start the line with the # character.
  • User-Agent is used to target a particular web crawler.
  • Any rules declared below it will apply to that User-Agent.
  • To hide a file or folder from the User-Agent, type the word 'Disallow' followed by a semi-colon.