Log In Sign Up

springboks.rugby
robots.txt

Robots Exclusion Standard data for springboks.rugby

Resource Scan

Scan Details

Site Domain springboks.rugby
Base Domain springboks.rugby
Scan Status Ok
Last Scan2025-07-15T11:14:41+00:00
Next Scan 2025-08-14T11:14:41+00:00

Last Scan

Scanned2025-07-15T11:14:41+00:00
URL https://springboks.rugby/robots.txt
Domain IPs 52.174.181.178
Response IP 52.174.181.178
Found Yes
Hash 563be15a909d3fde5abe715fa75c535657dc6a12b5c160e5aaa7755337255540
SimHash 3a1251472d31

Groups

*

Rule Path
Disallow /bin/
Disallow /config/
Disallow /umbraco/
Disallow /views/
Back to top

Other Records

Field Value
sitemap https://www.sarugby.co.za/sitemap
Back to top

Comments

  • To add a comment to the file, start the line with the # character.
  • User-Agent is used to target a particular web crawler.
  • Any rules declared below it will apply to that User-Agent.
  • To hide a file or folder from the User-Agent, type the word 'Disallow' followed by a semi-colon.
Back to top