Log In Sign Up

maddevelopment.com
robots.txt

Robots Exclusion Standard data for maddevelopment.com

Resource Scan

Scan Details

Site Domain maddevelopment.com
Base Domain maddevelopment.com
Scan Status Ok
Last Scan2024-09-09T19:36:47+00:00
Next Scan 2024-10-09T19:36:47+00:00

Last Scan

Scanned2024-09-09T19:36:47+00:00
URL https://maddevelopment.com/robots.txt
Domain IPs 206.83.154.209
Response IP 206.83.154.209
Found Yes
Hash 62786fcef663ded85e2a9ea893e5d5b5584e4fb5fda3ccd78ce73e0ca77f01cd
SimHash 3a1271476d31

Groups

*

Rule Path
Disallow /bin/
Disallow /config/
Disallow /umbraco/
Disallow /views/
Disallow /shared-content/
Back to top

Comments

  • To add a comment to the file, start the line with the # character.
  • User-Agent is used to target a particular web crawler.
  • Any rules declared below it will apply to that User-Agent.
  • To hide a file or folder from the User-Agent, type the word 'Disallow' followed by a semi-colon.
Back to top