www2.naz.edu
robots.txt

Robots Exclusion Standard data for www2.naz.edu

Resource Scan

Scan Details

Site Domain www2.naz.edu
Base Domain naz.edu
Scan Status Ok
Last Scan2024-09-19T18:18:45+00:00
Next Scan 2024-10-19T18:18:45+00:00

Last Scan

Scanned2024-09-19T18:18:45+00:00
URL https://www2.naz.edu/robots.txt
Domain IPs 204.128.145.15
Response IP 204.128.145.15
Found Yes
Hash 40f5fb4a825c423140dc82a700805d9a64c91e0cbc420babb5a10399b39d8762
SimHash 401078d06d55

Groups

*

Rule Path
Disallow /config
Disallow /controllers
Disallow /elements
Disallow /helpers
Disallow /jobs
Disallow /languages
Disallow /libraries
Disallow /mail
Disallow /models
Disallow /single_pages
Disallow /themes
Disallow /tools
Disallow /updates
Disallow /auth
Disallow /login

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Disallow /blocks
Disallow /concrete
Allow /concrete/css/
Allow /concrete/js/
Allow /concrete/blocks/rss_displayer/
Disallow /config
Disallow /controllers
Disallow /css
Disallow /elements
Disallow /helpers
Disallow /jobs
Disallow /js
Disallow /languages
Disallow /libraries
Disallow /mail
Disallow /models
Disallow /auth
Disallow /login

rogerbot

Rule Path
Disallow /events

Other Records

Field Value
crawl-delay 10