montclair.edu
robots.txt
Robots Exclusion Standard data for montclair.edu
Resource Scan
Scan Details
Site Domain | montclair.edu |
Base Domain | montclair.edu |
Scan Status | Ok |
Last Scan | 2024-10-25T17:22:40+00:00 |
Next Scan | 2024-11-24T17:22:40+00:00 |
Last Scan
Scanned | 2024-10-25T17:22:40+00:00 |
URL | https://montclair.edu/robots.txt |
Redirect | https://www.montclair.edu/robots.txt |
Redirect Domain | www.montclair.edu |
Redirect Base | montclair.edu |
Domain IPs | 130.68.5.22 |
Redirect IPs | 130.68.5.22 |
Response IP | 130.68.5.22 |
Found | Yes |
Hash | b0a43862eb934f9a625d35aa7a9f2d1a4c3954e695ce642ecec60bb561c3dc68 |
SimHash | d8040484b312 |
Groups
*
Rule | Path |
---|---|
Disallow | /csam-new/ |
Disallow | /wp-admin/* |
Disallow | /catalog/* |
Disallow | /media/* |