aub.edu.lb
robots.txt
Robots Exclusion Standard data for aub.edu.lb
Resource Scan
Scan Details
Site Domain | aub.edu.lb |
Base Domain | aub.edu.lb |
Scan Status | Ok |
Last Scan | 2024-09-13T13:20:19+00:00 |
Next Scan | 2024-10-13T13:20:19+00:00 |
Last Scan
Scanned | 2024-09-13T13:20:19+00:00 |
URL | https://aub.edu.lb/robots.txt |
Domain IPs | 40.127.138.74 |
Response IP | 40.127.138.74 |
Found | Yes |
Hash | 7cb51f8b292fa5c7c1e9e36f9ceebb188dac13db78ed74e2276d934e50ebbb18 |
SimHash | 095ccc48c591 |
Groups
*
Rule | Path |
---|---|
Disallow | /_catalogs/ |
Disallow | /_layouts/ |
Disallow | /search/ |
Disallow | /register/ |
Disallow | /*?*%2F |
Other Records
Field | Value |
---|---|
sitemap | https://www.aub.edu.lb/sitemap.xml |