akamai.university
robots.txt

Robots Exclusion Standard data for akamai.university

Resource Scan

Scan Details

Site Domain akamai.university
Base Domain akamai.university
Scan Status Ok
Last Scan2025-05-22T18:42:32+00:00
Next Scan 2025-06-21T18:42:32+00:00

Last Scan

Scanned2025-05-22T18:42:32+00:00
URL https://akamai.university/robots.txt
Redirect https://www.akamai.university/robots.txt
Redirect Domain www.akamai.university
Redirect Base akamai.university
Domain IPs 199.34.228.47
Redirect IPs 199.34.228.47
Response IP 199.34.228.47
Found Yes
Hash a34f319953c0f038edf05a7f8b9897b277be649b6547fb0c8bb22af319b4d22b
SimHash 6a44dc742793

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /document-review.html

Other Records

Field Value
sitemap https://www.akamai.university/sitemap.xml