adelphi.edu
robots.txt

Robots Exclusion Standard data for adelphi.edu

Resource Scan

Scan Details

Site Domain adelphi.edu
Base Domain adelphi.edu
Scan Status Ok
Last Scan2025-11-02T20:08:48+00:00
Next Scan 2025-12-02T20:08:48+00:00

Last Scan

Scanned2025-11-02T20:08:48+00:00
URL https://adelphi.edu/robots.txt
Redirect https://www.adelphi.edu/robots.txt
Redirect Domain www.adelphi.edu
Redirect Base adelphi.edu
Domain IPs 192.147.12.33
Redirect IPs 192.147.12.33
Response IP 192.147.12.33
Found Yes
Hash d1e59d9af4d901f458cae2533b5a604abeb8b5e32f37e70db6eb3b3045e59454
SimHash 6320cc002eb2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

semanticscholarbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.adelphi.edu/sitemap_index.xml