researcher.manipal.edu
robots.txt

Robots Exclusion Standard data for researcher.manipal.edu

Resource Scan

Scan Details

Site Domain researcher.manipal.edu
Base Domain manipal.edu
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-03-25T15:30:31+00:00
Next Scan 2025-05-24T15:30:31+00:00

Last Successful Scan

Scanned2025-01-02T15:18:55+00:00
URL https://researcher.manipal.edu/robots.txt
Domain IPs 104.18.39.240, 172.64.148.16
Response IP 104.18.39.240
Found Yes
Hash a2e5ba207322009e5e8852885adc8371941e7698c1fdef016beef4b440a47079
SimHash eb1c1820a373

Groups

*

Rule Path
Disallow /*?*format=rss
Disallow /*?*export=xls

Other Records

Field Value
crawl-delay 5

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://researcher.manipal.edu/sitemap.xml