alvin-portal.org
robots.txt

Robots Exclusion Standard data for alvin-portal.org

Resource Scan

Scan Details

Site Domain alvin-portal.org
Base Domain alvin-portal.org
Scan Status Ok
Last Scan3/14/2025, 7:39:52 PM
Next Scan 4/13/2025, 7:39:52 PM

Last Scan

Scanned3/14/2025, 7:39:52 PM
URL https://www.alvin-portal.org/robots.txt
Domain IPs 130.238.7.118
Response IP 130.238.7.118
Found Yes
Hash 57a743e064a3faeff7cca85dc19c5cc8fdff99a963ef4e645c303d092738cb1c
SimHash 6289c8406699

Groups

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

coccoc

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

riddler

Rule Path
Disallow /

msnbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

semanticscholarbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 30

cludo

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /webstats/
Disallow /alvin/imageViewer.jsf
Disallow /iipsrv/
Disallow /alvin/security/