anyang.ac.kr
robots.txt

Robots Exclusion Standard data for anyang.ac.kr

Resource Scan

Scan Details

Site Domain anyang.ac.kr
Base Domain anyang.ac.kr
Scan Status Ok
Last Scan2025-09-16T13:23:11+00:00
Next Scan 2025-10-16T13:23:11+00:00

Last Scan

Scanned2025-09-16T13:23:11+00:00
URL https://www.anyang.ac.kr/robots.txt
Domain IPs 203.249.47.74
Response IP 203.249.47.74
Found Yes
Hash c97257b0a1e0abd59f4239689d15347829a29fa73170646e4297f494a8cc4e40
SimHash e35cc088e442

Groups

*

Rule Path
Disallow /_fox
Disallow /_attach
Disallow /_custom
Disallow /_res

amazonbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

uptimerobot

Rule Path
Disallow /

viberbot

Rule Path
Disallow /

yak

Rule Path
Disallow /

yandex

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

bytespider
bytespider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /