edu.web.nhk
robots.txt

Robots Exclusion Standard data for edu.web.nhk

Resource Scan

Scan Details

Site Domain edu.web.nhk
Base Domain web.nhk
Scan Status Ok
Last Scan2025-11-26T00:09:17+00:00
Next Scan 2025-12-10T00:09:17+00:00

Last Scan

Scanned2025-11-26T00:09:17+00:00
URL https://edu.web.nhk/robots.txt
Domain IPs 23.49.60.50, 23.49.60.64, 2600:1413:5000:3::1736:7688, 2600:1413:5000:3::1736:7692
Response IP 23.54.155.100
Found Yes
Hash 284fd2f84d4787ab62b2f7bd49eaada2be1e1604c667b7c79c9b2ea87ec145be
SimHash 1114794780d7

Groups

gptbot
chatgpt-user
claudebot
google-extended
applebot-extended
anthropic-ai
cohere-ai
ccbot
icc-crawler
bytespider
oai-searchbot
perplexitybot
meta-externalagent
perplexity-ai
perplexity-user

Rule Path
Disallow /

Other Records

Field Value
sitemap https://edu.web.nhk/sitemap.xml