ig.informatikamu.id
robots.txt

Robots Exclusion Standard data for ig.informatikamu.id

Resource Scan

Scan Details

Site Domain ig.informatikamu.id
Base Domain informatikamu.id
Scan Status Ok
Last Scan2025-11-25T02:56:46+00:00
Next Scan 2025-12-25T02:56:46+00:00

Last Scan

Scanned2025-11-25T02:56:46+00:00
URL https://ig.informatikamu.id/robots.txt
Domain IPs 104.21.76.16, 172.67.185.16, 2606:4700:3033::6815:4c10, 2606:4700:3034::ac43:b910
Response IP 172.67.185.16
Found Yes
Hash 3c6d9ed0e227764944bcebfc452b475e23cefc1c4f6ae77262d99cbb376b179a
SimHash 591b9ad1cb11

Groups

*

Rule Path
Allow /
Disallow /member
Disallow /membernew
Disallow /*PageSpeed%3Dnoscript
Disallow /*?PageSpeed=noscript
Disallow /admin/
Disallow /account/

gptbot

Rule Path
Allow /

oai-searchbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

anthropic-ai

Rule Path
Allow /

claudebot

Rule Path
Allow /

claude-web

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

google-extended

Rule Path
Allow /

applebot

Rule Path
Allow /

applebot-extended

Rule Path
Allow /

ccbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://ig.informatikamu.id/sitemap.xml

Comments

  • OpenAI
  • Anthropic
  • Perplexity
  • Google AI (kontrol data untuk Gemini/AI Overviews)
  • Lain-lain populer