silabus.web.id
robots.txt

Robots Exclusion Standard data for silabus.web.id

Resource Scan

Scan Details

Site Domain silabus.web.id
Base Domain silabus.web.id
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-08-12T12:37:41+00:00
Next Scan 2025-10-11T12:37:41+00:00

Last Successful Scan

Scanned2025-06-14T12:36:12+00:00
URL https://silabus.web.id/robots.txt
Redirect https://www.silabus.web.id/robots.txt
Redirect Domain www.silabus.web.id
Redirect Base silabus.web.id
Domain IPs 45.126.43.5
Redirect IPs 45.126.43.5
Response IP 45.126.43.5
Found Yes
Hash 0353803f535e87a6025ea134527b8d6f4348a8781aa63095457e3198d19a4ef3
SimHash 780048708a30

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

openai

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

youbot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.silabus.web.id/sitemap.xml