Log In Sign Up

ijcert.org
robots.txt

Robots Exclusion Standard data for ijcert.org

Resource Scan

Scan Details

Site Domain ijcert.org
Base Domain ijcert.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-28T08:19:07+00:00
Next Scan 2025-09-27T08:19:07+00:00

Last Successful Scan

Scanned2025-07-30T08:07:24+00:00
URL https://ijcert.org/robots.txt
Redirect https://www.ijcert.org/robots.txt
Redirect Domain www.ijcert.org
Redirect Base ijcert.org
Domain IPs 103.149.68.57
Redirect IPs 103.149.68.57
Response IP 103.149.68.57
Found Yes
Hash b6bb69f4127fd11fc1754727fe6b975dcd9e8408b905857c26fd3ef5f582bf41
SimHash 0c11cd314771

Groups

*

Rule Path
Allow /

googlebot

Rule Path
Allow /issue/
Allow /article/
Back to top

Comments

  • Allow all search engine crawlers to crawl all content
  • Specifically allow crawling of "/issue/" and "/article/" URLs for Googlebot (optional)
  • Disallow any other directives you might have (optional)
  • Disallow: /admin/
  • Disallow: /images/private/
  • Comments (ignored by search engines)
  • This is a comment to explain the purpose of allowing all search engines to crawl "/"
Back to top