Log In Sign Up

mofar.my.id
robots.txt

Robots Exclusion Standard data for mofar.my.id

Resource Scan

Scan Details

Site Domain mofar.my.id
Base Domain mofar.my.id
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-07-26T10:54:20+00:00
Next Scan 2025-10-24T10:54:20+00:00

Last Successful Scan

Scanned2025-03-29T10:52:40+00:00
URL https://mofar.my.id/robots.txt
Domain IPs 104.21.62.76, 172.67.221.204, 2606:4700:3033::ac43:ddcc, 2606:4700:3034::6815:3e4c
Response IP 172.67.221.204
Found Yes
Hash 8270b44519038d4d2bc26d40a410b88e1c7577f7f41e2307e4a1ecf1ba0a13e7
SimHash b814bd0b4574

Groups

*

Rule Path
Allow /system/resources/
Disallow /config/
Disallow /system/
Disallow /cache/
Disallow /lang/
Disallow /composer.json
Disallow /composer.lock
Disallow /composer.phar
Disallow /admin/
Back to top

Comments

  • robots.txt
  • This file is to prevent the crawling and indexing of certain parts
  • of your site by web crawlers and spiders run by sites like Yahoo!
  • and Google. By telling these "robots" where not to go on your site,
  • you save bandwidth and server resources.
  • This file will be ignored unless it is at the root of your host:
  • Used: http://example.com/robots.txt
  • Ignored: http://example.com/site/robots.txt
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/wc/robots.html
  • For syntax checking, see:
  • http://www.sxw.org.uk/computing/robots/check.html
  • Allow directories
  • Disallow directories
  • Disallow files
  • Disallow paths
Back to top