Log In Sign Up

marbee.info
robots.txt

Robots Exclusion Standard data for marbee.info

Resource Scan

Scan Details

Site Domain marbee.info
Base Domain marbee.info
Scan Status Ok
Last Scan2025-10-31T18:38:39+00:00
Next Scan 2025-11-07T18:38:39+00:00

Last Scan

Scanned2025-10-31T18:38:39+00:00
URL https://marbee.info/robots.txt
Domain IPs 162.43.94.149
Response IP 162.43.94.149
Found Yes
Hash f63a98b4a3ea0472f26a0df48f2d607a99c2be01746eac8ec3172777052b88b6
SimHash a10454820771

Groups

twitterbot

Rule Path
Disallow *
Allow /wp-content/uploads/
Allow /gundamconquest/wp-content/uploads/
Allow /playstation/wp-content/uploads/
Back to top

Other Records

Field Value
sitemap http://www.marbee.info/sitemap.xml
Back to top

Comments

  • User-agent: Mediapartners-Google
  • Disallow:
  • User-agent: *
  • Disallow: /wp-admin
  • Disallow: /wp-includes
  • Disallow: /comments
  • Disallow: */trackback
  • Disallow: */comments
  • Disallow: /author
  • Disallow: /tag
  • Disallow: /mod_pagespeed_beacon
  • Disallow: /*?*
  • Disallow: /*?
  • Disallow: /*.php$
  • Disallow: /*.inc$
  • Disallow: /*.gz$
  • Disallow: /*.wmv$
  • Disallow: /*.cgi$
  • Disallow: /*.xhtml$
  • allow Twitter bot on entire site
  • BEGIN XML-SITEMAP-PLUGIN
  • END XML-SITEMAP-PLUGIN
Back to top