Log In Sign Up

monaia.com
robots.txt

Robots Exclusion Standard data for monaia.com

Resource Scan

Scan Details

Site Domain monaia.com
Base Domain monaia.com
Scan Status Ok
Last Scan2024-06-10T13:17:28+00:00
Next Scan 2024-07-10T13:17:28+00:00

Last Scan

Scanned2024-06-10T13:17:28+00:00
URL https://monaia.com/robots.txt
Domain IPs 208.109.73.131
Response IP 208.109.73.131
Found Yes
Hash ae8838dca5c66530803fcce305c7ff83bdf8fe200f75cecf05ad123843f1a209
SimHash 4d60d3b753b6

Groups

googlebot
googlebot-mobile
adsbot-google
googlebot-image
mediapartners
mediapartners-google
googlebot-news
googlebot-video

Rule Path
Allow /
Disallow /cgi-bin/
Disallow /wp-admin/$
Disallow /author/admin/
Disallow /wp-content/cache*
Disallow */trackback/$
Disallow /comments/feed*
Disallow /wp-login.php?*
Disallow *?comments=
Disallow *?replytocom
Disallow *?s=
Disallow */feed
Disallow */page/
Disallow */tag/
Allow /*.js*
Allow /*.css*
Allow /wp-admin/admin-ajax.php
Allow /wp-admin/admin-ajax.php?action=*

slurp

Rule Path
Allow /
Disallow /cgi-bin/
Disallow /wp-admin/$
Disallow /author/admin/
Disallow /wp-content/cache*
Disallow */trackback/$
Disallow /comments/feed*
Disallow /wp-login.php?*
Disallow *?comments=
Disallow *?replytocom
Disallow *?s=
Disallow */feed
Disallow */page/
Disallow */tag/
Allow /*.js*
Allow /*.css*
Allow /wp-admin/admin-ajax.php
Allow /wp-admin/admin-ajax.php?action=*

Other Records

Field Value
crawl-delay 10

bingbot

Rule Path
Allow /
Disallow /cgi-bin/
Disallow /wp-admin/$
Disallow /author/admin/
Disallow /wp-content/cache*
Disallow */trackback/$
Disallow /comments/feed*
Disallow /wp-login.php?*
Disallow *?comments=
Disallow *?replytocom
Disallow *?s=
Disallow */feed
Disallow */page/
Disallow */tag/
Allow /*.js*
Allow /*.css*
Allow /wp-admin/admin-ajax.php
Allow /wp-admin/admin-ajax.php?action=*

Other Records

Field Value
crawl-delay 10

yandex
yandexbot
yandexmedia
yandeximages
yandexcatalog
yandexdirect
yandexblogs
yandexnews
yandexpagechecker

Rule Path
Allow /
Disallow /cgi-bin/
Disallow /wp-admin/$
Disallow /author/admin/
Disallow /wp-content/cache*
Disallow */trackback/$
Disallow /comments/feed*
Disallow /wp-login.php?*
Disallow *?comments=
Disallow *?replytocom
Disallow *?s=
Disallow */feed
Disallow */page/
Disallow */tag/
Allow /*.js*
Allow /*.css*
Allow /wp-admin/admin-ajax.php
Allow /wp-admin/admin-ajax.php?action=*

dotbot
rogerbot

Rule Path
Allow /
Disallow /cgi-bin/
Disallow /wp-admin/$
Disallow /author/admin/
Disallow /wp-content/cache*
Disallow */trackback/$
Disallow /comments/feed*
Disallow /wp-login.php?*
Disallow *?comments=
Disallow *?replytocom
Disallow *?s=
Disallow */feed
Disallow */page/
Disallow */tag/
Allow /*.js*
Allow /*.css*
Allow /wp-admin/admin-ajax.php
Allow /wp-admin/admin-ajax.php?action=*

*

Rule Path
Allow /
Disallow /cgi-bin/
Disallow /wp-admin/$
Disallow /author/admin/
Disallow /wp-content/cache*
Disallow */trackback/$
Disallow /comments/feed*
Disallow /wp-login.php?*
Disallow *?comments=
Disallow *?replytocom
Disallow *?s=
Disallow */feed
Disallow */page/
Disallow */tag/
Allow /*.js*
Allow /*.css*
Allow /wp-admin/admin-ajax.php
Allow /wp-admin/admin-ajax.php?action=*

*

Rule Path
Allow /
Disallow /cgi-bin/
Disallow /wp-admin/$
Disallow /author/admin/
Disallow /wp-content/cache*
Disallow */trackback/$
Disallow /comments/feed*
Disallow /wp-login.php?*
Disallow *?comments=
Disallow *?replytocom
Disallow *?s=
Disallow */feed
Disallow */page/
Disallow */tag/
Allow /*.js*
Allow /*.css*
Allow /wp-admin/admin-ajax.php
Allow /wp-admin/admin-ajax.php?action=*
Back to top

Other Records

Field Value
sitemap https://www.monaia.com/sitemap_index.xml
Back to top

Comments

  • Google Bots
  • slow down Yahoo
  • Slow Down Bing Bot
  • Yandex Bot
  • Moz Bot
Back to top