Log In Sign Up

betterbutter.in
robots.txt

Robots Exclusion Standard data for betterbutter.in

Resource Scan

Scan Details

Site Domain betterbutter.in
Base Domain betterbutter.in
Scan Status Ok
Last Scan2024-09-19T22:29:42+00:00
Next Scan 2024-09-26T22:29:42+00:00

Last Scan

Scanned2024-09-19T22:29:42+00:00
URL https://www.betterbutter.in/robots.txt
Domain IPs 104.236.67.189
Response IP 104.236.67.189
Found Yes
Hash 4cb3ce245b3baef379bb88b99a69c8f1b8d227c38314d5f85ec731f76f01d12e
SimHash 5914d4d4c531

Groups

*

Rule Path
Allow /
Allow /blog/
Allow /blog/wp-content/uploads/
Disallow /admin/
Disallow /blog/wp-admin
Disallow /blog/wp-content/plugins/
Disallow /readme.html
Disallow /blog/wp-config.php
Disallow /blog/wp-load.php
Disallow /blog/wp-register.php
Disallow /blog/xmlrpc.php
Disallow /blog/wp-app.php
Disallow /blog/wp-login.php
Disallow /blog/wp-settings.php
Disallow /blog/wp-cron.php
Disallow /blog/wp-mail.php
Disallow /blog/wp-signup.php
Disallow /blog/wp-trackback.php
Disallow /blog/wp-pass.php
Disallow /blog/wp-links-opml.php
Disallow /blog/tag/*
Disallow /cache/
Disallow /logs/
Disallow /account/
Disallow /user/
Disallow /whats-cooking
Disallow /explore/search
Disallow /my-profile/
Disallow /?utm_source=
Disallow /*/my-profile/
Disallow /*/edit

twitterbot

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /
Allow /blog/
Disallow /account/
Disallow /admin/
Disallow /blog/wp-admin
Disallow /my-profile/
Disallow /*/my-profile/
Disallow /*/edit
Disallow /upload
Disallow /*/upload

googlebot-mobile

Rule Path
Allow /blog/wp-content/uploads/
Allow /blog/wp-content/themes/
Allow /images/
Back to top

Other Records

Field Value
sitemap https://www.betterbutter.in/sitemap.xml
sitemap https://www.betterbutter.in/blog/sitemap.xml
sitemap https://www.betterbutter.in/blog/sitemap-news.xml
Back to top

Warnings

  • `noindex` is not a known field.
Back to top