mmcinfosite.blogspot.com
robots.txt

Robots Exclusion Standard data for mmcinfosite.blogspot.com

Resource Scan

Scan Details

Site Domain mmcinfosite.blogspot.com
Base Domain mmcinfosite.blogspot.com
Scan Status Ok
Last Scan2025-12-10T17:27:34+00:00
Next Scan 2025-12-17T17:27:34+00:00

Last Scan

Scanned2025-12-10T17:27:34+00:00
URL https://mmcinfosite.blogspot.com/robots.txt
Redirect https://www.cagymind.me/robots.txt
Redirect Domain www.cagymind.me
Redirect Base cagymind.me
Domain IPs 2404:6800:4003:c05::84, 74.125.68.132
Redirect IPs 142.250.4.121, 2404:6800:4003:c06::79
Response IP 142.251.10.121
Found Yes
Hash 1b825e8ebbe6ebff9c076d461f45707134a6853179c7d2922ba7f83b1d2c1d24
SimHash 3832e7b0d183

Groups

mediapartners-google

Rule Path
Disallow

*

Product Comment
* to select all crawling bots and search engines
Rule Path Comment
Disallow /search* to block all user generated query item within the website.
Disallow /20* this line will disallow archieve section of Blogger.
Disallow /feeds* this line will disallow feeds. Read instruction below
Allow /*.html allow all post and pages of the blog

mediapartners-google

Rule Path
Disallow

all browser and website inspector

Rule Path
Allow /

*

Rule Path
Disallow /

*

Rule Path
Disallow /calendar/
Disallow /junk/
Disallow /books/fiction/contemporary/

googlebot-news

Rule Path
Allow /

*

Rule Path
Disallow /

unnecessarybot

Rule Path
Disallow /

*

Rule Path
Allow /

*

Rule Path
Disallow /useless_file.html
Disallow /junk/other_useless_file.html

*

Rule Path
Disallow /
Allow /public/

googlebot-image

Rule Path
Disallow /images/dogs.jpg

googlebot-image

Rule Path
Disallow /

googlebot

Rule Path
Disallow /*.gif$

*

Rule Path
Disallow /

mediapartners-google

Rule Path
Allow /

googlebot

Rule Path
Disallow /*.xls$

Other Records

Field Value
sitemap https://www.cagymind.me/sitemap.xml
sitemap https://www.cagymind.me/sitemap.xml

Comments

  • sitemap of the blog

Warnings

  • 1 invalid line.