massivechecks.com
robots.txt

Robots Exclusion Standard data for massivechecks.com

Resource Scan

Scan Details

Site Domain massivechecks.com
Base Domain massivechecks.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-09-22T18:03:10+00:00
Next Scan 2024-12-21T18:03:10+00:00

Last Successful Scan

Scanned2024-05-26T18:01:06+00:00
URL https://www.massivechecks.com/robots.txt
Domain IPs 104.21.93.248, 172.67.217.35, 2606:4700:3033::6815:5df8, 2606:4700:3035::ac43:d923
Response IP 104.21.93.248
Found Yes
Hash aa500f9f08dbb03599341c65209517ce5f5c6b906e507ea590cf50b1868058e6
SimHash 9e7d4f134530

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /search*
Disallow /20*
Allow /*.html
Disallow ez3k.lovestoblog.com
Allow /

Other Records

Field Value
sitemap http://www.massivechecks.com/feeds/posts/default?orderby=UPDATED
sitemap https://www.massivechecks.com/sitemap.xml
sitemap https://www.massivechecks.com/sitemap-pages.xml
sitemap https://www.massivechecks.com/atom.xml?redirect=false&start-index=1&max-result=500
sitemap https://www.massivechecks.com/atom.xml?redirect=false&start-index=501&max-result=500
sitemap https://www.massivechecks.com/atom.xml?redirect=false&start-index=1001&max-result=500

Comments

  • below lines control all search engines, and blocks all search, archieve and allow all blog posts and pages.
  • sitemap of the blog
  • sitemap of the blog - search-console - developers.google.com - ez3k