m4yours.com
robots.txt

Robots Exclusion Standard data for m4yours.com

Resource Scan

Scan Details

Site Domain m4yours.com
Base Domain m4yours.com
Scan Status Ok
Last Scan2026-01-18T04:43:28+00:00
Next Scan 2026-01-25T04:43:28+00:00

Last Scan

Scanned2026-01-18T04:43:28+00:00
URL https://m4yours.com/robots.txt
Redirect https://www.m4yours.com/robots.txt
Redirect Domain www.m4yours.com
Redirect Base m4yours.com
Domain IPs 104.21.54.201, 172.67.169.3, 2606:4700:3034::6815:36c9, 2606:4700:3034::ac43:a903
Redirect IPs 104.21.54.201, 172.67.169.3, 2606:4700:3034::6815:36c9, 2606:4700:3034::ac43:a903
Response IP 172.67.169.3
Found Yes
Hash a4a5f3c68302186de5af9c113aa536efd3fbbe61c0cd7ffb9434962ff7725e68
SimHash 6060dc114794

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

msnbot

Rule Path
Disallow

slurp

Rule Path
Disallow

teoma

Rule Path
Disallow

gigabot

Rule Path
Disallow

baiduspider

Rule Path
Disallow

yahoo-mmcrawler

Rule Path
Disallow

psbot

Rule Path
Disallow

yahoo-blogs/v3.9
*

Rule Path
Disallow /404
Disallow /500

*

Rule Path
Allow /
Disallow /404

Other Records

Field Value
crawl-delay 120

*

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://www.m4yours.com/sitemap.xml
sitemap https://www.m4yours.com/blogs-sitemap.xml

Comments

  • *
  • *
  • Host
  • Sitemaps
  • Sitemaps-Blogs

Warnings

  • 1 invalid line.
  • `host` is not a known field.