mealblend.com
robots.txt

Robots Exclusion Standard data for mealblend.com

Resource Scan

Scan Details

Site Domain mealblend.com
Base Domain mealblend.com
Scan Status Ok
Last Scan2026-02-11T23:43:33+00:00
Next Scan 2026-02-18T23:43:33+00:00

Last Scan

Scanned2026-02-11T23:43:33+00:00
URL https://mealblend.com/robots.txt
Domain IPs 104.21.58.202, 172.67.164.91, 2606:4700:3036::6815:3aca, 2606:4700:3036::ac43:a45b
Response IP 172.67.164.91
Found Yes
Hash f9fd0f706af5286013ab682284fbfd00e7a97bdcc0bc43a6b344b50ab21aa777
SimHash 6800dc52a721

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /api/

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://mealblend.com/sitemap.xml

Comments

  • Sitemaps
  • Crawl delay (optional - helps prevent server overload)
  • Disallow admin and API paths