Log In Sign Up

mnamaz.com
robots.txt

Robots Exclusion Standard data for mnamaz.com

Resource Scan

Scan Details

Site Domain mnamaz.com
Base Domain mnamaz.com
Scan Status Ok
Last Scan2026-01-25T01:38:06+00:00
Next Scan 2026-02-01T01:38:06+00:00

Last Scan

Scanned2026-01-25T01:38:06+00:00
URL https://mnamaz.com/robots.txt
Domain IPs 185.199.108.153, 185.199.109.153, 185.199.110.153, 185.199.111.153
Response IP 185.199.110.153
Found Yes
Hash 5dad8cc94fd39fe80ad00c768999951d13a956291fefc3c031d078d1c2c77228
SimHash 4712ef336581

Groups

*

Rule Path
Allow /
Disallow /api/
Disallow /_next/
Disallow /out/

Other Records

Field Value
crawl-delay 0.5

googlebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 0

googlebot-image

Rule Path
Allow /

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 0

slurp

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

baiduspider

Rule Path
Allow /

yandexbot

Rule Path
Allow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://mnamaz.com/sitemap.xml
sitemap https://mnamaz.com/sitemap-0.xml
Back to top

Comments

  • https://www.robotstxt.org/robotstxt.html
  • mNamaz - Islamic Prayer Guide
  • Default rules for all crawlers
  • Crawl delay (optional - prevents server overload)
  • Major search engines - full access
  • AI crawlers - selective access
  • Sitemaps
  • Host (preferred domain)
Back to top

Warnings

  • `host` is not a known field.
Back to top