Log In Sign Up

memoword.online
robots.txt

Robots Exclusion Standard data for memoword.online

Resource Scan

Scan Details

Site Domain memoword.online
Base Domain memoword.online
Scan Status Ok
Last Scan2025-12-29T04:43:43+00:00
Next Scan 2026-01-12T04:43:43+00:00

Last Scan

Scanned2025-12-29T04:43:43+00:00
URL https://memoword.online/robots.txt
Domain IPs 136.243.81.57, 2a01:4f8:212:2f08::
Response IP 136.243.81.57
Found Yes
Hash 50e5bbcbdaabe6878ea9fa11b2bf2e02f2312c6e0c3680d3f2dd7152cb22f8b4
SimHash 6c718b70c7a0

Groups

*

Rule Path
Disallow /admin/
Disallow /private/
Disallow /cgi-bin/
Allow /

Other Records

Field Value
crawl-delay 5

googlebot

Rule Path
Allow /

yandex

Rule Path
Disallow /tmp/
Allow /
Back to top

Other Records

Field Value
sitemap https://memoword.online/sitemap.xml
Back to top

Comments

  • Allow access to all other content
  • Specify the location of the sitemap
  • Optional: set crawl delay to avoid server overload
  • Googlebot-specific rules
  • Yandex-specific rules
  • Define the preferred domain
Back to top

Warnings

  • `host` is not a known field.
Back to top