Log In Sign Up

cookit.guru
robots.txt

Robots Exclusion Standard data for cookit.guru

Resource Scan

Scan Details

Site Domain cookit.guru
Base Domain cookit.guru
Scan Status Ok
Last Scan2024-09-15T19:56:08+00:00
Next Scan 2024-09-22T19:56:08+00:00

Last Scan

Scanned2024-09-15T19:56:08+00:00
URL https://cookit.guru/robots.txt
Domain IPs 195.248.234.115
Response IP 195.248.234.115
Found Yes
Hash 0876acfe58f72330a7f351c721eafb16d79f7de99fd65a4e6d03386e9080c6a8
SimHash 0801c2420336

Groups

ia_archiver-web.archive.org

Rule Path
Disallow /

*

Rule Path
Disallow /cgi-bin
Disallow /wp-
Disallow /trackback
Disallow */trackback
Disallow */*/trackback
Disallow /*?*
Disallow /xmlrpc.php
Allow */uploads
Allow *.js
Allow *.css

yandex

Rule Path
Disallow /cgi-bin
Disallow /wp-
Disallow /trackback
Disallow */trackback
Disallow */*/trackback
Disallow /*?*
Disallow /xmlrpc.php
Allow */uploads
Allow *.js
Allow *.css
Allow */feed/zen/
Back to top

Other Records

Field Value
sitemap https://cookit.guru/sitemap_index.xml
Back to top

Comments

  • Disallow: */*/feed/*/
  • Disallow: */feed
  • Disallow: /tag
  • Disallow: */*/feed/*/
  • Disallow: */feed
  • Disallow: /tag
Back to top

Warnings

  • `host` is not a known field.
Back to top