Log In Sign Up

cookiemadness.net
robots.txt

Robots Exclusion Standard data for cookiemadness.net

Resource Scan

Scan Details

Site Domain cookiemadness.net
Base Domain cookiemadness.net
Scan Status Ok
Last Scan2024-11-14T05:38:03+00:00
Next Scan 2024-11-21T05:38:03+00:00

Last Scan

Scanned2024-11-14T05:38:03+00:00
URL https://cookiemadness.net/robots.txt
Domain IPs 104.21.0.188, 172.67.128.52, 2606:4700:3030::6815:bc, 2606:4700:3036::ac43:8034
Response IP 172.67.128.52
Found Yes
Hash da9470d0337c80b9c3ecc8508fb422242a7d70725f2cb523d0c0837690d2139a
SimHash 8909ca6082b2

Groups

ia_archiver

Rule Path
Disallow /

*

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap http://www.cookiemadness.net/sitemap.xml
Back to top

Comments

  • IA
  • global
  • Disallow: /cgi-bin/
  • Disallow: /wp-admin/
  • Disallow: /trackback/
  • Disallow: /feed/
  • Disallow: /comments/
  • Disallow: /category/*/*
  • Disallow: /tag/
  • Disallow: */trackback/
  • Disallow: */feed/
  • Disallow: */comments/
  • Disallow: */comment-page-
  • Disallow: /wp-content/plugins/
  • Allow: /wp-content/uploads/
Back to top