curipod.com
robots.txt

Robots Exclusion Standard data for curipod.com

Resource Scan

Scan Details

Site Domain curipod.com
Base Domain curipod.com
Scan Status Ok
Last Scan2025-08-13T09:01:24+00:00
Next Scan 2025-09-12T09:01:24+00:00

Last Scan

Scanned2025-08-13T09:01:24+00:00
URL https://curipod.com/robots.txt
Domain IPs 2001:4860:4802:32::15, 2001:4860:4802:34::15, 2001:4860:4802:36::15, 2001:4860:4802:38::15, 216.239.32.21, 216.239.34.21, 216.239.36.21, 216.239.38.21
Response IP 216.239.32.21
Found Yes
Hash 64eb726bb6a9f8689e8f737cd2c9a3e9ac828379e2117f3bb8e006a50bc9fd96
SimHash 29001f43cb56

Groups

*

Rule Path
Disallow /discover
Disallow /discover/*

Other Records

Field Value
sitemap https://curipod.com/sitemap.xml
sitemap https://curipod.com/server-sitemap-index.xml

Comments

  • Allow for everything except discover
  • Disallow discover overview page
  • Disallow every subroute of discover
  • Host
  • Sitemaps

Warnings

  • `host` is not a known field.