Log In Sign Up

countable.us
robots.txt

Robots Exclusion Standard data for countable.us

Resource Scan

Scan Details

Site Domain countable.us
Base Domain countable.us
Scan Status Ok
Last Scan2024-06-19T19:14:38+00:00
Next Scan 2024-06-26T19:14:38+00:00

Last Scan

Scanned2024-06-19T19:14:38+00:00
URL https://countable.us/robots.txt
Redirect https://www.causes.com:443/robots.txt
Redirect Domain www.causes.com
Redirect Base causes.com
Domain IPs 35.83.211.192, 44.228.96.107, 54.148.242.61
Redirect IPs 108.156.133.105, 108.156.133.36, 108.156.133.58, 108.156.133.74, 2600:9000:2755:5800:15:cdf7:fe00:93a1, 2600:9000:2755:6800:15:cdf7:fe00:93a1, 2600:9000:2755:a00:15:cdf7:fe00:93a1, 2600:9000:2755:a600:15:cdf7:fe00:93a1, 2600:9000:2755:d600:15:cdf7:fe00:93a1, 2600:9000:2755:e000:15:cdf7:fe00:93a1, 2600:9000:2755:ea00:15:cdf7:fe00:93a1, 2600:9000:2755:f000:15:cdf7:fe00:93a1
Response IP 108.156.133.74
Found Yes
Hash 5c8d4e0773037659992d954358da513dbdc096e64ce959b1d6ab69965488b78a
SimHash a28d2d8d2550

Groups

*

Rule Path
Disallow /users/*
Disallow /view
Back to top

Other Records

Field Value
sitemap https://assets.hosted-assets.com/nextgencauses/sitemaps/sitemap.xml.gz
Back to top

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-agent: *
  • Disallow: /
Back to top