Log In Sign Up

wellhub.com
robots.txt

Robots Exclusion Standard data for wellhub.com

Resource Scan

Scan Details

Site Domain wellhub.com
Base Domain wellhub.com
Scan Status Ok
Last Scan2024-08-24T22:39:02+00:00
Next Scan 2024-09-23T22:39:02+00:00

Last Scan

Scanned2024-08-24T22:39:02+00:00
URL https://wellhub.com/robots.txt
Domain IPs 108.156.133.36, 108.156.133.57, 108.156.133.60, 108.156.133.72, 2600:9000:2755:2600:16:5418:bbc0:93a1, 2600:9000:2755:2c00:16:5418:bbc0:93a1, 2600:9000:2755:7a00:16:5418:bbc0:93a1, 2600:9000:2755:7c00:16:5418:bbc0:93a1, 2600:9000:2755:9000:16:5418:bbc0:93a1, 2600:9000:2755:9800:16:5418:bbc0:93a1, 2600:9000:2755:dc00:16:5418:bbc0:93a1, 2600:9000:2755:f200:16:5418:bbc0:93a1
Response IP 108.156.133.57
Found Yes
Hash 601f1352c3c85bf301799fcfde3a49a9cfb5ad2fc8c05353ee4ea979eb1aa971
SimHash 8a0528872260

Groups

*

Rule Path
Allow /

meanpathbot

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://wellhub.com/sitemap.xml
Back to top

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-Agent: *
  • Disallow: /
Back to top