indexventures.com
robots.txt

Robots Exclusion Standard data for indexventures.com

Resource Scan

Scan Details

Site Domain indexventures.com
Base Domain indexventures.com
Scan Status Ok
Last Scan2024-05-26T00:46:37+00:00
Next Scan 2024-06-25T00:46:37+00:00

Last Scan

Scanned2024-05-26T00:46:37+00:00
URL https://indexventures.com/robots.txt
Redirect https://www.indexventures.com:443/robots.txt
Redirect Domain www.indexventures.com
Redirect Base indexventures.com
Domain IPs 34.242.72.77, 54.194.223.19
Redirect IPs 18.173.121.111, 18.173.121.38, 18.173.121.39, 18.173.121.68
Response IP 108.157.52.97
Found Yes
Hash 7ab3f0c243049f538617bb9c34322d457c033163293827b1ae6d77a8cca255fc
SimHash aa1c1dc5f7f0

Groups

*

Rule Path
Disallow *.pdf$
Disallow /landing_google
Disallow /enterprise/landing_pages/google*

Other Records

Field Value
sitemap https://www.indexventures.com/sitemap.xml
sitemap https://www.indexventures.com/sitemap_extra.xml

Comments

  • See http://www.robotstxt.org for documentation on how to use the robots.txt file