indexventures.com
robots.txt
Robots Exclusion Standard data for indexventures.com
Resource Scan
Scan Details
Site Domain | indexventures.com |
Base Domain | indexventures.com |
Scan Status | Ok |
Last Scan | 2024-05-26T00:46:37+00:00 |
Next Scan | 2024-06-25T00:46:37+00:00 |
Last Scan
Scanned | 2024-05-26T00:46:37+00:00 |
URL | https://indexventures.com/robots.txt |
Redirect | https://www.indexventures.com:443/robots.txt |
Redirect Domain | www.indexventures.com |
Redirect Base | indexventures.com |
Domain IPs | 34.242.72.77, 54.194.223.19 |
Redirect IPs | 18.173.121.111, 18.173.121.38, 18.173.121.39, 18.173.121.68 |
Response IP | 108.157.52.97 |
Found | Yes |
Hash | 7ab3f0c243049f538617bb9c34322d457c033163293827b1ae6d77a8cca255fc |
SimHash | aa1c1dc5f7f0 |
Groups
*
Rule | Path |
---|---|
Disallow | *.pdf$ |
Disallow | /landing_google |
Disallow | /enterprise/landing_pages/google* |
Other Records
Field | Value |
---|---|
sitemap | https://www.indexventures.com/sitemap.xml |
sitemap | https://www.indexventures.com/sitemap_extra.xml |
Comments