vanta.com
robots.txt

Robots Exclusion Standard data for vanta.com

Resource Scan

Scan Details

Site Domain vanta.com
Base Domain vanta.com
Scan Status Ok
Last Scan2024-05-02T05:59:40+00:00
Next Scan 2024-06-01T05:59:40+00:00

Last Scan

Scanned2024-05-02T05:59:40+00:00
URL https://vanta.com/robots.txt
Redirect https://www.vanta.com/robots.txt
Redirect Domain www.vanta.com
Redirect Base vanta.com
Domain IPs 75.2.70.75, 99.83.190.102
Redirect IPs 13.200.123.229, 13.234.100.116, 65.0.79.182
Response IP 52.42.122.102
Found Yes
Hash d1ea03cba4f716bff9471a888b1526ab7a0b475d7bdee53a333d548c6fc04039
SimHash 49d112d21eda

Groups

*

Rule Path
Disallow /paid/
Disallow /twist
Disallow /products/new-page-name
Disallow /partners/msp-draft-2
Disallow /rc
Disallow /equity
Disallow /landing
Disallow /careers/paralegal
Disallow /search
Disallow /referral
Disallow /resources?1e6a6004_page=*
Disallow /resources?*1e6a6004_page=*
Disallow /resources?1e81e00e_page=*
Disallow /resources?*1e81e00e_page=*
Disallow /resources?36c897fc_page=*
Disallow /resources?*36c897fc_page=*
Disallow /resources?4995a6b5_page=*
Disallow /resources?*4995a6b5_page=*
Disallow /resources?61f25d17_page=*
Disallow /resources?*61f25d17_page=*
Disallow /resources?61f25d23_page=*
Disallow /resources?*61f25d23_page=*
Disallow /resources?700a79e5_page=*
Disallow /resources?*700a79e5_page=*
Disallow /resources?8fa89a8a_page=*
Disallow /resources?*8fa89a8a_page=*
Disallow /resources?a1c54600_page=*
Disallow /resources?*a1c54600_page=*
Disallow /resources?b3e9deb6_page=*
Disallow /resources?*b3e9deb6_page=*
Disallow /resources?bb543e10_page=*
Disallow /resources?*bb543e10_page=*
Disallow /resources?c748ec71_page=*
Disallow /resources?*c748ec71_page=*
Disallow /resources?c8d368ef_page=*
Disallow /resources?*c8d368ef_page=*
Disallow /resources?c9e6399c_page=*
Disallow /resources?*c9e6399c_page=*

termlybot

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.vanta.com/sitemap.xml

Comments

  • Resources pagination
  • Termly scanner