vention.io
robots.txt

Robots Exclusion Standard data for vention.io

Resource Scan

Scan Details

Site Domain vention.io
Base Domain vention.io
Scan Status Ok
Last Scan2024-06-03T15:45:48+00:00
Next Scan 2024-06-17T15:45:48+00:00

Last Scan

Scanned2024-06-03T15:45:48+00:00
URL https://vention.io/robots.txt
Domain IPs 104.26.10.218, 104.26.11.218, 172.67.72.240, 2606:4700:20::681a:ada, 2606:4700:20::681a:bda, 2606:4700:20::ac43:48f0
Response IP 104.26.11.218
Found Yes
Hash 8cd8e7a0c2f4479ca4e9c3c0d98004b30a79fd191d79629651fb5fd45c85173b
SimHash 8b10b94ff761

Groups

semrushbot-sa

Rule Path
Allow /

semrushbot-si

Rule Path
Allow /

*

Rule Path
Disallow /technical_documents/index
Disallow /comments/*/likes
Disallow /home/video_demo_modal
Disallow /*/contact_modal

Other Records

Field Value
sitemap https://vention.io/sitemap.xml

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • We expect indexing of individual white papers, not of the list