vettafi.com
robots.txt

Robots Exclusion Standard data for vettafi.com

Resource Scan

Scan Details

Site Domain vettafi.com
Base Domain vettafi.com
Scan Status Ok
Last Scan2025-11-26T13:07:55+00:00
Next Scan 2025-12-03T13:07:55+00:00

Last Scan

Scanned2025-11-26T13:07:55+00:00
URL https://vettafi.com/robots.txt
Redirect https://www.vettafi.com/robots.txt
Redirect Domain www.vettafi.com
Redirect Base vettafi.com
Domain IPs 198.202.211.1
Redirect IPs 198.202.211.1, 2620:cb:2000::1
Response IP 198.202.211.1
Found Yes
Hash 18c9677f22785a58a06af3dec8d6c06fcff35058cad29af58b2fca70fdf9ae11
SimHash 751acc60e610

Groups

*

Rule Path
Disallow

gptbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 2

anthropic-ai

Rule Path
Disallow

Other Records

Field Value
crawl-delay 2

claude-web

Rule Path
Disallow

Other Records

Field Value
crawl-delay 2

perplexitybot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 2

google-extended

Rule Path
Disallow

Other Records

Field Value
crawl-delay 2

amazonbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 2

applebot-extended

Rule Path
Disallow

Other Records

Field Value
crawl-delay 2

bytespider

Rule Path
Disallow

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap https://www.vettafi.com/sitemap.xml