veteran.com
robots.txt

Robots Exclusion Standard data for veteran.com

Resource Scan

Scan Details

Site Domain veteran.com
Base Domain veteran.com
Scan Status Ok
Last Scan2024-11-14T20:23:06+00:00
Next Scan 2024-11-21T20:23:06+00:00

Last Scan

Scanned2024-11-14T20:23:06+00:00
URL https://veteran.com/robots.txt
Domain IPs 172.66.41.2, 172.66.42.254, 2606:4700:3108::ac42:2902, 2606:4700:3108::ac42:2afe
Response IP 172.66.42.254
Found Yes
Hash eaa549609e646eaa7a645adfb1b2fdf94017cf73d01b8185b93a0742ab3a3172
SimHash 6c2a4b40a4f4

Groups

*

Rule Path
Disallow /*?p=*
Disallow /*%26p%3D*
Disallow /*?s=*
Disallow /*%26s%3D*
Disallow /*?ical=1
Disallow /*%26ical%3D1
Disallow /*?tribe-bar-date=*
Disallow /*%26tribe-bar-date%3D*
Disallow /?author=*
Disallow /*wp-comments*
Disallow /*wp-trackback*
Disallow /*wp-feed*
Disallow /*replytocom%3D*
Disallow /*?preview=*
Disallow /*%26preview%3D*
Disallow /*add-to-cart%3D*
Disallow /*add_to_wishlist%3D*
Disallow /*cart/*
Disallow /*checkout/*
Disallow /*my-account/*
Disallow /*myaccount/*
Disallow /*?ajaxCalendar=1*
Allow /*/plugins/*

google-extended

Rule Path
Disallow /

googleother

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

applebot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://veteran.com/sitemap_index.xml

Comments

  • Stop bots from crawling junk URLs
  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK