vetfriends.com
robots.txt
Robots Exclusion Standard data for vetfriends.com
Resource Scan
Scan Details
| Site Domain | vetfriends.com |
| Base Domain | vetfriends.com |
| Scan Status | Ok |
| Last Scan | 2024-11-01T02:55:34+00:00 |
| Next Scan | 2024-12-01T02:55:34+00:00 |
Last Scan
| Scanned | 2024-11-01T02:55:34+00:00 |
| URL | https://www.vetfriends.com/robots.txt |
| Domain IPs | 209.35.50.98 |
| Response IP | 209.35.50.98 |
| Found | Yes |
| Hash | 84b74beee7b96757b924654ec398ba814cecfb3b4ad28e864fe6b3034778c23f |
| SimHash | c8aedf60d539 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin |
| Disallow | /CFIDE |
| Disallow | /private |
| Disallow | /temp |
| Disallow | /catalog_item.cfm |
| Disallow | /catalog/cfc |
| Disallow | /catalog/cart.cfm |
| Disallow | /catalog/checkout_amazonAPA.cfm |
| Disallow | /catalog/order-receipt.cfm |
| Disallow | /catalog/order-details.cfm |
| Disallow | /catalog/mobile/cart.cfm |
| Disallow | /catalog/mobile/order-receipt.cfm |
| Disallow | /catalog/mobile/order-details.cfm |
| Disallow | /catalog/mobile/cfc |
| Disallow | /catalog/paypal-cat.cfm |
| Disallow | /catalog/invoicepage.cfm |
| Disallow | /registration/premiumReceipt.cfm |
| Disallow | /catalog/premiumReceipt-cat.cfm |
| Disallow | /catalogvetfriends |
| Disallow | /index_version1c.cfm |
| Disallow | /links/click_thru.cfm |
| Disallow | /*mailtofriend.cfm |
| Disallow | /members/ecommerce |
| Disallow | /memorial/mem_alphab.cfm |
| Disallow | /memorial/auth_only |
| Disallow | /mobile/ |
| Disallow | /m/ |
| Disallow | /_newCatalogTest |
| Disallow | /_newmobilecatalogtest/ |
| Disallow | /veterandirectory/?member=224818 |
| Disallow | /units/index_vs2.cfm |
| Disallow | /units/?unit=201127 |
| Disallow | /veterandirectory/?member=164413 |
| Disallow | /units/?unit=43258 |
| Disallow | /units/?unit=122786 |
| Disallow | /veterandirectory/?member=299820&name=SHERIVA%20WHITEHEAD&branch=Army&from=1991&to=2002 |
| Disallow | /veterandirectory/?member=299820 |
| Disallow | /veterandirectory/?member=1395904 |
| Disallow | /temp/nl/goRobly.cfm |
| Disallow | /catalog/RatingWidget/reviewOrderItem.cfm |
| Disallow | /email.cfm |
| Disallow | /cfscripts5635 |
facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
*
| Rule | Path |
|---|---|
| Disallow | /catalogvetfriends/order-receipt.cfm |
*
| Rule | Path |
|---|---|
| Disallow | /catalogvetfriends/order-details.cfm |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.vetfriends.com/sitemap.xml |
| sitemap | https://www.vetfriends.com/sitemap.xml |