clinic.veterinarians.org
robots.txt
Robots Exclusion Standard data for clinic.veterinarians.org
Resource Scan
Scan Details
Site Domain | clinic.veterinarians.org |
Base Domain | veterinarians.org |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-17T05:22:27+00:00 |
Next Scan | 2024-12-16T05:22:27+00:00 |
Last Successful Scan
Scanned | 2024-04-22T18:06:50+00:00 |
URL | https://clinic.veterinarians.org/robots.txt |
Redirect | https://www.veterinarians.org/robots.txt |
Redirect Domain | www.veterinarians.org |
Redirect Base | veterinarians.org |
Domain IPs | 141.193.213.10, 141.193.213.11 |
Redirect IPs | 141.193.213.10, 141.193.213.11 |
Response IP | 141.193.213.10 |
Found | Yes |
Hash | 23bd7e91c363ee5100db73de670e4649b782a9e33b4716db3110d8b7187a3146 |
SimHash | 2dacb470ed72 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Disallow | /p/ |
Disallow | /learn/ |
Disallow | /wp-admin/admin-ajax.php |
Disallow | /*/feed/ |
Disallow | /hot-deal/ |
Disallow | /customer-love/ |
Disallow | /exclusive-deals/ |
Disallow | /news/ |
Disallow | /news/*/ |
Disallow | /search/*/ |
Disallow | /brands/*/ |
Disallow | /tag/*/ |
Disallow | /c/*/ |
Disallow | /reviews/*/ |
Disallow | /*.css?* |
Disallow | /*.js?* |
Disallow | /*?* |
Other Records
Field | Value |
---|---|
sitemap | https://www.veterinarians.org/sitemap_index.xml |