equibase.com
robots.txt
Robots Exclusion Standard data for equibase.com
Resource Scan
Scan Details
| Site Domain | equibase.com |
| Base Domain | equibase.com |
| Scan Status | Ok |
| Last Scan | 2024-10-30T17:07:14+00:00 |
| Next Scan | 2024-11-06T17:07:14+00:00 |
Last Scan
| Scanned | 2024-10-30T17:07:14+00:00 |
| URL | https://equibase.com/robots.txt |
| Redirect | https://www.equibase.com/robots.txt |
| Redirect Domain | www.equibase.com |
| Redirect Base | equibase.com |
| Domain IPs | 45.60.135.33, 45.60.75.33 |
| Redirect IPs | 45.60.81.33 |
| Response IP | 45.60.81.33 |
| Found | Yes |
| Hash | c01e2df00e7d7448c534e17b7d96441fb46ee31110a3923be19973478fd6f109 |
| SimHash | e9149cb2ea73 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /absolutebm/ |
| Disallow | /banmanpro/ |
| Disallow | /bcup2001/ |
| Disallow | /bcup2002/ |
| Disallow | /bcup2003/ |
| Disallow | /bcup2004/ |
| Disallow | /bcup2005/ |
| Disallow | /premium/eqbRaceChartCalendar.cfm |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Warnings
- 2 invalid lines.