spotrac.com
robots.txt
Robots Exclusion Standard data for spotrac.com
Resource Scan
Scan Details
| Site Domain | spotrac.com |
| Base Domain | spotrac.com |
| Scan Status | Ok |
| Last Scan | 2024-11-10T23:01:24+00:00 |
| Next Scan | 2024-11-17T23:01:24+00:00 |
Last Scan
| Scanned | 2024-11-10T23:01:24+00:00 |
| URL | https://spotrac.com/robots.txt |
| Redirect | https://www.spotrac.com/robots.txt |
| Redirect Domain | www.spotrac.com |
| Redirect Base | spotrac.com |
| Domain IPs | 54.158.112.25 |
| Redirect IPs | 18.224.124.198, 3.147.33.234 |
| Response IP | 3.147.33.234 |
| Found | Yes |
| Hash | 687ff8c70d268d5f8029b87a0a6a0016d7760d726238816766eaa96d0223e00a |
| SimHash | a16ee220e73b |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /mobile/ |
| Disallow | /mobi/ |
| Disallow | /app/ |
| Disallow | /m/ |
| Disallow | /remote/ |
| Disallow | /2015/ |
| Disallow | /labs/ |
| Disallow | /redirect/ |
| Disallow | /cache/ |
| Disallow | /reports/ |
| Disallow | /assets |
| Allow | /ads.txt |
| Disallow | /ads |