offroadassassin.com
robots.txt
Robots Exclusion Standard data for offroadassassin.com
Resource Scan
Scan Details
| Site Domain | offroadassassin.com |
| Base Domain | offroadassassin.com |
| Scan Status | Ok |
| Last Scan | 2024-06-15T01:13:29+00:00 |
| Next Scan | 2024-06-22T01:13:29+00:00 |
Last Scan
| Scanned | 2024-06-15T01:13:29+00:00 |
| URL | https://offroadassassin.com/robots.txt |
| Redirect | https://www.offroadexpo.com/robots.txt |
| Redirect Domain | www.offroadexpo.com |
| Redirect Base | offroadexpo.com |
| Domain IPs | 217.70.184.55 |
| Redirect IPs | 141.193.213.20, 141.193.213.21 |
| Response IP | 141.193.213.20 |
| Found | Yes |
| Hash | 6cfcdaf47f3974c97751efa61cb6e5f995ca131ac9e7c624cf4cc609e1b48be6 |
| SimHash | 0f18df42f1e2 |
Groups
semrushbot
siteauditbot
semrushbot-ba
semrushbot-si
semrushbot-swa
semrushbot-ct
splitsignalbot
semrushbot-coub
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /au/ |
| Disallow | /ca/ |
| Disallow | /fr/ |
| Disallow | /ca/ |
| Disallow | /fr/ |
| Disallow | /de/ |
| Disallow | /in/ |
| Disallow | /it/ |
| Disallow | /jp/ |
| Disallow | /mx/ |
| Disallow | /es/ |
| Disallow | /uk/ |
| Disallow | /comments/feed/ |
| Disallow | /trackback/ |
| Disallow | */comments$ |
| Disallow | */trackback |
| Disallow | */trackback$ |
| Disallow | /wp-comments |
| Disallow | /wp-trackback |
| Disallow | /cgi-bin/ |
| Disallow | /wp-admin/ |
| Disallow | /wp-login.php |
| Disallow | /tags/* |
| Disallow | */page/* |
| Allow | */page/2/ |
| Allow | */page/3/ |
| Allow | */page/4/ |
| Allow | */page/5/ |
| Allow | */page/6/ |
| Allow | */page/7/ |
| Allow | */page/8/ |
| Allow | */page/9/ |
| Allow | */page/10/ |
| Allow | /wp-admin/admin-ajax.php |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.offroadexpo.com/sitemap_index.xml |
Comments