1000rr.com
robots.txt
Robots Exclusion Standard data for 1000rr.com
Resource Scan
Scan Details
Site Domain | 1000rr.com |
Base Domain | 1000rr.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-04-14T00:51:58+00:00 |
Next Scan | 2024-07-13T00:51:58+00:00 |
Last Successful Scan
Scanned | 2023-09-17T13:40:28+00:00 |
URL | https://1000rr.com/robots.txt |
Redirect | https://www.motorcycle.com/robots.txt |
Redirect Domain | www.motorcycle.com |
Redirect Base | motorcycle.com |
Domain IPs | 104.16.248.51, 104.16.249.51 |
Redirect IPs | 151.101.1.91, 151.101.129.91, 151.101.193.91, 151.101.65.91, 2a04:4e42:200::347, 2a04:4e42:400::347, 2a04:4e42:600::347, 2a04:4e42::347 |
Response IP | 199.232.45.91 |
Found | Yes |
Hash | 35e183eaf388ca25594d21197a5b92bf188d492f87c5f327f5534aa19131eac0 |
SimHash | 130a8210d6b2 |
Groups
*
Rule | Path |
---|---|
Disallow | /?*activity_id=* |
Disallow | /ajax/ |
Disallow | /tour/ |
Disallow | /browser |
Disallow | /delete |
Disallow | /sharebox |
Disallow | /account |
Disallow | /flag |
Disallow | /logging/ |
Disallow | /track_ht/ |
Disallow | /js/errors |
Disallow | /homemade |
Disallow | /comment |
Disallow | /hashtags |
Disallow | /outdated |
Disallow | /board |
Disallow | /notifications |
Disallow | /paid-acquisition |
Disallow | /rapid |
Disallow | /react |
Disallow | *size%3D |
Disallow | *sort%3D |
Disallow | *se%3D |
Disallow | *%3B |
Disallow | *force_refresh%3D |
Disallow | *split_test%3D |
Disallow | /l/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.motorcycle.com/resources/user_media/network/sitemaps/motorcycle.sitemootx.xml |