nortonmotorcycles.com
robots.txt
Robots Exclusion Standard data for nortonmotorcycles.com
Resource Scan
Scan Details
Site Domain | nortonmotorcycles.com |
Base Domain | nortonmotorcycles.com |
Scan Status | Ok |
Last Scan | 2024-09-11T05:13:37+00:00 |
Next Scan | 2024-10-11T05:13:37+00:00 |
Last Scan
Scanned | 2024-09-11T05:13:37+00:00 |
URL | https://nortonmotorcycles.com/robots.txt |
Domain IPs | 192.0.78.164 |
Response IP | 192.0.78.164 |
Found | Yes |
Hash | 16de96d4d2b5ad7ec53cece0573d4311ceb2a324f7e776e688c751e65c5d24ed |
SimHash | 7a80d94422bb |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Disallow | /readme.html |
Disallow | /refer/ |
Disallow | /wp-login.php |
Disallow | /?s= |
Disallow | /search/ |
Disallow | /wp-content/plugins/ |
Disallow | /bikes/ |
Disallow | /community/ |
Disallow | /slideshows/ |
Disallow | /motorcycle/ |
Disallow | /home-2/ |
Disallow | /purchase/ |
Disallow | /nortonshop/ |
Disallow | /event-app/ |
Disallow | /atelier-london/ |
Disallow | /hq/ |
Disallow | /sp/ |
Disallow | /sp/thor/ |
Disallow | /sp/oakmere/ |
Disallow | /sp/ph/ |
Disallow | /via-moto/ |
Allow | /?display=wide |
Allow | /wp-content/uploads/ |
Allow | /wp-admin/admin-ajax.php |
Other Records
Field | Value |
---|---|
sitemap | https://nortonmotorcycles.com/page-sitemap.xml |
sitemap | https://nortonmotorcycles.com/norton_stories-sitemap.xml |
sitemap | https://nortonmotorcycles.com/norton_models-sitemap.xml |
sitemap | https://nortonmotorcycles.com/norton_jobs-sitemap.xml |
sitemap | https://nortonmotorcycles.com/video-sitemap-1.xml |