bmw-motorrad.fr
robots.txt

Robots Exclusion Standard data for bmw-motorrad.fr

Resource Scan

Scan Details

Site Domain bmw-motorrad.fr
Base Domain bmw-motorrad.fr
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-05-29T07:48:18+00:00
Next Scan 2024-08-27T07:48:18+00:00

Last Successful Scan

Scanned2022-10-28T18:31:04+00:00
URL https://bmw-motorrad.fr/robots.txt
Redirect https://www.bmw-motorrad.fr/robots.txt
Redirect Domain www.bmw-motorrad.fr
Redirect Base bmw-motorrad.fr
Response IP 118.214.167.57, 118.214.167.89
Found Yes
Hash b53690df51270aa0ddc17fd0386619a549c2e7f3e26aae1fa73de1da4d4f6b8d
SimHash 89090ac44b54

Groups

gsa-crawler

Rule Path
Disallow /*_MS/
Disallow /*/*_MS/
Disallow /liquidcontent.*.*.json.html
Disallow /*/*.liquidcontent.json.html
Disallow /content/bmwmotorradnsc/
Disallow /fr/home.html
Disallow /fr/protected-pool/
Disallow /fr/public-pool/
Disallow /fr/public-pool/fragments-pool/

*

Rule Path
Disallow /*_MS/
Disallow /*/*_MS/
Disallow /liquidcontent.*.*.json.html
Disallow /*/*.liquidcontent.json.html
Disallow /content/bmwmotorradnsc/
Disallow /fr/protected-pool/
Disallow /fr/public-pool/fragments-pool/

Other Records

Field Value
sitemap https://www.bmw-motorrad.fr/sitemap.xml