bmw-motorrad.dz
robots.txt

Robots Exclusion Standard data for bmw-motorrad.dz

Resource Scan

Scan Details

Site Domain bmw-motorrad.dz
Base Domain bmw-motorrad.dz
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-04-12T03:06:32+00:00
Next Scan 2024-07-11T03:06:32+00:00

Last Successful Scan

Scanned2023-09-08T11:01:33+00:00
URL https://bmw-motorrad.dz/robots.txt
Redirect https://www.bmw-motorrad.dz/robots.txt
Redirect Domain www.bmw-motorrad.dz
Redirect Base bmw-motorrad.dz
Domain IPs 104.94.220.221, 104.94.221.221, 104.94.222.229, 104.94.223.229, 104.96.176.221, 104.96.177.221, 104.96.178.223, 104.96.179.223, 104.96.180.220, 104.96.181.220
Redirect IPs 23.215.7.11, 23.215.7.18, 2600:1413:b000:1b::17d7:70b, 2600:1413:b000:1b::17d7:712
Response IP 96.17.180.185
Found Yes
Hash 6a806ee5939fd56e8f2a1e7c92db0070c4f1a7eea5e0fed39fd35735c52c7edb
SimHash c90d1e044d14

Groups

gsa-crawler

Rule Path
Disallow /*_MS/
Disallow /*/*_MS/
Disallow /*/json/liquidcontent/*.*.json.html
Disallow /content/bmwmotorradnsc/
Disallow /fr/home.html
Disallow /fr/protected-pool/
Disallow /fr/public-pool/
Disallow /fr/public-pool/fragments-pool/

*

Rule Path
Disallow /*_MS/
Disallow /*/*_MS/
Disallow /*/json/liquidcontent/*.*.json.html
Disallow /content/bmwmotorradnsc/
Disallow /fr/protected-pool/
Disallow /fr/public-pool/fragments-pool/

Other Records

Field Value
sitemap https://www.bmw-motorrad.dz/sitemap.xml