lexpressiondz.com
robots.txt

Robots Exclusion Standard data for lexpressiondz.com

Resource Scan

Scan Details

Site Domain lexpressiondz.com
Base Domain lexpressiondz.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-12T08:56:47+00:00
Next Scan 2025-12-11T08:56:47+00:00

Last Successful Scan

Scanned2023-02-02T07:15:36+00:00
URL https://lexpressiondz.com/robots.txt
Domain IPs 104.21.4.86, 172.67.131.222, 2606:4700:3030::6815:456, 2606:4700:3033::ac43:83de
Response IP 104.21.4.86
Found Yes
Hash bcaaf4227c42a074b0544ab5bb9405ccc05783b466c08354c05e5de7de26b395
SimHash 2900d5335421

Groups

*

Rule Path
Disallow

googlebot

Rule Path
Disallow /*view$
Allow /

googlebot-mobile

Rule Path
Disallow /*view$
Allow /

slurp

Rule Path
Disallow /*view$
Allow /

msnbot

Rule Path
Disallow /*view$
Allow /

ia_archiver

Rule Path
Disallow /*view$
Allow /
Disallow /pdf/
Disallow /ads/
Disallow /feed/
Disallow /feeds/
Disallow /images/
Disallow /styles/

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.lexpression.dz/sitemap.xml