alhairlibre.com
robots.txt

Robots Exclusion Standard data for alhairlibre.com

Resource Scan

Scan Details

Site Domain alhairlibre.com
Base Domain alhairlibre.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-11T07:26:18+00:00
Next Scan 2025-01-09T07:26:18+00:00

Last Successful Scan

Scanned2023-12-17T03:47:52+00:00
URL https://alhairlibre.com/robots.txt
Domain IPs 104.21.32.149, 172.67.186.235, 2606:4700:3032::6815:2095, 2606:4700:3036::ac43:baeb
Response IP 104.21.32.149
Found Yes
Hash 7046122a546038499b2fb399f5b7fb49d1b7c41aa55a23f26405f760582d77f1
SimHash eb449e412490

Groups

*

Rule Path
Disallow

googlebot

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

ning

Rule Path
Disallow /

omgili

Rule Path
Disallow /

zmeu

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

voyager

Rule Path
Disallow /

Other Records

Field Value
sitemap https://alhairlibre.com/sitemap.xml

Warnings

  • `host` is not a known field.