arabe-tech.com
robots.txt

Robots Exclusion Standard data for arabe-tech.com

Resource Scan

Scan Details

Site Domain arabe-tech.com
Base Domain arabe-tech.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-10T11:10:24+00:00
Next Scan 2026-01-08T11:10:24+00:00

Last Successful Scan

Scanned2025-06-13T10:40:15+00:00
URL https://arabe-tech.com/robots.txt
Redirect https://www.arabe-tech.com/robots.txt
Redirect Domain www.arabe-tech.com
Redirect Base arabe-tech.com
Domain IPs 216.239.32.21, 216.239.34.21, 216.239.36.21, 216.239.38.21
Redirect IPs 172.253.118.121, 2404:6800:4003:c00::79
Response IP 64.233.170.121
Found Yes
Hash 9f40cf2f0f39f93d3fb20166dbe5ec867f93dc46a41feb960fbcee271a365b0c
SimHash 0d049e504f13

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /search
Disallow /share-widget
Allow /

Other Records

Field Value
sitemap https://www.arabe-tech.com/sitemap.xml