blog.arabia2.com
robots.txt

Robots Exclusion Standard data for blog.arabia2.com

Resource Scan

Scan Details

Site Domain blog.arabia2.com
Base Domain arabia2.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-15T20:13:55+00:00
Next Scan 2024-11-13T20:13:55+00:00

Last Successful Scan

Scanned2023-09-28T06:18:30+00:00
URL https://blog.arabia2.com/robots.txt
Domain IPs 172.66.40.235, 172.66.43.21, 2606:4700:3108::ac42:28eb, 2606:4700:3108::ac42:2b15
Response IP 172.66.43.21
Found Yes
Hash 7c89cf064d534764b5eea714cbe17c4d6c6852c73bbf32a0594978671296a816
SimHash 4c511c14c513

Groups

*

Rule Path
Disallow /dimcp/

Other Records

Field Value
sitemap https://blog.arabia2.com/contents/sitemap/sitemap_index.xml.gz