awalmazad.com
robots.txt

Robots Exclusion Standard data for awalmazad.com

Resource Scan

Scan Details

Site Domain awalmazad.com
Base Domain awalmazad.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-15T12:12:14+00:00
Next Scan 2026-03-15T12:12:14+00:00

Last Successful Scan

Scanned2024-02-18T01:52:29+00:00
URL https://awalmazad.com/robots.txt
Domain IPs 104.18.0.78, 104.18.1.78, 2606:4700::6812:14e, 2606:4700::6812:4e
Response IP 104.18.0.78
Found Yes
Hash ce7825fdda7b0d639258e8c05c64f45ef0cb47aa75b1c21ffb45c200970e0240
SimHash 49048ea2a223

Groups

cutestat

Rule Path
Disallow /

clearwebstats

Rule Path
Disallow /

webstatdata

Rule Path
Disallow /

*

Rule Path
Allow /$
Allow /en$
Allow /ar$
Allow /en/search$
Allow /ar/search$
Allow /en/faq$
Allow /ar/faq$
Allow /en/contact-us$
Allow /ar/contact-us$
Disallow /en/vehicle/auction/bidding-history
Disallow /ar/vehicle/auction/bidding-history
Allow /en/vehicle/auction
Allow /ar/vehicle/auction
Disallow /

Other Records

Field Value
sitemap https://www.awalmazad.com/sitemap.xml