curlnationkw.com
robots.txt

Robots Exclusion Standard data for curlnationkw.com

Resource Scan

Scan Details

Site Domain curlnationkw.com
Base Domain curlnationkw.com
Scan Status Ok
Last Scan2024-06-03T08:58:37+00:00
Next Scan 2024-06-17T08:58:37+00:00

Last Scan

Scanned2024-06-03T08:58:37+00:00
URL https://curlnationkw.com/robots.txt
Domain IPs 104.26.4.214, 104.26.5.214, 172.67.74.120, 2606:4700:20::681a:4d6, 2606:4700:20::681a:5d6, 2606:4700:20::ac43:4a78
Response IP 104.26.5.214
Found Yes
Hash 8db9801ac217013b2deb4a182859baf7fd743eaa1b2b4cec6a9cd0fb7c5fff1a
SimHash 48444a164353

Groups

*

Rule Path
Allow /
Disallow /en/customer/account/login/referer/
Disallow /ar/customer/account/login/referer/

Other Records

Field Value
sitemap https://curlnationkw.com/media/sitemap/sitemap.xml
sitemap https://curlnationkw.com/media/sitemap/sitemap_ar.xml