kw.arabiaweather.com
robots.txt

Robots Exclusion Standard data for kw.arabiaweather.com

Resource Scan

Scan Details

Site Domain kw.arabiaweather.com
Base Domain arabiaweather.com
Scan Status Ok
Last Scan2024-05-29T00:35:32+00:00
Next Scan 2024-06-05T00:35:32+00:00

Last Scan

Scanned2024-05-29T00:35:32+00:00
URL https://kw.arabiaweather.com/robots.txt
Redirect https://www.arabiaweather.com/robots.txt
Redirect Domain www.arabiaweather.com
Redirect Base arabiaweather.com
Domain IPs 94.130.205.92
Redirect IPs 46.4.20.188
Response IP 148.251.121.114
Found Yes
Hash 0012141a084da22448f16a9eadfd3d9c53a1952d206f36f84086d32d4afdc6c9
SimHash cc2d18410f52

Groups

*

Rule Path
Disallow /cgi-bin/

googlebot

Rule Path
Allow *.js
Allow *.css

Other Records

Field Value
sitemap https://www.arabiaweather.com/sitemap.xml
sitemap https://www.arabiaweather.com/locations-sitemap.xml
sitemap https://www.arabiaweather.com/ar/locations-sitemap.xml
sitemap https://www.arabiaweather.com/en/locations-sitemap.xml
sitemap https://www.arabiaweather.com/news-sitemap.xml
sitemap https://www.arabiaweather.com/events-sitemap.xml
sitemap https://www.arabiaweather.com/others-sitemap.xml

Comments

  • robots.txt