Log In Sign Up

wasalt.sa
robots.txt

Robots Exclusion Standard data for wasalt.sa

Resource Scan

Scan Details

Site Domain wasalt.sa
Base Domain wasalt.sa
Scan Status Ok
Last Scan2025-08-22T12:59:50+00:00
Next Scan 2025-09-05T12:59:50+00:00

Last Scan

Scanned2025-08-22T12:59:50+00:00
URL https://wasalt.sa/robots.txt
Domain IPs 104.26.12.36, 104.26.13.36, 172.67.69.154, 2606:4700:20::681a:c24, 2606:4700:20::681a:d24, 2606:4700:20::ac43:459a
Response IP 172.67.69.154
Found Yes
Hash 0e8db2a52a5ae333ce82ab0a99d5395335390b993e1935e9509f1b21e01086e1
SimHash 51789a134db1

Groups

chatgpt-user

Rule Path
Allow /search

anthropic-ai

Rule Path
Allow /search

perplexitybot

Rule Path
Allow /search

*

Rule Path
Allow /
Disallow /search
Disallow /cdn-cgi/rum
Back to top

Other Records

Field Value
sitemap https://cdn.wasalt.sa/sitemap/static_sitemap_en_sa.xml.gz
sitemap https://cdn.wasalt.sa/sitemap/product_sitemap_en_sa.xml.gz
sitemap https://cdn.wasalt.sa/sitemap/static_sitemap_ar_sa.xml.gz
sitemap https://cdn.wasalt.sa/sitemap/product_sitemap_ar_sa.xml.gz
sitemap https://cdn.wasalt.sa/sitemap/category_sitemap_ar_sa.xml.gz
sitemap https://cdn.wasalt.sa/sitemap/category_sitemap_en_sa.xml.gz
sitemap https://cdn.wasalt.sa/sitemap/rental_pdp_sitemap_en_sa.xml.gz
sitemap https://cdn.wasalt.sa/sitemap/rental_pdp_sitemap_ar_sa.xml.gz
sitemap https://cdn.wasalt.sa/sitemap/rental_srp_sitemap_en_sa.xml.gz
sitemap https://cdn.wasalt.sa/sitemap/rental_srp_sitemap_ar_sa.xml.gz
Back to top

Comments

  • Allow selected AI bots to access internal search results
  • Default rules for all other bots
  • Note: We're allowing AI access to most areas to support future integrations - no additional restrictions are needed for now.
Back to top