Log In Sign Up

bahrain.yallamotor.com
robots.txt

Robots Exclusion Standard data for bahrain.yallamotor.com

Resource Scan

Scan Details

Site Domain bahrain.yallamotor.com
Base Domain yallamotor.com
Scan Status Ok
Last Scan2025-03-07T03:02:12+00:00
Next Scan 2025-03-14T03:02:12+00:00

Last Scan

Scanned2025-03-07T03:02:12+00:00
URL https://bahrain.yallamotor.com/robots.txt
Domain IPs 172.66.40.62, 172.66.43.194, 2606:4700:3108::ac42:283e, 2606:4700:3108::ac42:2bc2
Response IP 172.66.43.194
Found Yes
Hash e8070a7693b86055d2505257e38311d71b16a31efcefcdbfa04a5c7831711c41
SimHash 9a154aad6775

Groups

grapeshot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

*

Rule Path
Disallow /user/*
Disallow /sales/*
Disallow /conversations/*
Disallow /new-cars/offers/*
Allow /used-cars/search
Allow /new-cars/search
Allow /used-cars/certified-pre-owned/search
Disallow /*/sc_
Disallow /*/tr_
Disallow /*/cy_
Disallow /*/pr_
Disallow /*/yr_
Disallow /*/km_
Disallow /*/dt_
Disallow /*/ex_
Disallow /*/es_
Disallow /*/sh_
Disallow /*/so_
Allow /news
Allow /news/uae
Allow /news/ksa
Allow /news/egypt
Allow /news/qatar
Allow /news/oman
Allow /news/kuwait
Allow /news/bahrain
Back to top

Other Records

Field Value
sitemap https://www.yallamotor.com/sitemap.xml
sitemap https://bahrain.yallamotor.com/uploads/sitemaps/daily/bahrain/sitemap.xml
sitemap https://bahrain.yallamotor.com/uploads/sitemaps/weekly/bahrain/sitemap.xml
sitemap https://bahrain.yallamotor.com/uploads/sitemaps/daily/bahrain-ar/sitemap.xml
sitemap https://bahrain.yallamotor.com/uploads/sitemaps/weekly/bahrain-ar/sitemap.xml
Back to top

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • Search Pages
  • Allow important search
  • Disallow URLs containing specific filtering patterns
  • News Pages
Back to top