Log In Sign Up

souqshare.com
robots.txt

Robots Exclusion Standard data for souqshare.com

Resource Scan

Scan Details

Site Domain souqshare.com
Base Domain souqshare.com
Scan Status Ok
Last Scan2026-02-01T12:36:54+00:00
Next Scan 2026-02-08T12:36:54+00:00

Last Scan

Scanned2026-02-01T12:36:54+00:00
URL https://souqshare.com/robots.txt
Domain IPs 162.254.34.26
Response IP 162.254.34.26
Found Yes
Hash 9f8e00e2b359f29e42f7b0ad1801aa8683494cccc663c46344d0a08f19ec8ff4
SimHash 4d187a4ff434

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /api/
Disallow /config/
Disallow /includes/
Disallow /migrations/
Disallow /database/
Disallow /user/settings.php
Disallow /user/messages.php
Disallow /user/wallet.php
Disallow /checkout.php
Disallow /login.php
Disallow /register.php
Disallow /logout.php
Disallow /forgot-password.php
Allow /index.php
Allow /ads.php
Allow /ad.php
Allow /category.php
Allow /search.php
Allow /about.php
Allow /contact.php
Allow /privacy.php
Allow /terms.php
Allow /sellers.php
Allow /profile.php
Allow /assets/
Allow /uploads/

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 0

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://souqshare.com/sitemap.php
sitemap https://souqshare.com/sitemap.php?lang=ar
sitemap https://souqshare.com/sitemap.php?lang=en
Back to top

Comments

  • Robots.txt for SOUQ SHARE
  • https://www.robotstxt.org/
  • Block admin area
  • Block user private areas
  • Allow important pages
  • Allow assets
  • Sitemaps - Both languages
  • Crawl-delay (optional for polite crawling)
  • Google specific
  • Bing specific
Back to top