Log In Sign Up

souq-olx.com
robots.txt

Robots Exclusion Standard data for souq-olx.com

Resource Scan

Scan Details

Site Domain souq-olx.com
Base Domain souq-olx.com
Scan Status Ok
Last Scan2024-05-14T13:50:48+00:00
Next Scan 2024-05-21T13:50:48+00:00

Last Scan

Scanned2024-05-14T13:50:48+00:00
URL https://souq-olx.com/robots.txt
Redirect https://www.souq-olx.com/robots.txt
Redirect Domain www.souq-olx.com
Redirect Base souq-olx.com
Domain IPs 104.21.74.3, 172.67.194.55, 2606:4700:3034::ac43:c237, 2606:4700:3036::6815:4a03
Redirect IPs 104.21.74.3, 172.67.194.55, 2606:4700:3034::ac43:c237, 2606:4700:3036::6815:4a03
Response IP 172.67.194.55
Found Yes
Hash b89974417c8a835ae5277a105e8fc251fc327c7d3234945b38ec4c284891f7dc
SimHash 38950949cc52

Groups

googlebot

Rule Path
Allow /

*

Rule Path
Disallow
Disallow /cgi-bin/
Disallow /search
Disallow /search?updated-min=
Disallow /search?updated-max=
Disallow /user/membership
Disallow /user/my-favourites
Disallow /user/profile
Disallow /user/change-password
Disallow /user/login-register
Disallow /user/home
Disallow /index/about
Disallow /cgi-bin/
Disallow /admin/
Disallow /user/support
Disallow /index/terms/1
Disallow /ajax/
Disallow /adminpanel/
Disallow /account/
Disallow /myaccount/
Disallow /adprint/
Disallow /ad/leaflet/
Disallow /ad/contact/
Disallow /payment/
Disallow /adding/confirm/
Disallow /adding/confirmpage/
Disallow /i2/ad/abuse/
Disallow /m/ad/abuse/
Disallow /admin/system/home
Disallow /user/reset-password
Disallow /?q=admin%2F
Disallow /?q=comment%2Freply%2F
Disallow /?q=filter%2Ftips%2F
Disallow /?q=node%2Fadd%2F
Disallow /?q=search%2F
Disallow /?q=user%2Fpassword%2F
Disallow /?q=user%2Fregister%2F
Disallow /?q=user%2Flogin%2F
Disallow /?q=user%2Flogout%2F
Disallow /admin/
Disallow /comment/reply/
Disallow /filter/tips/
Disallow /node/add/
Disallow /search/
Disallow /user/other-listing/
Disallow /user/register/
Disallow /user/password/
Disallow /user/login/
Disallow /user/logout/
Disallow /CHANGELOG.txt
Disallow /cron.php
Disallow /INSTALL.mysql.txt
Disallow /INSTALL.pgsql.txt
Disallow /INSTALL.sqlite.txt
Disallow /install.php
Disallow /INSTALL.txt
Disallow /LICENSE.txt
Disallow /MAINTAINERS.txt
Disallow /update.php
Disallow /UPGRADE.txt
Disallow /location/country/
Disallow /location/state/
Allow /
Allow /eg/category/items/
Allow /kw/category/items/
Allow /om/category/items/
Allow /jo/category/items/
Allow /ae/category/items/
Allow /bh/category/items/
Allow /qa/category/items/
Allow /sa/category/items/
Allow /us/category/items/
Allow /lb/category/items/
Allow /category/items/
Allow /item/view/
Allow /?hl=
Allow /?hl=*&gws_rd=ssl$
Allow /%26category/
Allow /%26limit
Allow /%26item
Allow /?limit
Allow /?item
Allow /?view
Allow /?route=checkout%2F
Allow /?route=account%2F
Allow /?route=product%2Fsearch
Allow /?route=affiliate%2F
Allow /?route=checkout%2F
Allow /?route=account%2F
Allow /?item%2Fview%2Fsearch
Allow /?page
Allow /%26create%3D1
Allow /?route=information%2Fcontact
Allow /?route=affiliate%2F
Allow /?keyword
Allow /?av
Allow /go/
Allow /?catalog%2F
Allow /vqmod/
Allow /image/

adsbot-google

Rule Path
Disallow /maps/api/js/
Allow /maps/api/js
Disallow /maps/api/place/js/
Disallow /maps/api/staticmap
Disallow /maps/api/streetview

twitterbot

Rule Path
Allow /imgres

facebookexternalhit

Rule Path
Allow /imgres
Back to top

Other Records

Field Value
sitemap https://www.souq-olx.com/sitemap.xml
sitemap https://www.souq-olx.com/images_sitemap.xml
sitemap https://www.souq-olx.com/ror.xml
sitemap https://www.souq-olx.com/sitemap_mobile.xml
sitemap https://www.souq-olx.com/sitemap_images.xml
sitemap https://www.souq-olx.com/sitemap_news.xml
sitemap https://www.souq-olx.com/feed_rss.xml
Back to top

Comments

  • AdsBot
  • Certain social media sites are whitelisted to allow crawlers to access page markup when links to google.com/imgres* are shared. To learn more, please contact images-robots-whitelist@google.com.
Back to top