basilhadad.com
robots.txt

Robots Exclusion Standard data for basilhadad.com

Resource Scan

Scan Details

Site Domain basilhadad.com
Base Domain basilhadad.com
Scan Status Ok
Last Scan2025-11-21T05:13:06+00:00
Next Scan 2025-12-21T05:13:06+00:00

Last Scan

Scanned2025-11-21T05:13:06+00:00
URL https://basilhadad.com/robots.txt
Redirect http://www.basilhadad.com/robots.txt
Redirect Domain www.basilhadad.com
Redirect Base basilhadad.com
Domain IPs 192.99.206.41
Redirect IPs 192.99.206.41
Response IP 192.99.206.41
Found Yes
Hash a30bab131a2c6b7a3ccfa0678d78aa88903c83961373701e23c20410cfc6ecbf
SimHash 70b441889ad4

Groups

*

Rule Path
Disallow /*/$
Disallow /aggregator/
Disallow /login_page
Disallow /appointment_form/
Disallow /email_listing/
Disallow /favorite_properties/
Disallow /?q=aggregator%2F
Disallow /?q=login_page
Disallow /?q=appointment_form%2F
Disallow /?q=email_listing%2F
Disallow /?q=favorite_properties%2F
Disallow /css/images/default/
Disallow /themes/hl_green_gold/images/
Disallow /themes/homelife/images/mapicons/
Disallow /homelife_university.hlr
Disallow /?q=constitution.hlr
Disallow /taxonomy/
Disallow /*recent_sales_area*
Disallow /*property_history*
Disallow /*price_comparison*
Disallow /contact_agent/
Disallow /contact_broker/
Disallow /mobile_contact/
Disallow /includes/
Disallow /active_now/save
Disallow /system/ajax
Disallow /autologout_check_by_d4
Allow /misc/
Allow /modules/
Disallow /profiles/
Disallow /scripts/
Allow /themes/
Allow /themes/urban/css/style.css
Allow /themes/bannertheme/css/
Allow /themes/bannertheme/js/
Allow /themes/bannertheme/theme2/css/style.css
Allow /themes/bannertheme/theme4/css/style.css
Allow /themes/bannertheme/theme5/css/style.css
Allow /themes/bannertheme/theme6/
Disallow /themes/bannertheme/theme6/js/
Allow /modules/widgets
Allow /themes/bannertheme/css/flexnav.css
Allow /misc/drupal.css
Allow /themes/mobile/css/all.css
Allow /themes/bannertheme/nivo/nivo-slider.css
Allow /node/add/
Disallow /CHANGELOG.txt
Disallow /cron.php
Disallow /INSTALL.mysql.txt
Disallow /INSTALL.pgsql.txt
Disallow /INSTALL.sqlite.txt
Disallow /install.php
Disallow /INSTALL.txt
Disallow /LICENSE.txt
Disallow /precondo_email_listing/
Disallow /MAINTAINERS.txt
Disallow /update.php
Disallow /UPGRADE.txt
Disallow /xmlrpc.php
Disallow /admin/
Disallow /comment/reply/
Disallow /filter/tips/
Disallow /search/
Disallow /user/register/
Disallow /user/password/
Disallow /user/login/
Disallow /user/logout/
Disallow /_ask_questions_textimage/
Disallow /?q=admin%2F
Disallow /?q=comment%2Freply%2F
Disallow /?q=filter%2Ftips%2F
Disallow /?q=node%2Fadd%2F
Disallow /?q=search%2F
Disallow /?q=user%2Fpassword%2F
Disallow /?q=user%2Fregister%2F
Disallow /?q=user%2Flogin%2F
Disallow /?q=user%2Flogout%2F
Disallow /?q=getImageNew%2F
Disallow /getImageNew/
Disallow /user/register
Disallow /user/password
Disallow /user/login
Disallow /user/logout
Disallow /visitor
Disallow /visitor*
Disallow /protected/login*
Disallow /protectedpropertydetails/register_page*
Disallow /google_api_script
Disallow /*/listing-info$
Disallow /properties/allinfo
Disallow /get-property-detail-info

yandeximages

Rule Path
Disallow /

Comments

  • Crawl-Delay: 30
  • Files
  • Paths (clean URLs)
  • Paths (no clean URLs)