Log In Sign Up

therehablab.com
robots.txt

Robots Exclusion Standard data for therehablab.com

Resource Scan

Scan Details

Site Domain therehablab.com
Base Domain therehablab.com
Scan Status Ok
Last Scan2025-12-06T08:46:35+00:00
Next Scan 2026-01-05T08:46:35+00:00

Last Scan

Scanned2025-12-06T08:46:35+00:00
URL https://therehablab.com/robots.txt
Redirect https://www.therehablab.com/robots.txt
Redirect Domain www.therehablab.com
Redirect Base therehablab.com
Domain IPs 192.124.249.40
Redirect IPs 192.124.249.40
Response IP 192.124.249.40
Found Yes
Hash b29a481dc0c6d98850b5cf9fb0cd6f297401a09b9f8a951761e622610c2a9314
SimHash 8dc3940b6adb

Groups

semrushbot

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow

*

Rule Path
Disallow /.sucuriquarantine/
Disallow /.well-known/
Allow /assets/css/
Allow /assets/fonts/
Allow /assets/images/
Allow /assets/pdf/
Allow /assets/videos/
Disallow /uploads/
Disallow /home
Disallow /profile
Disallow /clients
Disallow /suggest
Disallow /logged_out
Disallow /logout_success
Disallow /contact_success
Disallow /contact_error
Disallow /subscription_success
Disallow /subscription_error
Disallow /subscription_already
Disallow /subscription_fail
Disallow /addmoreusers
Disallow /addmoreusers_success
Disallow /addmoreusers_fail
Disallow /request_quote
Disallow /quote_success
Disallow /register
Disallow /register_success
Disallow /request_success
Disallow /trial_survey
Disallow /trial_success
Disallow /trial_fail
Disallow /survey
Disallow /survey_success
Disallow /report
Disallow /report_success
Disallow /error_404
Disallow /updates_new
Disallow */logged_out
Disallow */logout_success
Disallow */contact_success
Disallow */contact_error
Disallow */subscription_success
Disallow */subscription_error
Disallow */subscription_already
Disallow */subscription_fail
Disallow */addmoreusers
Disallow */addmoreusers_success
Disallow */addmoreusers_fail
Disallow */request_quote
Disallow */quote_success
Disallow */register
Disallow */register_success
Disallow */request_success
Disallow */trial_survey
Disallow */trial_success
Disallow */trial_fail
Disallow */survey
Disallow */survey_success
Disallow */report
Disallow */report_success
Disallow */error_404
Disallow */updates_new
Disallow /portal?key=
Back to top

Other Records

Field Value
sitemap https://www.therehablab.com/ko-KR/sitemap.xml
sitemap https://www.therehablab.com/ru-RU/sitemap.xml
sitemap https://www.therehablab.com/sitemapindex.xml
Back to top

Comments

  • Disallow: /application/
  • Disallow: /assets/js/
  • Disallow: /assets/vendor/
  • Disallow: /site-images/
  • Disallow: /system/
  • Disallow pages that offer no utility for search engines and their foriegn language versions
  • Disallow specific query strings for portal, but be aware this is not a standard approach.
  • This may not block all variations of /portal?key= but could be respected by some crawlers.
Back to top