Log In Sign Up

secure.justanswer.com
robots.txt

Robots Exclusion Standard data for secure.justanswer.com

Resource Scan

Scan Details

Site Domain secure.justanswer.com
Base Domain justanswer.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-29T16:39:40+00:00
Next Scan 2024-10-13T16:39:40+00:00

Last Successful Scan

Scanned2024-08-22T15:03:27+00:00
URL https://secure.justanswer.com/robots.txt
Domain IPs 104.16.42.9, 104.16.43.9
Response IP 104.16.42.9
Found Yes
Hash e1f367af0940ba500bd6e895adfab649a39fc7377b6274f6636ec1c0cfbe2903
SimHash 0a8512d84438

Groups

xombot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

zing-bottabot
zing-bottabot/2.0

Rule Path
Disallow /

goscraper

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

turnitin

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /App_Controls/
Disallow /LS/
Disallow /misc/
Disallow /modules/
Disallow /profiles/
Disallow /sites/
Disallow /themes/
Disallow /img/$
Disallow /CHANGELOG.txt
Disallow /cron.php
Disallow /INSTALL.mysql.txt
Disallow /INSTALL.pgsql.txt
Disallow /install.php
Disallow /INSTALL.txt
Disallow /LICENSE.txt
Disallow /MAINTAINERS.txt
Disallow /update.php
Disallow /UPGRADE.txt
Disallow /xmlrpc.php
Disallow /de/
Disallow /ja/
Disallow /es/
Disallow /en-gb/
Disallow /admin/
Disallow /archives/
Disallow /comment/reply/
Disallow /contact/
Disallow /fling/
Disallow /fraud-examiner/
Disallow /ja_services/
Disallow /logout/
Disallow /node/add/
Disallow /processes/
Disallow /search/
Disallow /user/register/
Disallow /user/password/
Disallow /user/login/
Disallow /?q=admin%2F
Disallow /?q=comment%2Freply%2F
Disallow /?q=contact%2F
Disallow /?q=logout%2F
Disallow /?q=node%2Fadd%2F
Disallow /?q=search%2F
Disallow /?q=user%2Fpassword%2F
Disallow /?q=user%2Fregister%2F
Disallow /?q=user%2Flogin%2F
Disallow /boost_stats.php
Disallow /disclaimer.html
Disallow /account/
Disallow /billing/
Disallow /payment/
Disallow /new-question/
Disallow /email_notify_confirm.aspx
Disallow /errorfile500.aspx
Disallow /expert/info_submit.aspx
Disallow /insufficient-permission.aspx
Disallow /my-questions.aspx
Disallow /pm/new_message.aspx
Disallow /question/accepted-question.aspx
Disallow /question/disclaimer.aspx
Disallow /question/qa.aspx
Disallow /ratings.aspx
Disallow /report_post.aspx
Disallow /unsubscribe.aspx
Disallow /login.aspx
Disallow /feedback/leave-feedback.aspx
Disallow /register.aspx
Disallow /consumer%20electronics/?
Disallow /consumer%20protection?
Disallow /classic-cars/classic%20corvette?
Disallow /australia-law?
Disallow /australia-law/?
Disallow /anwalt/?
Disallow /medizin/?
Disallow /law/l?
Disallow /law/r?
Disallow /cash-registers/cash-register?
Disallow /electronics/cash-register/cash-register?
Disallow /electronics/printers-and-office/Verifone/?
Disallow /boat-mechanics?
Disallow /car-mechanics?
Disallow /mental-health/counselors/?
Disallow /homework/writing?
Disallow /homework/math?
Disallow /homework/math/college-math-homework?
Disallow /homework/math/advanced-math-homework?
Allow /processes/bundle/BundleContent.ashx
Allow /processes/css.ashx
Allow /processes/js.ashx
Allow /processes/funnel/VirtualAssistantService.asmx/GetAssistantProfile
Allow /processes/funnel/assistant-profile.ashx
Allow /processes/expert/expert-feedback/ExpertFeedbackStatisticsService.asmx/GetSpecificFeedbackStatistics

*

Rule Path
Disallow /App_Controls/
Disallow /LS/
Disallow /misc/
Disallow /modules/
Disallow /profiles/
Disallow /sites/
Disallow /themes/
Disallow /img/$
Disallow /CHANGELOG.txt
Disallow /cron.php
Disallow /INSTALL.mysql.txt
Disallow /INSTALL.pgsql.txt
Disallow /install.php
Disallow /INSTALL.txt
Disallow /LICENSE.txt
Disallow /MAINTAINERS.txt
Disallow /update.php
Disallow /UPGRADE.txt
Disallow /xmlrpc.php
Disallow /de/
Disallow /ja/
Disallow /es/
Disallow /en-gb/
Disallow /admin/
Disallow /archives/
Disallow /comment/reply/
Disallow /contact/
Disallow /fling/
Disallow /fraud-examiner/
Disallow /ja_services/
Disallow /logout/
Disallow /node/add/
Disallow /processes/
Disallow /search/
Disallow /user/register/
Disallow /user/password/
Disallow /user/login/
Disallow /?q=admin%2F
Disallow /?q=comment%2Freply%2F
Disallow /?q=contact%2F
Disallow /?q=logout%2F
Disallow /?q=node%2Fadd%2F
Disallow /?q=search%2F
Disallow /?q=user%2Fpassword%2F
Disallow /?q=user%2Fregister%2F
Disallow /?q=user%2Flogin%2F
Disallow /boost_stats.php
Disallow /disclaimer.html
Disallow /account/
Disallow /billing/
Disallow /payment/
Disallow /new-question/
Disallow /email_notify_confirm.aspx
Disallow /errorfile500.aspx
Disallow /expert/info_submit.aspx
Disallow /insufficient-permission.aspx
Disallow /my-questions.aspx
Disallow /pm/new_message.aspx
Disallow /question/accepted-question.aspx
Disallow /question/disclaimer.aspx
Disallow /question/qa.aspx
Disallow /ratings.aspx
Disallow /report_post.aspx
Disallow /unsubscribe.aspx
Disallow /login.aspx
Disallow /feedback/leave-feedback.aspx
Disallow /register.aspx
Disallow /consumer%20electronics/?
Disallow /consumer%20protection?
Disallow /classic-cars/classic%20corvette?
Disallow /australia-law?
Disallow /australia-law/?
Disallow /anwalt/?
Disallow /medizin/?
Disallow /law/l?
Disallow /law/r?
Disallow /cash-registers/cash-register?
Disallow /electronics/cash-register/cash-register?
Disallow /electronics/printers-and-office/Verifone/?
Disallow /boat-mechanics?
Disallow /car-mechanics?
Disallow /mental-health/counselors/?
Disallow /homework/writing?
Disallow /homework/math?
Disallow /homework/math/college-math-homework?
Disallow /homework/math/advanced-math-homework?
Allow /processes/bundle/BundleContent.ashx
Allow /processes/css.ashx
Allow /processes/js.ashx
Allow /processes/funnel/VirtualAssistantService.asmx/GetAssistantProfile
Allow /processes/funnel/assistant-profile.ashx
Allow /processes/expert/expert-feedback/ExpertFeedbackStatisticsService.asmx/GetSpecificFeedbackStatistics

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://www.justanswer.com/sitemap.xml
sitemap https://www.justanswer.com/sitemap.xml
Back to top

Comments

  • Directories
  • Files
  • Paths (clean URLs)
  • Paths (no clean URLs)
  • Secure and Error pages
  • 404s
  • Sitemaps
  • Exceptions
  • Directories
  • Files
  • Paths (clean URLs)
  • Paths (no clean URLs)
  • Secure and Error pages
  • 404s
  • Sitemaps
  • Exceptions
Back to top