mathworks.com
robots.txt

Robots Exclusion Standard data for mathworks.com

Resource Scan

Scan Details

Site Domain mathworks.com
Base Domain mathworks.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-05T06:07:51+00:00
Next Scan 2024-12-05T06:07:51+00:00

Last Successful Scan

Scanned2024-09-30T06:06:35+00:00
URL https://mathworks.com/robots.txt
Redirect https://www.mathworks.com/robots.txt
Redirect Domain www.mathworks.com
Redirect Base mathworks.com
Domain IPs 144.212.130.17, 144.212.244.17
Redirect IPs 23.203.74.33
Response IP 23.222.138.88
Found Yes
Hash dae8248f43a284b91a261c7e7344fa94eb72e650fd8ac06058ac8062ba1387e4
SimHash 4f001131974b

Groups

*

Rule Path
Disallow *.html?file=%2Fproducts%2Fdemos%2Fshipping*
Disallow */shared-content/*
Disallow */support/books/index_new_books/jcr%3Acontent.search.json
Disallow */support/books/search/jcr%3Acontent.search.json
Disallow /_site_doc
Disallow /academia/books/members.html
Disallow /access/pagenotfound.html
Disallow /accesslogin
Disallow /add-ons/
Disallow /brandguide
Disallow /campaigns/portals/
Disallow /campaigns/products/trials/forms/
Disallow /campaigns/road-map
Disallow /cgi-bin
Disallow /company/events/conferences/matlab-expo-2017-china.html
Disallow /company/events/conferences/matlab-expo-2017-germany.html
Disallow /company/events/conferences/matlab-expo-2017-japan.html
Disallow /company/events/conferences/matlab-expo-2017-switzerland.html
Disallow /company/events/conferences/matlab-expo-2017-uk.html
Disallow /company/events/conferences/matlab-expo-2017-us.html
Disallow /company/events/conferences/matlab-expo-2018-france.html
Disallow /company/events/conferences/matlab-expo-2018-italy.html
Disallow /company/events/conferences/matlab-expo-2018-spain.html
Disallow /company/events/mab
Disallow /company/events/research-summit
Disallow /company/events/seminars/locations/*
Disallow /company/legal/
Disallow /content/dam/mathworks/ebook/gated/
Disallow /content/dam/mathworks/mathworks-dot-com/images/company/jobs
Disallow /content/dam/mathworks/mathworks-dot-com/products/files/industry-model-code-testing.pdf
Disallow /content/dam/mathworks/price-lists/
Disallow /content/dam/mathworks/white-paper/gated/
Disallow /content/mathworks
Disallow /contest/*/view_submission.html
Disallow /develop/
Allow /develop/review/
Disallow /help/deeplearning/index.html%3B*
Disallow /help/pdf_doc/
Disallow /help/releases/
Disallow /includes_content/missing_handler/view_map.html
Disallow /licensecenter/classroom/
Disallow /matlabcentral/answers/?
Allow /matlabcentral/answers/?page=*
Disallow /matlabcentral/answers/?page=*&amp%3B*
Allow /matlabcentral/answers/?page=*&amp%3Bs_tid=gn_mlc_ans_ans
Allow /matlabcentral/answers/?s_tid=gn_mlc_ans&amp%3Bpage=*
Allow /matlabcentral/answers/?s_tid=gn_mlc_ans_ans
Disallow /matlabcentral/answers/?s_tid=gn_mlc_ans_ans&amp%3B*
Disallow /matlabcentral/answers/?s_tid=gn_mlc_ans_ans&amp%3B*page=*&amp%3B*
Disallow /matlabcentral/answers/uploaded_files/*
Disallow /matlabcentral/answers/questions*
Disallow /matlabcentral/cody/activities
Disallow /matlabcentral/cody/players/*
Disallow /matlabcentral/cody/problems/*/players
Disallow /matlabcentral/cody/problems/*/solutions
Disallow /matlabcentral/cody/problems/*/solutions/*
Disallow /matlabcentral/cody/solutions
Disallow /matlabcentral/fileexchange/*?*download=true*
Disallow /matlabcentral/fileexchange/?
Allow /matlabcentral/fileexchange/?term=type%3Aapp
Allow /matlabcentral/fileexchange/?term=type%3Aapp&amp%3Bpage=*
Disallow /matlabcentral/fileexchange/?term=type%3Aapp*&amp%3B*
Allow /matlabcentral/fileexchange/?term=type%3Aclass
Allow /matlabcentral/fileexchange/?term=type%3Aclass&amp%3Bpage=*
Disallow /matlabcentral/fileexchange/?term=type%3Aclass*&amp%3B*
Allow /matlabcentral/fileexchange/?term=type%3Adriver
Allow /matlabcentral/fileexchange/?term=type%3Adriver&amp%3Bpage=*
Disallow /matlabcentral/fileexchange/?term=type%3Adriver*&amp%3B*
Allow /matlabcentral/fileexchange/?term=type%3Aexample
Allow /matlabcentral/fileexchange/?term=type%3Aexample&amp%3Bpage=*
Disallow /matlabcentral/fileexchange/?term=type%3Aexample*&amp%3B*
Allow /matlabcentral/fileexchange/?term=type%3Afunction
Allow /matlabcentral/fileexchange/?term=type%3Afunction&amp%3Bpage=*
Disallow /matlabcentral/fileexchange/?term=type%3Afunction*&amp%3B*
Allow /matlabcentral/fileexchange/?term=type%3Amodel
Allow /matlabcentral/fileexchange/?term=type%3Amodel&amp%3Bpage=*
Disallow /matlabcentral/fileexchange/?term=type%3Amodel*&amp%3B*
Allow /matlabcentral/fileexchange/?term=type%3Ascript
Allow /matlabcentral/fileexchange/?term=type%3Ascript&amp%3Bpage=*
Disallow /matlabcentral/fileexchange/?term=type%3Ascript*&amp%3B*
Allow /matlabcentral/fileexchange/?term=type%3Avideo
Allow /matlabcentral/fileexchange/?term=type%3Avideo&amp%3Bpage=*
Disallow /matlabcentral/fileexchange/?term=type%3Avideo*&amp%3B*
Disallow /matlabcentral/fileexchange/authors/?
Allow /matlabcentral/fileexchange/authors/?page=*
Disallow /matlabcentral/fileexchange/authors/?page=*&amp%3B*
Disallow /matlabcentral/fileexchange/authors/contact/
Disallow /matlabcentral/fileexchange/download.do
Disallow /matlabcentral/fileexchange/feed.atom
Disallow /matlabcentral/fileexchange/feedbacks
Disallow /matlabcentral/fileexchange/index
Disallow /matlabcentral/fileexchange/tags
Disallow /matlabcentral/fileexchange/tags
Disallow /matlabcentral/mlc-downloads/
Disallow /matlabcentral/profile/api/v1/active/*
Disallow /matlabcentral/profile/contact/*
Disallow /moler/ncm-download.html
Disallow /products/connections/product_detail/product_35486.html
Disallow /products/connections/trials
Disallow /products/demos/shipping/
Disallow /products/demos/shipping_ja/
Disallow /products/matlab-home-for-enterprise/
Disallow /products/new_products/r2017b-pr-transition.html
Disallow /products/trials/
Disallow /programs/nrd/
Disallow /programs/products/files/
Disallow /programs/videos/video-feedback.html
Disallow /quality/
Disallow /searchresults*
Disallow /searchresults/
Allow /searchresults/*videos_all*videos_jp*facets
Disallow /store/link/
Disallow /support/2010a/
Disallow /support/2010b/
Disallow /support/2011a/
Disallow /support/2011b/
Disallow /support/2012a/
Disallow /support/2012b/
Disallow /support/2013a/
Disallow /support/2013b/
Disallow /support/2014a/
Disallow /support/2014b/
Disallow /support/2015a/
Disallow /support/2015b/
Disallow /support/beta/
Disallow /support/books/index_new_books.html
Disallow /support/bugreports/
Disallow /support/faq/r2017a_pr_bugs.html
Disallow /support/faq/r2017b_pr_bugs.html
Disallow /support/pricing/
Disallow /tagteam
Disallow /test/
Disallow /videos/*.feedback.html
Disallow /videos/hardware-in-the-loop-simulation-with-simulink-real-time-using-plcs-and-ethernetip-protocol-for-validating-industrial-automation-control-algorithms-96697.html
Disallow /videos/raw-ethernet-communication-support-from-simulink-real-time-96619.html
Disallow /videos/real-time-udp-communication-support-99895.html
Disallow /videos/video-feedback.html
Disallow /videos/video-feedback-confirmation.html
Disallow /web_downloads

baiduspider

Rule Path
Disallow /academia/books/search.html
Disallow /company/user_stories/search.html
Disallow /company/newsletters/search.html
Disallow /hardware-support.html
Disallow /hardware-support/instrument-control-toolbox/drivers-search.html
Disallow /matlabcentral/simbiology/search.html
Disallow /matlabcentral/topics/distance-learning/search.html
Disallow /matlabcentral/topics/power-electronics-control/search.html
Disallow /products/connections/search-products.html
Disallow /products/connections/search-services.html
Disallow /search.html
Disallow /support/search.html
Disallow /videos/search.html
Disallow /searchresults*
Disallow /searchresults/

slurp

Rule Path
Disallow /company/aboutus/policies_statements/travel.html

Other Records

Field Value
crawl-delay 60

*

Rule Path
Disallow /de/*.html?file=%2Fproducts%2Fdemos%2Fshipping*
Disallow /de/*/shared-content/*
Disallow /de/*/support/books/index_new_books/jcr%3Acontent.search.json
Disallow /de/*/support/books/search/jcr%3Acontent.search.json
Disallow /de/_site_doc
Disallow /de/academia/books/members.html
Disallow /de/access/pagenotfound.html
Disallow /de/accesslogin
Disallow /de/add-ons/
Disallow /de/brandguide
Disallow /de/campaigns/portals/
Disallow /de/campaigns/products/trials/forms/
Disallow /de/campaigns/road-map
Disallow /de/cgi-bin
Disallow /de/company/events/conferences/matlab-expo-2017-china.html
Disallow /de/company/events/conferences/matlab-expo-2017-germany.html
Disallow /de/company/events/conferences/matlab-expo-2017-japan.html
Disallow /de/company/events/conferences/matlab-expo-2017-switzerland.html
Disallow /de/company/events/conferences/matlab-expo-2017-uk.html
Disallow /de/company/events/conferences/matlab-expo-2017-us.html
Disallow /de/company/events/conferences/matlab-expo-2018-france.html
Disallow /de/company/events/conferences/matlab-expo-2018-italy.html
Disallow /de/company/events/conferences/matlab-expo-2018-spain.html
Disallow /de/company/events/mab
Disallow /de/company/events/research-summit
Disallow /de/company/events/seminars/locations/*
Disallow /de/company/legal/
Disallow /de/content/dam/mathworks/mathworks-dot-com/images/company/jobs
Disallow /de/content/dam/mathworks/mathworks-dot-com/products/files/industry-model-code-testing.pdf
Disallow /de/content/dam/mathworks/price-lists/
Disallow /de/content/mathworks
Disallow /de/contest/*/view_submission.html
Disallow /de/develop/
Allow /de/develop/review/
Disallow /de/help/deeplearning/index.html%3B*
Disallow /de/help/pdf_doc/
Disallow /de/help/releases/
Disallow /de/includes_content/missing_handler/view_map.html
Disallow /de/licensecenter/classroom/
Disallow /de/matlabcentral/answers/?
Allow /de/matlabcentral/answers/?page=*
Disallow /de/matlabcentral/answers/?page=*&amp%3B*
Allow /de/matlabcentral/answers/?page=*&amp%3Bs_tid=gn_mlc_ans_ans
Allow /de/matlabcentral/answers/?s_tid=gn_mlc_ans&amp%3Bpage=*
Allow /de/matlabcentral/answers/?s_tid=gn_mlc_ans_ans
Disallow /de/matlabcentral/answers/?s_tid=gn_mlc_ans_ans&amp%3B*
Disallow /de/matlabcentral/answers/?s_tid=gn_mlc_ans_ans&amp%3B*page=*&amp%3B*
Disallow /de/matlabcentral/answers/uploaded_files/*
Disallow /de/matlabcentral/answers/questions*
Disallow /de/matlabcentral/cody/activities
Disallow /de/matlabcentral/cody/players/*
Disallow /de/matlabcentral/cody/problems/*/players
Disallow /de/matlabcentral/cody/problems/*/solutions
Disallow /de/matlabcentral/cody/problems/*/solutions/*
Disallow /de/matlabcentral/cody/solutions
Disallow /de/matlabcentral/fileexchange/*?*download=true*
Disallow /de/matlabcentral/fileexchange/?
Allow /de/matlabcentral/fileexchange/?term=type%3Aapp
Allow /de/matlabcentral/fileexchange/?term=type%3Aapp&amp%3Bpage=*
Disallow /de/matlabcentral/fileexchange/?term=type%3Aapp*&amp%3B*
Allow /de/matlabcentral/fileexchange/?term=type%3Aclass
Allow /de/matlabcentral/fileexchange/?term=type%3Aclass&amp%3Bpage=*
Disallow /de/matlabcentral/fileexchange/?term=type%3Aclass*&amp%3B*
Allow /de/matlabcentral/fileexchange/?term=type%3Adriver
Allow /de/matlabcentral/fileexchange/?term=type%3Adriver&amp%3Bpage=*
Disallow /de/matlabcentral/fileexchange/?term=type%3Adriver*&amp%3B*
Allow /de/matlabcentral/fileexchange/?term=type%3Aexample
Allow /de/matlabcentral/fileexchange/?term=type%3Aexample&amp%3Bpage=*
Disallow /de/matlabcentral/fileexchange/?term=type%3Aexample*&amp%3B*
Allow /de/matlabcentral/fileexchange/?term=type%3Afunction
Allow /de/matlabcentral/fileexchange/?term=type%3Afunction&amp%3Bpage=*
Disallow /de/matlabcentral/fileexchange/?term=type%3Afunction*&amp%3B*
Allow /de/matlabcentral/fileexchange/?term=type%3Amodel
Allow /de/matlabcentral/fileexchange/?term=type%3Amodel&amp%3Bpage=*
Disallow /de/matlabcentral/fileexchange/?term=type%3Amodel*&amp%3B*
Allow /de/matlabcentral/fileexchange/?term=type%3Ascript
Allow /de/matlabcentral/fileexchange/?term=type%3Ascript&amp%3Bpage=*
Disallow /de/matlabcentral/fileexchange/?term=type%3Ascript*&amp%3B*
Allow /de/matlabcentral/fileexchange/?term=type%3Avideo
Allow /de/matlabcentral/fileexchange/?term=type%3Avideo&amp%3Bpage=*
Disallow /de/matlabcentral/fileexchange/?term=type%3Avideo*&amp%3B*
Disallow /de/matlabcentral/fileexchange/authors/?
Allow /de/matlabcentral/fileexchange/authors/?page=*
Disallow /de/matlabcentral/fileexchange/authors/?page=*&amp%3B*
Disallow /de/matlabcentral/fileexchange/authors/contact/
Disallow /de/matlabcentral/fileexchange/download.do
Disallow /de/matlabcentral/fileexchange/feed.atom
Disallow /de/matlabcentral/fileexchange/feedbacks
Disallow /de/matlabcentral/fileexchange/index
Disallow /de/matlabcentral/fileexchange/tags
Disallow /de/matlabcentral/fileexchange/tags
Disallow /de/matlabcentral/mlc-downloads/
Disallow /de/matlabcentral/profile/api/v1/active/*
Disallow /de/matlabcentral/profile/contact/*
Disallow /de/moler/ncm-download.html
Disallow /de/products/connections/product_detail/product_35486.html
Disallow /de/products/connections/trials
Disallow /de/products/demos/shipping/
Disallow /de/products/demos/shipping_ja/
Disallow /de/products/matlab-home-for-enterprise/
Disallow /de/products/new_products/r2017b-pr-transition.html
Disallow /de/products/trials/
Disallow /de/programs/nrd/
Disallow /de/programs/products/files/
Disallow /de/programs/videos/video-feedback.html
Disallow /de/quality/
Disallow /de/searchresults*
Disallow /de/searchresults/
Allow /de/searchresults/*videos_all*videos_jp*facets
Disallow /de/store/link/
Disallow /de/support/2010a/
Disallow /de/support/2010b/
Disallow /de/support/2011a/
Disallow /de/support/2011b/
Disallow /de/support/2012a/
Disallow /de/support/2012b/
Disallow /de/support/2013a/
Disallow /de/support/2013b/
Disallow /de/support/2014a/
Disallow /de/support/2014b/
Disallow /de/support/2015a/
Disallow /de/support/2015b/
Disallow /de/support/beta/
Disallow /de/support/books/index_new_books.html
Disallow /de/support/bugreports/
Disallow /de/support/faq/r2017a_pr_bugs.html
Disallow /de/support/faq/r2017b_pr_bugs.html
Disallow /de/support/pricing/
Disallow /de/tagteam
Disallow /de/test/
Disallow /de/videos/*.feedback.html
Disallow /de/videos/hardware-in-the-loop-simulation-with-simulink-real-time-using-plcs-and-ethernetip-protocol-for-validating-industrial-automation-control-algorithms-96697.html
Disallow /de/videos/raw-ethernet-communication-support-from-simulink-real-time-96619.html
Disallow /de/videos/real-time-udp-communication-support-99895.html
Disallow /de/videos/video-feedback.html
Disallow /de/videos/video-feedback-confirmation.html
Disallow /de/web_downloads

baiduspider

Rule Path
Disallow /de/academia/books/search.html
Disallow /de/company/user_stories/search.html
Disallow /de/company/newsletters/search.html
Disallow /de/hardware-support.html
Disallow /de/hardware-support/instrument-control-toolbox/drivers-search.html
Disallow /de/matlabcentral/simbiology/search.html
Disallow /de/matlabcentral/topics/distance-learning/search.html
Disallow /de/matlabcentral/topics/power-electronics-control/search.html
Disallow /de/products/connections/search-products.html
Disallow /de/products/connections/search-services.html
Disallow /de/search.html
Disallow /de/support/search.html
Disallow /de/videos/search.html
Disallow /de/searchresults*
Disallow /de/searchresults/

slurp

Rule Path
Disallow /de/company/aboutus/policies_statements/travel.html

Other Records

Field Value
crawl-delay 60

*

Rule Path
Disallow /fr/*.html?file=%2Fproducts%2Fdemos%2Fshipping*
Disallow /fr/*/shared-content/*
Disallow /fr/*/support/books/index_new_books/jcr%3Acontent.search.json
Disallow /fr/*/support/books/search/jcr%3Acontent.search.json
Disallow /fr/_site_doc
Disallow /fr/academia/books/members.html
Disallow /fr/access/pagenotfound.html
Disallow /fr/accesslogin
Disallow /fr/add-ons/
Disallow /fr/brandguide
Disallow /fr/campaigns/portals/
Disallow /fr/campaigns/products/trials/forms/
Disallow /fr/campaigns/road-map
Disallow /fr/cgi-bin
Disallow /fr/company/events/conferences/matlab-expo-2017-china.html
Disallow /fr/company/events/conferences/matlab-expo-2017-germany.html
Disallow /fr/company/events/conferences/matlab-expo-2017-japan.html
Disallow /fr/company/events/conferences/matlab-expo-2017-switzerland.html
Disallow /fr/company/events/conferences/matlab-expo-2017-uk.html
Disallow /fr/company/events/conferences/matlab-expo-2017-us.html
Disallow /fr/company/events/conferences/matlab-expo-2018-france.html
Disallow /fr/company/events/conferences/matlab-expo-2018-italy.html
Disallow /fr/company/events/conferences/matlab-expo-2018-spain.html
Disallow /fr/company/events/mab
Disallow /fr/company/events/research-summit
Disallow /fr/company/events/seminars/locations/*
Disallow /fr/company/legal/
Disallow /fr/content/dam/mathworks/mathworks-dot-com/images/company/jobs
Disallow /fr/content/dam/mathworks/mathworks-dot-com/products/files/industry-model-code-testing.pdf
Disallow /fr/content/dam/mathworks/price-lists/
Disallow /fr/content/mathworks
Disallow /fr/contest/*/view_submission.html
Disallow /fr/develop/
Allow /fr/develop/review/
Disallow /fr/help/deeplearning/index.html%3B*
Disallow /fr/help/pdf_doc/
Disallow /fr/help/releases/
Disallow /fr/includes_content/missing_handler/view_map.html
Disallow /fr/licensecenter/classroom/
Disallow /fr/matlabcentral/answers/?
Allow /fr/matlabcentral/answers/?page=*
Disallow /fr/matlabcentral/answers/?page=*&amp%3B*
Allow /fr/matlabcentral/answers/?page=*&amp%3Bs_tid=gn_mlc_ans_ans
Allow /fr/matlabcentral/answers/?s_tid=gn_mlc_ans&amp%3Bpage=*
Allow /fr/matlabcentral/answers/?s_tid=gn_mlc_ans_ans
Disallow /fr/matlabcentral/answers/?s_tid=gn_mlc_ans_ans&amp%3B*
Disallow /fr/matlabcentral/answers/?s_tid=gn_mlc_ans_ans&amp%3B*page=*&amp%3B*
Disallow /fr/matlabcentral/answers/uploaded_files/*
Disallow /fr/matlabcentral/answers/questions*
Disallow /fr/matlabcentral/cody/activities
Disallow /fr/matlabcentral/cody/players/*
Disallow /fr/matlabcentral/cody/problems/*/players
Disallow /fr/matlabcentral/cody/problems/*/solutions
Disallow /fr/matlabcentral/cody/problems/*/solutions/*
Disallow /fr/matlabcentral/cody/solutions
Disallow /fr/matlabcentral/fileexchange/*?*download=true*
Disallow /fr/matlabcentral/fileexchange/?
Allow /fr/matlabcentral/fileexchange/?term=type%3Aapp
Allow /fr/matlabcentral/fileexchange/?term=type%3Aapp&amp%3Bpage=*
Disallow /fr/matlabcentral/fileexchange/?term=type%3Aapp*&amp%3B*
Allow /fr/matlabcentral/fileexchange/?term=type%3Aclass
Allow /fr/matlabcentral/fileexchange/?term=type%3Aclass&amp%3Bpage=*
Disallow /fr/matlabcentral/fileexchange/?term=type%3Aclass*&amp%3B*
Allow /fr/matlabcentral/fileexchange/?term=type%3Adriver
Allow /fr/matlabcentral/fileexchange/?term=type%3Adriver&amp%3Bpage=*
Disallow /fr/matlabcentral/fileexchange/?term=type%3Adriver*&amp%3B*
Allow /fr/matlabcentral/fileexchange/?term=type%3Aexample
Allow /fr/matlabcentral/fileexchange/?term=type%3Aexample&amp%3Bpage=*
Disallow /fr/matlabcentral/fileexchange/?term=type%3Aexample*&amp%3B*
Allow /fr/matlabcentral/fileexchange/?term=type%3Afunction
Allow /fr/matlabcentral/fileexchange/?term=type%3Afunction&amp%3Bpage=*
Disallow /fr/matlabcentral/fileexchange/?term=type%3Afunction*&amp%3B*
Allow /fr/matlabcentral/fileexchange/?term=type%3Amodel
Allow /fr/matlabcentral/fileexchange/?term=type%3Amodel&amp%3Bpage=*
Disallow /fr/matlabcentral/fileexchange/?term=type%3Amodel*&amp%3B*
Allow /fr/matlabcentral/fileexchange/?term=type%3Ascript
Allow /fr/matlabcentral/fileexchange/?term=type%3Ascript&amp%3Bpage=*
Disallow /fr/matlabcentral/fileexchange/?term=type%3Ascript*&amp%3B*
Allow /fr/matlabcentral/fileexchange/?term=type%3Avideo
Allow /fr/matlabcentral/fileexchange/?term=type%3Avideo&amp%3Bpage=*
Disallow /fr/matlabcentral/fileexchange/?term=type%3Avideo*&amp%3B*
Disallow /fr/matlabcentral/fileexchange/authors/?
Allow /fr/matlabcentral/fileexchange/authors/?page=*
Disallow /fr/matlabcentral/fileexchange/authors/?page=*&amp%3B*
Disallow /fr/matlabcentral/fileexchange/authors/contact/
Disallow /fr/matlabcentral/fileexchange/download.do
Disallow /fr/matlabcentral/fileexchange/feed.atom
Disallow /fr/matlabcentral/fileexchange/feedbacks
Disallow /fr/matlabcentral/fileexchange/index
Disallow /fr/matlabcentral/fileexchange/tags
Disallow /fr/matlabcentral/fileexchange/tags
Disallow /fr/matlabcentral/mlc-downloads/
Disallow /fr/matlabcentral/profile/api/v1/active/*
Disallow /fr/matlabcentral/profile/contact/*
Disallow /fr/moler/ncm-download.html
Disallow /fr/products/connections/product_detail/product_35486.html
Disallow /fr/products/connections/trials
Disallow /fr/products/demos/shipping/
Disallow /fr/products/demos/shipping_ja/
Disallow /fr/products/matlab-home-for-enterprise/
Disallow /fr/products/new_products/r2017b-pr-transition.html
Disallow /fr/products/trials/
Disallow /fr/programs/nrd/
Disallow /fr/programs/products/files/
Disallow /fr/programs/videos/video-feedback.html
Disallow /fr/quality/
Disallow /fr/searchresults*
Disallow /fr/searchresults/
Allow /fr/searchresults/*videos_all*videos_jp*facets
Disallow /fr/store/link/
Disallow /fr/support/2010a/
Disallow /fr/support/2010b/
Disallow /fr/support/2011a/
Disallow /fr/support/2011b/
Disallow /fr/support/2012a/
Disallow /fr/support/2012b/
Disallow /fr/support/2013a/
Disallow /fr/support/2013b/
Disallow /fr/support/2014a/
Disallow /fr/support/2014b/
Disallow /fr/support/2015a/
Disallow /fr/support/2015b/
Disallow /fr/support/beta/
Disallow /fr/support/books/index_new_books.html
Disallow /fr/support/bugreports/
Disallow /fr/support/faq/r2017a_pr_bugs.html
Disallow /fr/support/faq/r2017b_pr_bugs.html
Disallow /fr/support/pricing/
Disallow /fr/tagteam
Disallow /fr/test/
Disallow /fr/videos/*.feedback.html
Disallow /fr/videos/hardware-in-the-loop-simulation-with-simulink-real-time-using-plcs-and-ethernetip-protocol-for-validating-industrial-automation-control-algorithms-96697.html
Disallow /fr/videos/raw-ethernet-communication-support-from-simulink-real-time-96619.html
Disallow /fr/videos/real-time-udp-communication-support-99895.html
Disallow /fr/videos/video-feedback.html
Disallow /fr/videos/video-feedback-confirmation.html
Disallow /fr/web_downloads

baiduspider

Rule Path
Disallow /fr/academia/books/search.html
Disallow /fr/company/user_stories/search.html
Disallow /fr/company/newsletters/search.html
Disallow /fr/hardware-support.html
Disallow /fr/hardware-support/instrument-control-toolbox/drivers-search.html
Disallow /fr/matlabcentral/simbiology/search.html
Disallow /fr/matlabcentral/topics/distance-learning/search.html
Disallow /fr/matlabcentral/topics/power-electronics-control/search.html
Disallow /fr/products/connections/search-products.html
Disallow /fr/products/connections/search-services.html
Disallow /fr/search.html
Disallow /fr/support/search.html
Disallow /fr/videos/search.html
Disallow /fr/searchresults*
Disallow /fr/searchresults/

slurp

Rule Path
Disallow /fr/company/aboutus/policies_statements/travel.html

Other Records

Field Value
crawl-delay 60

*

Rule Path
Disallow /en/*.html?file=%2Fproducts%2Fdemos%2Fshipping*
Disallow /en/*/shared-content/*
Disallow /en/*/support/books/index_new_books/jcr%3Acontent.search.json
Disallow /en/*/support/books/search/jcr%3Acontent.search.json
Disallow /en/_site_doc
Disallow /en/academia/books/members.html
Disallow /en/access/pagenotfound.html
Disallow /en/accesslogin
Disallow /en/add-ons/
Disallow /en/brandguide
Disallow /en/campaigns/portals/
Disallow /en/campaigns/products/trials/forms/
Disallow /en/campaigns/road-map
Disallow /en/cgi-bin
Disallow /en/company/events/conferences/matlab-expo-2017-china.html
Disallow /en/company/events/conferences/matlab-expo-2017-germany.html
Disallow /en/company/events/conferences/matlab-expo-2017-japan.html
Disallow /en/company/events/conferences/matlab-expo-2017-switzerland.html
Disallow /en/company/events/conferences/matlab-expo-2017-uk.html
Disallow /en/company/events/conferences/matlab-expo-2017-us.html
Disallow /en/company/events/conferences/matlab-expo-2018-france.html
Disallow /en/company/events/conferences/matlab-expo-2018-italy.html
Disallow /en/company/events/conferences/matlab-expo-2018-spain.html
Disallow /en/company/events/mab
Disallow /en/company/events/research-summit
Disallow /en/company/events/seminars/locations/*
Disallow /en/company/legal/
Disallow /en/content/dam/mathworks/mathworks-dot-com/images/company/jobs
Disallow /en/content/dam/mathworks/mathworks-dot-com/products/files/industry-model-code-testing.pdf
Disallow /en/content/dam/mathworks/price-lists/
Disallow /en/content/mathworks
Disallow /en/contest/*/view_submission.html
Disallow /en/develop/
Allow /en/develop/review/
Disallow /en/help/deeplearning/index.html%3B*
Disallow /en/help/pdf_doc/
Disallow /en/help/releases/
Disallow /en/includes_content/missing_handler/view_map.html
Disallow /en/licensecenter/classroom/
Disallow /en/matlabcentral/answers/?
Allow /en/matlabcentral/answers/?page=*
Disallow /en/matlabcentral/answers/?page=*&amp%3B*
Allow /en/matlabcentral/answers/?page=*&amp%3Bs_tid=gn_mlc_ans_ans
Allow /en/matlabcentral/answers/?s_tid=gn_mlc_ans&amp%3Bpage=*
Allow /en/matlabcentral/answers/?s_tid=gn_mlc_ans_ans
Disallow /en/matlabcentral/answers/?s_tid=gn_mlc_ans_ans&amp%3B*
Disallow /en/matlabcentral/answers/?s_tid=gn_mlc_ans_ans&amp%3B*page=*&amp%3B*
Disallow /en/matlabcentral/answers/uploaded_files/*
Disallow /en/matlabcentral/answers/questions*
Disallow /en/matlabcentral/cody/activities
Disallow /en/matlabcentral/cody/players/*
Disallow /en/matlabcentral/cody/problems/*/players
Disallow /en/matlabcentral/cody/problems/*/solutions
Disallow /en/matlabcentral/cody/problems/*/solutions/*
Disallow /en/matlabcentral/cody/solutions
Disallow /en/matlabcentral/fileexchange/*?*download=true*
Disallow /en/matlabcentral/fileexchange/?
Allow /en/matlabcentral/fileexchange/?term=type%3Aapp
Allow /en/matlabcentral/fileexchange/?term=type%3Aapp&amp%3Bpage=*
Disallow /en/matlabcentral/fileexchange/?term=type%3Aapp*&amp%3B*
Allow /en/matlabcentral/fileexchange/?term=type%3Aclass
Allow /en/matlabcentral/fileexchange/?term=type%3Aclass&amp%3Bpage=*
Disallow /en/matlabcentral/fileexchange/?term=type%3Aclass*&amp%3B*
Allow /en/matlabcentral/fileexchange/?term=type%3Adriver
Allow /en/matlabcentral/fileexchange/?term=type%3Adriver&amp%3Bpage=*
Disallow /en/matlabcentral/fileexchange/?term=type%3Adriver*&amp%3B*
Allow /en/matlabcentral/fileexchange/?term=type%3Aexample
Allow /en/matlabcentral/fileexchange/?term=type%3Aexample&amp%3Bpage=*
Disallow /en/matlabcentral/fileexchange/?term=type%3Aexample*&amp%3B*
Allow /en/matlabcentral/fileexchange/?term=type%3Afunction
Allow /en/matlabcentral/fileexchange/?term=type%3Afunction&amp%3Bpage=*
Disallow /en/matlabcentral/fileexchange/?term=type%3Afunction*&amp%3B*
Allow /en/matlabcentral/fileexchange/?term=type%3Amodel
Allow /en/matlabcentral/fileexchange/?term=type%3Amodel&amp%3Bpage=*
Disallow /en/matlabcentral/fileexchange/?term=type%3Amodel*&amp%3B*
Allow /en/matlabcentral/fileexchange/?term=type%3Ascript
Allow /en/matlabcentral/fileexchange/?term=type%3Ascript&amp%3Bpage=*
Disallow /en/matlabcentral/fileexchange/?term=type%3Ascript*&amp%3B*
Allow /en/matlabcentral/fileexchange/?term=type%3Avideo
Allow /en/matlabcentral/fileexchange/?term=type%3Avideo&amp%3Bpage=*
Disallow /en/matlabcentral/fileexchange/?term=type%3Avideo*&amp%3B*
Disallow /en/matlabcentral/fileexchange/authors/?
Allow /en/matlabcentral/fileexchange/authors/?page=*
Disallow /en/matlabcentral/fileexchange/authors/?page=*&amp%3B*
Disallow /en/matlabcentral/fileexchange/authors/contact/
Disallow /en/matlabcentral/fileexchange/download.do
Disallow /en/matlabcentral/fileexchange/feed.atom
Disallow /en/matlabcentral/fileexchange/feedbacks
Disallow /en/matlabcentral/fileexchange/index
Disallow /en/matlabcentral/fileexchange/tags
Disallow /en/matlabcentral/fileexchange/tags
Disallow /en/matlabcentral/mlc-downloads/
Disallow /en/matlabcentral/profile/api/v1/active/*
Disallow /en/matlabcentral/profile/contact/*
Disallow /en/moler/ncm-download.html
Disallow /en/products/connections/product_detail/product_35486.html
Disallow /en/products/connections/trials
Disallow /en/products/demos/shipping/
Disallow /en/products/demos/shipping_ja/
Disallow /en/products/matlab-home-for-enterprise/
Disallow /en/products/new_products/r2017b-pr-transition.html
Disallow /en/products/trials/
Disallow /en/programs/nrd/
Disallow /en/programs/products/files/
Disallow /en/programs/videos/video-feedback.html
Disallow /en/quality/
Disallow /en/searchresults*
Disallow /en/searchresults/
Allow /en/searchresults/*videos_all*videos_jp*facets
Disallow /en/store/link/
Disallow /en/support/2010a/
Disallow /en/support/2010b/
Disallow /en/support/2011a/
Disallow /en/support/2011b/
Disallow /en/support/2012a/
Disallow /en/support/2012b/
Disallow /en/support/2013a/
Disallow /en/support/2013b/
Disallow /en/support/2014a/
Disallow /en/support/2014b/
Disallow /en/support/2015a/
Disallow /en/support/2015b/
Disallow /en/support/beta/
Disallow /en/support/books/index_new_books.html
Disallow /en/support/bugreports/
Disallow /en/support/faq/r2017a_pr_bugs.html
Disallow /en/support/faq/r2017b_pr_bugs.html
Disallow /en/support/pricing/
Disallow /en/tagteam
Disallow /en/test/
Disallow /en/videos/*.feedback.html
Disallow /en/videos/hardware-in-the-loop-simulation-with-simulink-real-time-using-plcs-and-ethernetip-protocol-for-validating-industrial-automation-control-algorithms-96697.html
Disallow /en/videos/raw-ethernet-communication-support-from-simulink-real-time-96619.html
Disallow /en/videos/real-time-udp-communication-support-99895.html
Disallow /en/videos/video-feedback.html
Disallow /en/videos/video-feedback-confirmation.html
Disallow /en/web_downloads

baiduspider

Rule Path
Disallow /en/academia/books/search.html
Disallow /en/company/user_stories/search.html
Disallow /en/company/newsletters/search.html
Disallow /en/hardware-support.html
Disallow /en/hardware-support/instrument-control-toolbox/drivers-search.html
Disallow /en/matlabcentral/simbiology/search.html
Disallow /en/matlabcentral/topics/distance-learning/search.html
Disallow /en/matlabcentral/topics/power-electronics-control/search.html
Disallow /en/products/connections/search-products.html
Disallow /en/products/connections/search-services.html
Disallow /en/search.html
Disallow /en/support/search.html
Disallow /en/videos/search.html
Disallow /en/searchresults*
Disallow /en/searchresults/

slurp

Rule Path
Disallow /en/company/aboutus/policies_statements/travel.html

Other Records

Field Value
crawl-delay 60

nutch-solr-integration

Rule Path
Allow /support/bugreports/

caliperbot/1.0

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

covario-ids/1.0

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

Comments

  • robots.txt for http://www.mathworks.com and subdomains
  • Please do not update this file without contacting the owner
  • Owner: webops at mathworks.com
  • Note 1 for updating: Please keep list alphabetized by URL.
  • Note 2 for updating: When making an update, it needs to be updated for /de/, /fr/, /en/ sections as well.
  • /de/ below
  • /fr/ below
  • /en/ below