gurufocus.com
robots.txt

Robots Exclusion Standard data for gurufocus.com

Resource Scan

Scan Details

Site Domain gurufocus.com
Base Domain gurufocus.com
Scan Status Ok
Last Scan2024-09-22T13:11:23+00:00
Next Scan 2024-09-29T13:11:23+00:00

Last Scan

Scanned2024-09-22T13:11:23+00:00
URL https://gurufocus.com/robots.txt
Redirect https://www.gurufocus.com/robots.txt
Redirect Domain www.gurufocus.com
Redirect Base gurufocus.com
Domain IPs 172.66.40.223, 172.66.43.33, 2606:4700:3108::ac42:28df, 2606:4700:3108::ac42:2b21
Redirect IPs 172.66.40.223, 172.66.43.33, 2606:4700:3108::ac42:28df, 2606:4700:3108::ac42:2b21
Response IP 172.66.43.33
Found Yes
Hash 3f80c39f1e2cd37da5ada05b2db40b7774defb97e4380989c51aed3450107725
SimHash fd7579050db1

Groups

mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow /beta/
Disallow /filing_wiz/
Disallow /cdn-cgi/
Disallow /compare.php*
Disallow /download_52weeklow.php*
Disallow /forum/
Disallow /gurutrac/
Disallow /ic/
Disallow /membership/
Disallow /modules/
Disallow /moneymanager/
Disallow /my/
Disallow /news_print.php*
Disallow /nl_downloads.php*
Disallow /old_homepage/
Disallow /pdf_download.php*
Disallow /pdf/
Disallow /r.php*
Disallow /rss_2.php*
Disallow /stock_pdf/
Disallow /stock_reader.php*
Disallow /StockLink.php*
Disallow /temp/
Disallow /Terms_of_use.htm
Disallow /test/
Disallow /update/
Disallow /xmlswf/
Disallow /old_homepage/
Disallow /login*
Disallow /chart_old.php*
Disallow /conference/
Disallow /conference
Disallow /feed/
Disallow /ticket/
Disallow /term_api.php
Disallow /ads/
Disallow /new_index/
Disallow /new_index
Disallow /show_forum_post.php*
Disallow /download_dividend.php*
Disallow *.pdf
Disallow *.xlsx$
Disallow *.xls$
Disallow *.zip$

Other Records

Field Value
sitemap https://www.gurufocus.com/sitemapindex.xml
sitemap https://www.gurufocus.com/google_news_sitemap.xml
sitemap https://www.gurufocus.com/rss.php
sitemap https://www.gurufocus.com/sitemap/us-stocks-sitemap-1.xml
sitemap https://www.gurufocus.com/sitemap/us-stocks-sitemap-2.xml
sitemap https://www.gurufocus.com/sitemap/pages-sitemap.xml

Comments

  • Files