financhle.com
robots.txt

Robots Exclusion Standard data for financhle.com

Resource Scan

Scan Details

Site Domain financhle.com
Base Domain financhle.com
Scan Status Ok
Last Scan2025-11-26T10:21:01+00:00
Next Scan 2025-12-03T10:21:01+00:00

Last Scan

Scanned2025-11-26T10:21:01+00:00
URL https://financhle.com/robots.txt
Domain IPs 104.21.69.109, 172.67.207.112, 2606:4700:3030::ac43:cf70, 2606:4700:3031::6815:456d
Response IP 172.67.207.112
Found Yes
Hash cc2a5b66042ed810dbc0c9b14f9cf9da64663fcb88ffc53deb4c2b6958918260
SimHash 4b085814b98c

Groups

*

Rule Path
Allow /
Allow /company/*
Allow /etf/*
Allow /articles/*
Allow /sp500-companies-by-weight*
Allow /nasdaq100-companies-by-weight*
Allow /russell2000-companies-by-weight*
Allow /spy-prediction
Allow /unusual-options
Allow /earnings-calendar
Allow /explore
Allow /ipos
Allow /tickers
Allow /about-us
Disallow /account/
Disallow /update-password/
Disallow /api/
Disallow /company/*/manifest.json
Disallow /company/*?*
Disallow /company/*/options/O%3A*
Disallow /etf/*/options/O%3A*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*
Disallow /*.json$
Disallow /*.js$
Disallow /*.css$
Disallow /*.php$
Disallow /_next/
Disallow /login
Disallow /privacy-policy
Disallow /terms-and-conditions

Other Records

Field Value
crawl-delay 0.5

twitterbot

Rule Path
Allow /
Allow /*.jpg$
Allow /*.jpeg$
Allow /*.png$
Allow /*.gif$
Allow /*.webp$
Allow /*.svg$
Disallow /account/
Disallow /update-password/
Disallow /api/
Disallow /company/*/manifest.json
Disallow /company/*?*
Disallow /company/*/options/O%3A*
Disallow /etf/*/options/O%3A*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*
Disallow /*.json$
Disallow /*.js$
Disallow /*.css$
Disallow /*.php$
Disallow /_next/

googlebot

Rule Path
Allow /
Allow /company/*
Allow /etf/*
Allow /articles/*
Allow /sp500-companies-by-weight*
Allow /nasdaq100-companies-by-weight*
Allow /russell2000-companies-by-weight*
Allow /spy-prediction
Allow /unusual-options
Allow /earnings-calendar
Allow /explore
Allow /ipos
Allow /tickers
Allow /about-us
Disallow /account/
Disallow /update-password/
Disallow /api/
Disallow /company/*/manifest.json
Disallow /company/*?*
Disallow /company/*/options/O%3A*
Disallow /etf/*/options/O%3A*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*
Disallow /*.json$
Disallow /*.js$
Disallow /*.css$
Disallow /*.php$
Disallow /_next/
Disallow /login
Disallow /privacy-policy
Disallow /terms-and-conditions

Other Records

Field Value
crawl-delay 0.2

bingbot

Rule Path
Allow /
Allow /company/*
Allow /etf/*
Allow /articles/*
Allow /sp500-companies-by-weight*
Allow /nasdaq100-companies-by-weight*
Allow /russell2000-companies-by-weight*
Allow /spy-prediction
Allow /unusual-options
Allow /earnings-calendar
Allow /explore
Allow /ipos
Allow /tickers
Allow /about-us
Disallow /account/
Disallow /update-password/
Disallow /api/
Disallow /company/*/manifest.json
Disallow /company/*?*
Disallow /company/*/options/O%3A*
Disallow /etf/*/options/O%3A*
Disallow /*?*
Disallow /*%26*
Disallow /*%3D*
Disallow /*.json$
Disallow /*.js$
Disallow /*.css$
Disallow /*.php$
Disallow /_next/
Disallow /login
Disallow /privacy-policy
Disallow /terms-and-conditions

Other Records

Field Value
crawl-delay 0.5

Other Records

Field Value
sitemap https://financhle.com/sitemap.xml