community.finary.com
robots.txt

Robots Exclusion Standard data for community.finary.com

Resource Scan

Scan Details

Site Domain community.finary.com
Base Domain finary.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-04-24T14:53:19+00:00
Next Scan 2025-06-23T14:53:19+00:00

Last Successful Scan

Scanned2025-02-01T14:37:59+00:00
URL https://community.finary.com/robots.txt
Domain IPs 172.66.40.242, 172.66.43.14, 2606:4700:3108::ac42:28f2, 2606:4700:3108::ac42:2b0e
Response IP 172.66.40.242
Found Yes
Hash 04737a1622c5745d9c5fa58f8cbaba5ec6ad80adb2eab227add071a142521f59
SimHash 289d1d857770

Groups

mauibot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

seo spider

Rule Path
Disallow /

*

Rule Path
Disallow /admin/
Disallow /auth/
Disallow /assets/browser-update*.js
Disallow /email/
Disallow /session
Disallow /user-api-key
Disallow /*?api_key*
Disallow /*?*api_key*
Disallow /badges
Disallow /u/
Disallow /my
Disallow /search
Disallow /tag/*/l
Disallow /g
Disallow /t/*/*.rss
Disallow /c/*.rss

googlebot

Rule Path
Disallow /admin/
Disallow /auth/
Disallow /assets/browser-update*.js
Disallow /email/
Disallow /session
Disallow /user-api-key
Disallow /*?api_key*
Disallow /*?*api_key*

Other Records

Field Value
sitemap https://community.finary.com/sitemap.xml

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file