finary.com
robots.txt

Robots Exclusion Standard data for finary.com

Resource Scan

Scan Details

Site Domain finary.com
Base Domain finary.com
Scan Status Ok
Last Scan2024-05-14T12:06:44+00:00
Next Scan 2024-05-28T12:06:44+00:00

Last Scan

Scanned2024-05-14T12:06:44+00:00
URL https://finary.com/robots.txt
Domain IPs 172.66.40.242, 172.66.43.14, 2606:4700:3108::ac42:28f2, 2606:4700:3108::ac42:2b0e
Response IP 172.66.40.242
Found Yes
Hash 30562a3bcdcf659e3dfbaa8e14aa9c910d1b2f184dc3b3bd27f3637dff5fdbdb
SimHash 4c140713cf13

Groups

*

Rule Path
Allow /
Disallow /_vercel/
Disallow /api/
Disallow /en/glossaire/

Other Records

Field Value
sitemap https://finary.com/sitemap-fixed.xml
sitemap https://finary.com/fr/crypto/sitemap.xml

Comments

  • robots.txt for finary.com v1.0.20240321 - Wealthier Web Crawlers
  • Website Section
  • Toolbox Section
  • We thought you'd never make it!
  • We hope you feel right at home in this file...unless you're a disallowed subfolder.
  • There's even a bring your robot to work day.
  • .
  • +%@@@.
  • *@@=. *@@:
  • %@@ :==.
  • -*#%%%%%%%%%%%%%: -%%@@@%%%. *%%: -%%:-*%@@%*- :+#@@@%*-+%% +@%.-*%@% #@@. *@%.
  • @@@@@@@@@@@@@@@+ .::@@@::: *@@: -@@%*-..-#@@* #@@*-..:=%@@@ +@@#@*=:: %@% =@@.
  • +@@@@@@@@@@@@@%*: %@% *@@: -@@= %@@ +@@- %@@ +@@%. .%@* -@@:
  • .:-----: %@% *@@: -@@: #@@ #@@ +@@ +@@. .@@= :@@=
  • .+%@@@@@@@# %@% *@@: -@@: #@@ =@@+ .%@@ +@@. :@@+@@*
  • .%@@@@@@@@# %@% *@@: -@@: #@@ =@@%+--=#@@@@ +@@. =@@@
  • =######*=. *## +##: -##. *## -+###*=.+## =## .@@
  • @%
  • =%