14.2.2 HeatWave GenAI In-Database LLMs

HeatWave GenAI supports LLMs hosted and executed within the database. When in-database LLMs are used, data does not leave your HeatWave Cluster, which enhances the security for your data.

For MySQL 9.3.2 and later, see View Available Models on how to view a list of the supported in-database LLMs.

For MySQL 9.3.1 and earlier, the following are the in-database LLMs currently supported by HeatWave on AWS:

• Supported since MySQL 9.0.1:
  • llama2-7b-v1: supports English (en).
  • llama3-8b-instruct-v1: supports English (en), French (fr), German (de), Hindi (hi), Italian (it), Portuguese (pt), Spanish (es), and Thai (th).
  • mistral-7b-instruct-v1: supports English (en), French (fr), German (de), and Spanish (es).
• Supported since MySQL 9.3.1:
  • llama3.1-8b-instruct-v1: supports English (en), French (fr), German (de), Hindi (hi), Italian (it), Portuguese (pt), Spanish (es), and Thai (th).
  • mistral-7b-instruct-v3: supports English (en), French (fr), German (de), and Spanish (es).
  • llama3.2-3b-instruct-v1: supports English (en), French (fr), German (de), Hindi (hi), Italian (it), Portuguese (pt), Spanish (es), and Thai (th). This is the default LLM used by HeatWave GenAI for content generation.
  • llama3.2-1b-instruct-v1: supports English (en), French (fr), German (de), Hindi (hi), Italian (it), Portuguese (pt), Spanish (es), and Thai (th).

Use these models with the HeatWave GenAI routines.