14.2.2 MySQL HeatWave GenAI In-Database LLMs

MySQL HeatWave GenAI supports LLMs hosted and executed within the database. When in-database LLMs are used, data does not leave your MySQL HeatWave Cluster, which enhances the security for your data.

For MySQL 9.3.2 and later, see View Available Models on how to view a list of the supported in-database LLMs.

For MySQL 9.3.1 and earlier, the following are the in-database LLMs currently supported by MySQL HeatWave on AWS:

• Supported since MySQL 9.0.1:
  • llama2-7b-v1: supports English (en).
  • llama3-8b-instruct-v1: supports English (en), French (fr), German (de), Hindi (hi), Italian (it), Portuguese (pt), Spanish (es), and Thai (th).
  • mistral-7b-instruct-v1: supports English (en), French (fr), German (de), and Spanish (es).
• Supported since MySQL 9.3.1:
  • llama3.1-8b-instruct-v1: supports English (en), French (fr), German (de), Hindi (hi), Italian (it), Portuguese (pt), Spanish (es), and Thai (th).
  • mistral-7b-instruct-v3: supports English (en), French (fr), German (de), and Spanish (es).
  • llama3.2-3b-instruct-v1: supports English (en), French (fr), German (de), Hindi (hi), Italian (it), Portuguese (pt), Spanish (es), and Thai (th). This is the default LLM used by MySQL HeatWave GenAI for content generation.
  • llama3.2-1b-instruct-v1: supports English (en), French (fr), German (de), Hindi (hi), Italian (it), Portuguese (pt), Spanish (es), and Thai (th).

Use these models with the MySQL HeatWave GenAI routines.