14.2.3 MySQL HeatWave GenAI External LLMs

MySQL HeatWave GenAI supports external LLMs provided by Amazon Bedrock. When external LLMs are used, data leaves your MySQL HeatWave Cluster to be processed by Amazon Bedrock.

For MySQL 9.3.2 and later, see View Available Models on how to view a list of the supported external LLMs.

For MySQL 9.3.1 and earlier, the following are the external LLMs provided by Amazon Bedrock that are currently supported by MySQL HeatWave on AWS:

• Supported since MySQL 9.0.1:
  • cohere.command-text-v14
  • cohere.command-light-text-v14
  • meta.llama3-1-70b-instruct-v1:0
• Supported since MySQL 9.2.1:
  • cohere.command-r-v1:0
  • cohere.command-r-plus-v1:0
  • meta.llama3-70b-instruct-v1:0
  • meta.llama3-1-405b-instruct-v1:0

See Amazon Bedrock Documentation for the list of languages supported by each of the LLMs.

Note:

Not all LLMs provided by Amazon Bedrock are available in all AWS regions. Also, MySQL HeatWave GenAI does not support cross-region inference, which means an external LLM provided by Amazon Bedrock is not supported by MySQL HeatWave GenAI in your AWS region if it is only accessible through cross-region inference in that region. See Supported foundation models in Amazon Bedrock for details.

To use these models with the MySQL HeatWave GenAI routines, you need:

• An IAM policy to access the Amazon Bedrock service
• An IAM Role to access the Amazon Bedrock service