MySQL HeatWave User Guide
Auto Parallel Load is a feature of MySQL HeatWave that automates many of the steps for loading data, which include the following:
Excluding schemas, tables, and columns that cannot be loaded.
Defining RAPID
as the secondary engine
for tables that are to be loaded.
Verifying that there is sufficient memory available for the data.
Optimizing load parallelism based on machine learning models.
Loading data into MySQL HeatWave.
As of MySQL 8.4.0, Auto Parallel Load uses Autopilot to collect statistics about frequently used DB System tables. Auto Parallel Load then automatically loads these tables into MySQL HeatWave. Conversely, if an automatically loaded table becomes cold due to not being used, then it is automatically unloaded. Also, if there is not enough memory for a manually loaded table due to automatically loaded tables taking up too much memory, Auto Unload unloads automatically loaded tables to allow the manually loaded table to load.
As of MySQL 9.3.1, this feature extends to partitions. Auto Parallel Load automatically loads frequently used partitions, and automatically unloads partitions that are not being used.
Auto Parallel Load automatically loads any table that does not have the
secondary engine set, or the secondary engine is set to
RAPID
.
Auto Parallel Load has a 24-hour wait interval between checking the table statistics, and only checks them during a quiet period. Therefore, within 24 hours of the first query that accesses a table, Auto Parallel Load automatically loads the table into MySQL HeatWave if there is sufficient memory.
Learn how to load data using Auto Parallel Load.