Introduces Oracle Data Mining to perform a variety of mining tasks.
2.1 About Oracle Data Mining
Understand the uses of Oracle Data Mining and learn about different mining techniques.
Oracle Data Mining provides a powerful, state-of-the-art data mining capability within Oracle Database. You can use Oracle Data Mining to build and deploy predictive and descriptive data mining applications, to add intelligent capabilities to existing applications, and to generate predictive queries for data exploration.
Oracle Data Mining offers a broad set of in-database algorithms for performing a variety of machine learning tasks, such as classification, regression, anomaly detection, feature extraction, clustering, and market basket analysis. The algorithms can work on standard case data, transactional data, star schemas, and unstructured text data. Oracle Data Mining is uniquely suited to the analysis of very large data sets.
Oracle Data Mining along with Oracle R Enterprise are components of Oracle Advanced Analytics Option that provides powerful APIs for in-database data mining, among other features.
2.2 Oracle Data Mining for SQL in the Database Kernel
Learn about the implementation of Oracle Data Mining for SQL (Oracle Data Mining) in Oracle Database kernel and its advantages.
Oracle Data Mining is implemented in the Oracle Database kernel. Oracle Data Mining models are first class database objects. Oracle Data Mining for SQL processes use built-in features of Oracle Database to maximize scalability and make efficient use of system resources.
Oracle Data Mining within Oracle Database offers many advantages:
No Data Movement: Some data mining products require that the data be exported from a corporate database and converted to a specialized format. With Oracle Data Mining, no data movement or conversion is needed. This makes the entire process less complex, time-consuming, and error-prone, and it allows for the analysis of very large data sets.
Security: Your data is protected by the extensive security mechanisms of Oracle Database. Moreover, specific database privileges are needed for different data mining activities. Only users with the appropriate privileges can define, manipulate, or apply data mining model objects.
Data Preparation and Administration: Most data must be cleansed, filtered, normalized, sampled, and transformed in various ways before it can be mined. Up to 80% of the effort in a data mining project is often devoted to data preparation. Oracle Data Mining can automatically manage key steps in the data preparation process. Additionally, Oracle Database provides extensive administrative tools for preparing and managing data.
Ease of Data Refresh: Data mining processes within Oracle Database have ready access to refreshed data. Oracle Data Mining can easily deliver data mining results based on current data, thereby maximizing its timeliness and relevance.
Oracle Database Analytics: Oracle Database offers many features for advanced analytics and business intelligence. You can easily integrate data mining with other analytical features of the database, such as statistical analysis and OLAP.
Oracle Technology Stack: You can take advantage of all aspects of Oracle's technology stack to integrate data mining within a larger framework for business intelligence or scientific inquiry.
Domain Environment: Data mining models have to be built, tested, validated, managed, and deployed in their appropriate application domain environments. Data mining results may need to be post-processed as part of domain specific computations (for example, calculating estimated risks and response probabilities) and then stored into permanent repositories or data warehouses. With Oracle Data Mining, the pre- and post-data mining activities can all be accomplished within the same environment.
Application Programming Interfaces: The PL/SQL API and SQL language operators provide direct access to Oracle Data Mining functionality in Oracle Database.
2.3 Data Mining in Oracle Exadata
Understand scoring in Oracle Exadata.
Scoring refers to the process of applying a data mining model to data to generate predictions. The scoring process may require significant system resources. Vast amounts of data may be involved, and algorithmic processing may be very complex.
With Oracle Data Mining, scoring can be off-loaded to intelligent Oracle Exadata Storage Servers where processing is extremely performant.
Oracle Exadata Storage Servers combine Oracle's smart storage software and Oracle's industry-standard hardware to deliver the industry's highest database storage performance. For more information about Oracle Exadata, visit the Oracle Technology Network.
2.4 About Partitioned Models
Introduces partitioned models to organize and represent multiple models.
When you build a model on your data set and apply it to new data, sometimes the prediction may be generic that performs badly when run on new and evolving data. To overcome this, the data set can be divided into different parts based on some characteristics. Oracle Data Mining for SQL supports partitioned model. Partitioned models allow users to build a type of ensemble model for each data partition. The top-level model has sub models that are automatically produced. The sub models are based on the attribute options. For example, if your data set has an attribute called MARITAL with four values and you have defined it as the partitioned attribute. Then, four sub models are created for this attribute. The sub models are automatically managed and used as a single model. The partitioned model automates a typicaldata mining task and can potentially achieve better accuracy through multiple targeted models.
The partitioned model and its sub models reside as first class, persistent database objects. Persistent means that the partitioned model has an on-disk representation.
To create a partitioned model, include the
ODMS_PARTITION_COLUMNS setting. To define the number of partitions, include the
ODMS_MAX_PARTITIONS setting. When you are making predictions, you must use the top-level model. The correct sub model is selected automatically based on the attribute, the attribute options, and the partition setting. You must include the partition columns as part of the
USING clause when scoring. The
GROUPING hint is an optional hint that applies to data mining scoring functions when scoring partitioned models.
The partition names, key values, and the structure of the partitioned model are available in the
2.5 Interfaces to Oracle Data Mining
The programmatic interfaces to Oracle Data Mining are PL/SQL for building and maintaining models and a family of SQL functions for scoring. Oracle Data Mining also supports a graphical user interface, which is implemented as an extension to Oracle SQL Developer.
Oracle Predictive Analytics, a set of simplified data mining routines, is built on top of Oracle Data Mining and is implemented as a PL/SQL package.
2.5.1 PL/SQL API
The Oracle Data Mining PL/SQL API is implemented in the
DBMS_DATA_MINING PL/SQL package, which contains routines for building, testing, and maintaining data mining models. A batch apply operation is also included in this package.
The following example shows part of a simple PL/SQL script for creating an SVM classification model called SVMC_SH_Clas_sample. The model build uses weights, specified in a weights table, and settings, specified in a settings table. The weights influence the weighting of target classes. The settings override default behavior. The model uses Automatic Data Preparation (
prep_auto_on setting). The model is trained on the data in mining_data_build_v.
Example 2-1 Creating a Classification Model
----------------------- CREATE AND POPULATE A CLASS WEIGHTS TABLE ------------ CREATE TABLE svmc_sh_sample_class_wt ( target_value NUMBER, class_weight NUMBER); INSERT INTO svmc_sh_sample_class_wt VALUES (0,0.35); INSERT INTO svmc_sh_sample_class_wt VALUES (1,0.65); COMMIT; ----------------------- CREATE AND POPULATE A SETTINGS TABLE ------------------ CREATE TABLE svmc_sh_sample_settings ( setting_name VARCHAR2(30), setting_value VARCHAR2(4000)); BEGIN INSERT INTO svmc_sh_sample_settings (setting_name, setting_value) VALUES (dbms_data_mining.algo_name, dbms_data_mining.algo_support_vector_machines); INSERT INTO svmc_sh_sample_settings (setting_name, setting_value) VALUES (dbms_data_mining.svms_kernel_function, dbms_data_mining.svms_linear); INSERT INTO svmc_sh_sample_settings (setting_name, setting_value) VALUES (dbms_data_mining.clas_weights_table_name, 'svmc_sh_sample_class_wt'); INSERT INTO svmc_sh_sample_settings (setting_name, setting_value) VALUES (dbms_data_mining.prep_auto, dbms_data_mining.prep_auto_on); END; / ------------------------ CREATE THE MODEL ------------------------------------- BEGIN DBMS_DATA_MINING.CREATE_MODEL( model_name => 'SVMC_SH_Clas_sample', mining_function => dbms_data_mining.classification, data_table_name => 'mining_data_build_v', case_id_column_name => 'cust_id', target_column_name => 'affinity_card', settings_table_name => 'svmc_sh_sample_settings'); END; /
2.5.2 SQL Functions
The Data Mining SQL functions perform prediction, clustering, and feature extraction.
The functions score data by applying a mining model object or by executing an analytic clause that performs dynamic scoring.
The following example shows a query that applies the classification model
svmc_sh_clas_sample to the data in the view
mining_data_apply_v. The query returns the average age of customers who are likely to use an affinity card. The results are broken out by gender.
Example 2-2 The PREDICTION Function
SELECT cust_gender, COUNT(*) AS cnt, ROUND(AVG(age)) AS avg_age FROM mining_data_apply_v WHERE PREDICTION(svmc_sh_clas_sample USING *) = 1 GROUP BY cust_gender ORDER BY cust_gender; C CNT AVG_AGE - ---------- ---------- F 59 41 M 409 45
2.5.3 Oracle Data Miner
Oracle Data Mining for SQL supports a graphical interface called Oracle Data Miner.
Oracle Data Miner is a graphical interface to Oracle Data Mining. Oracle Data Miner is an extension to Oracle SQL Developer, which is available for download free of charge on the Oracle Technology Network.
Oracle Data Miner uses a work flow paradigm to capture, document, and automate the process of building, evaluating, and applying Oracle Data Mining models. Within a work flow, you can specify data transformations, build and evaluate multiple models, and score multiple data sets. You can then save work flows and share them with other users.
Figure 2-1 An Oracle Data Miner Workflow
Description of "Figure 2-1 An Oracle Data Miner Workflow"
For information about Oracle Data Miner, including installation instructions, visit Oracle Technology Network.
2.5.4 Predictive Analytics
Predictive analytics is a technology that captures data mining processes in simple routines.
Predictive analytics uses data mining technology, but knowledge of data mining is not needed to use predictive analytics. You can use predictive analytics simply by specifying an operation to perform on your data. You do not need to create or use mining models or understand the mining techniques and algorithms summarized in "Oracle Data Mining Basics ".
Oracle Data Mining predictive analytics operations are described in the following table:
Table 2-1 Oracle Predictive Analytics Operations
Explains how individual predictors (columns) affect the variation of values in a target column
For each case (row), predicts the values in a target column
Creates a set of rules for cases (rows) that imply the same target value
The Oracle predictive analytics operations are implemented in the
DBMS_PREDICTIVE_ANALYTICS PL/SQL package. They are also available in Oracle Data Miner.
2.6 Overview of Database Analytics
An overview of native analytics supported by Oracle Database.
Oracle Database supports an array of native analytical features. Since all these features are part of a common server it is possible to combine them efficiently. The results of analytical processing can be integrated with Oracle Business Intelligence Suite Enterprise Edition and other BI tools and applications.
The possibilities for combining different analytics are virtually limitless. Example 2-3 shows Oracle Data Mining for SQL and text processing within a single SQL query. The query selects all customers who have a high propensity to attrite (> 80% chance), are valuable customers (customer value rating > 90), and have had a recent conversation with customer services regarding a Checking Plus account. The propensity to attrite information is computed using a Oracle Data Mining model called
tree_model. The query uses the Oracle Text
CONTAINS operator to search call center notes for references to Checking Plus accounts.
Some of the native analytics supported by Oracle Database are described in the following table:
Table 2-2 Oracle Database Native Analytics
Example 2-3 SQL Query Combining Oracle Data Mining for SQL and Oracle Text
SELECT A.cust_name, A.contact_info FROM customers A WHERE PREDICTION_PROBABILITY(tree_model, 'attrite' USING A.*) > 0.8 AND A.cust_value > 90 AND A.cust_id IN (SELECT B.cust_id FROM call_center B WHERE B.call_date BETWEEN '01-Jan-2005' AND '30-Jun-2005' AND CONTAINS(B.notes, 'Checking Plus', 1) > 0);