oracle.odi.mapping.generation.spark

Class SparkLoadCmd

java.lang.Object

oracle.odi.mapping.generation.AbstractSyntaxTree

oracle.odi.mapping.generation.spark.SparkCommand

oracle.odi.mapping.generation.spark.SparkLoadCmd

public class SparkLoadCmd
extends SparkCommand

This is the AST representing a Spark load command.

Nested Class Summary

Nested classes/interfaces inherited from class oracle.odi.mapping.generation.AbstractSyntaxTree

AbstractSyntaxTree.LogCounter

Method Summary

Modifier and Type	Method and Description
java.lang.String	getDateFormat() Get Date format property
java.lang.String	getFieldSep() Get the file separator.
java.lang.String	getFileFormat() Get the file format.
java.lang.String	getFileLoc() Gets the file location.
boolean	getGenerateInputSchemaDefinition() Gets a flag indicating if the input schema definition should be generated in the generated code.
boolean	getInferSourceShema() Get infer source schema property
java.lang.String	getInputAvroSchemaDef()
java.lang.String	getInputSchemaDefinition() Gets the valid definition of input schema .
java.util.List	getInputStructTypeSchemaDefinition() Gets the valid definition of input schema defined by the specified structure type, for the data frame that was read.
java.util.List	getInputStructTypeSchemaDefinitionDF() Gets the valid definition of input schema defined by the specified structure type, for the data frame that was read.
java.lang.String	getLoadFuncArgs() Gets the arguments to load function.
java.lang.String	getLoadFunction() Gets the load function
java.lang.String	getLoadOptions() Get the load options
java.util.List	getOutputSchemaFieldList() Generate the names for source columns.
java.lang.String	getOutputSchemaFields() Gets list of fields for output schema.
java.lang.String	getOutputSchemaFieldsDF() Gets list of fields for output schema, specific to DataFrames.
java.lang.String	getRowSep() Get the row separator.
java.lang.String	getTechnology() Get the technology type.
SparkCommandType	getTypeEnum() Get the type of spark command
boolean	isKeySupport() Return true if key is supported.
boolean	isLoadFile() Return true if loading is for file.
boolean	needFormatOutput() Return true if output format is needed.
void	setInputAvroSchemaDef(java.lang.String inputAvroSchemaDef)

Methods inherited from class oracle.odi.mapping.generation.spark.SparkCommand

convertExprs, convertExprsDF, getChildren, getCommandIndex, getExprText, getExprTextDF, getFlexField, getModulePaths, getOptionValue, getParentScript, getPhysicalNode, getScriptLevelCommonContext, getSourceAlias, getSourceAliases, getSparkContextName, getSparkContextType, getStrctType, getStreamEnableWindowing, getStreamSlideInterval, getStreamWindowLength, getTargetAlias, getTemplateSubstitutionMap, getText, getType, isStreamingMode, setSourceAliases, toString, useSQLExpressions

Methods inherited from class oracle.odi.mapping.generation.AbstractSyntaxTree

getCodeGenerationTemplate, getCodeGenerationTemplateName, getCustomTemplate, getKMName, getLeafLevelChildren, getMapPhysicalNode, getOrder, getParentAST, getParentOfType, getPropertyValue, getSourceLanguage, getSourceLocation, getSourceTechnology, getSourceText, getTargetLanguage, getTargetLocation, getTargetTechnology, getTargetText, hasCustomTemplate, hasSourceAndTargetText, isLeafLevelNode, isPushFromSource

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, wait, wait, wait

Method Detail

getTypeEnum

public SparkCommandType getTypeEnum()

Get the type of spark command

Specified by:

getTypeEnum in class SparkCommand

Returns:

The SparkCommandType enum value.

getFileLoc

public java.lang.String getFileLoc()

Gets the file location.

Returns:

the file location.

getLoadFunction

public java.lang.String getLoadFunction()

Gets the load function

Returns:

the load function

getLoadFuncArgs

public java.lang.String getLoadFuncArgs()

Gets the arguments to load function.

Returns:

the arguments to load function

getInputSchemaDefinition

public java.lang.String getInputSchemaDefinition()
                                          throws GenerationException

Gets the valid definition of input schema .

Returns:

the valid Spark schema definition for input.

Throws:

GenerationException

getInputStructTypeSchemaDefinition

public java.util.List getInputStructTypeSchemaDefinition()
                                                  throws GenerationException

Gets the valid definition of input schema defined by the specified structure type, for the data frame that was read.

Returns:

the valid Spark schema definition for input.

Throws:

GenerationException

getInputStructTypeSchemaDefinitionDF

public java.util.List getInputStructTypeSchemaDefinitionDF()
                                                    throws GenerationException

Gets the valid definition of input schema defined by the specified structure type, for the data frame that was read.

Returns:

the valid Spark schema definition for input.

Throws:

GenerationException

getGenerateInputSchemaDefinition

public boolean getGenerateInputSchemaDefinition()

Gets a flag indicating if the input schema definition should be generated in the generated code.

Returns:

true for generating the "as ..." clause, false, other wise.

getOutputSchemaFieldList

public java.util.List getOutputSchemaFieldList()
                                        throws GenerationException

Generate the names for source columns.

Returns:

List of source columns.

Throws:

GenerationException

getOutputSchemaFields

public java.lang.String getOutputSchemaFields()
                                       throws GenerationException

Gets list of fields for output schema.

Returns:

The list of fields for output schema.

Throws:

GenerationException

getOutputSchemaFieldsDF

public java.lang.String getOutputSchemaFieldsDF()
                                         throws GenerationException

Gets list of fields for output schema, specific to DataFrames.

Returns:

The list of fields for output schema.

Throws:

GenerationException

needFormatOutput

public boolean needFormatOutput()

Return true if output format is needed.

Returns:

Boolean

isKeySupport

public boolean isKeySupport()

Return true if key is supported.

Returns:

Boolean

getTechnology

public java.lang.String getTechnology()

Get the technology type.

Returns:

The technology type.

isLoadFile

public boolean isLoadFile()

Return true if loading is for file.

Returns:

Boolean

getRowSep

public java.lang.String getRowSep()

Get the row separator.

Returns:

The row separator.

getFieldSep

public java.lang.String getFieldSep()

Get the file separator.

Returns:

The file separator.

getFileFormat

public java.lang.String getFileFormat()

Get the file format.

Returns:

The file format.

getLoadOptions

public java.lang.String getLoadOptions()

Get the load options

Returns:

The load options

getDateFormat

public java.lang.String getDateFormat()

Get Date format property

Returns:

Date format

getInferSourceShema

public boolean getInferSourceShema()

Get infer source schema property

Returns:

infer source schema

getInputAvroSchemaDef

public java.lang.String getInputAvroSchemaDef()

Returns:

setInputAvroSchemaDef

public void setInputAvroSchemaDef(java.lang.String inputAvroSchemaDef)

Parameters:

inputAvroSchemaDef -