com.oracle.eid.oozie.util

Class AvroUtils

java.lang.Object

com.oracle.eid.oozie.util.AvroUtils

public class AvroUtils
extends java.lang.Object

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	AvroUtils.AvroRecordBuilder Record builder implementation that can efficiently be used to convert multiple OES records into their Avro counterparts for a given Avro schema.

Constructor Summary

Constructors

Constructor and Description
AvroUtils()

Method Summary

Methods

Modifier and Type	Method and Description
static org.apache.avro.generic.GenericRecord	buildAvroData(Record fileRecord, java.util.Map<java.lang.String,java.lang.String> fieldNameMap, AvroUtils.AvroRecordBuilder avroRecordBuilder)
static org.apache.avro.Schema	buildSchema(java.lang.String schemaName, java.util.Collection<FieldMetadata> fieldDefinitions, java.util.Map<java.lang.String,java.lang.String> fieldNameMap) Creates an Avro schema representing the supplied OES field definitions.
protected static java.lang.Object	convertToAvroValue(java.util.List<java.lang.String> values, FieldMetadata.FieldType valueType, boolean singleValued, AvroStringValueFormatter formatter) Converts the given field values to their corresponding Avro values.
protected static org.apache.avro.Schema	getSchemaForField(FieldMetadata fieldMetadata) Returns the Avro schema that defines the way the given field would be stored in Avro.
static java.lang.String	handleDuplicateField(java.util.Collection<java.lang.String> fields, java.lang.String field)
protected static java.lang.String	scrubSchemaName(java.lang.String rawName) Converts the supplied name to a legal Avro schema name but replacing any invalid characters with underscores.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AvroUtils

public AvroUtils()

Method Detail

buildSchema

public static org.apache.avro.Schema buildSchema(java.lang.String schemaName,
                                 java.util.Collection<FieldMetadata> fieldDefinitions,
                                 java.util.Map<java.lang.String,java.lang.String> fieldNameMap)

Creates an Avro schema representing the supplied OES field definitions.

handleDuplicateField

public static java.lang.String handleDuplicateField(java.util.Collection<java.lang.String> fields,
                                    java.lang.String field)

buildAvroData

public static org.apache.avro.generic.GenericRecord buildAvroData(Record fileRecord,
                                                  java.util.Map<java.lang.String,java.lang.String> fieldNameMap,
                                                  AvroUtils.AvroRecordBuilder avroRecordBuilder)

convertToAvroValue

protected static java.lang.Object convertToAvroValue(java.util.List<java.lang.String> values,
                                  FieldMetadata.FieldType valueType,
                                  boolean singleValued,
                                  AvroStringValueFormatter formatter)

Converts the given field values to their corresponding Avro values.

Throws:

java.text.ParseException

scrubSchemaName

protected static java.lang.String scrubSchemaName(java.lang.String rawName)

Converts the supplied name to a legal Avro schema name but replacing any invalid characters with underscores. http://avro.apache.org/docs/1.7.5/spec.html#Names

getSchemaForField

protected static org.apache.avro.Schema getSchemaForField(FieldMetadata fieldMetadata)

Returns the Avro schema that defines the way the given field would be stored in Avro. This is either a nullable single value or a nullable array of values.