public class DeDuplicationHandlerImpl extends java.lang.Object implements DeDuplicationHandler
Modifier and Type | Field and Description |
---|---|
static ShortField |
DUPLICATE |
static ShortField |
FUTURE_RECORD |
static ShortField |
NO_DUPLICATE |
static ShortField |
TOO_OLD |
Constructor and Description |
---|
DeDuplicationHandlerImpl(TimePartitionManager partitionMgr)
Default Constructor
|
Modifier and Type | Method and Description |
---|---|
ShortField |
isDuplicate(MillisField timestamp,
StringField key)
Determines if the event is a duplicate
|
ShortField |
isDuplicate(MillisField timestamp,
StringField timezoneID,
StringField key)
Determines if the event is a duplicate
|
public static final ShortField NO_DUPLICATE
public static final ShortField DUPLICATE
public static final ShortField TOO_OLD
public static final ShortField FUTURE_RECORD
public DeDuplicationHandlerImpl(TimePartitionManager partitionMgr)
partitionMgr
- The partition managerpublic ShortField isDuplicate(MillisField timestamp, StringField timezoneID, StringField key) throws java.lang.Exception
isDuplicate
in interface DeDuplicationHandler
timestamp
- The timestamptimezoneID
- The TimeZone ID (i.e. UTC)key
- The de-duplication key to usejava.lang.Exception
- if any issue occurs while trying to determine if this is a duplicate eventpublic ShortField isDuplicate(MillisField timestamp, StringField key) throws java.lang.Exception
isDuplicate
in interface DeDuplicationHandler
timestamp
- The timestamp (assumed to be UTC)key
- The de-duplication key to usejava.lang.Exception
- if any issue occurs while trying to determine if this is a duplicate event