|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
public interface IncrementalDataSourceRuntime
Interface that can be implemented by a DataSourceRuntime
that
handles its own incremental acquisitions (in contrast with CAS handling the incremental acquisition).
Once an InrementalDataSourceRuntime is created, CAS only calls checkFullAcquisitionRequired
if an incremental is requested to determine if runIncrementalAcquisition
should be called. CAS calls
runIncrementalAcquisition
if calling checkFullAcquisitionRequired
on
every data source and manipulator in the crawl returns false
.
DataSourceRuntime
Method Summary | |
---|---|
boolean |
checkFullAcquisitionRequired()
Indicates whether a full acquisition is required based on the state maintained by the IncrementalDataSourceRuntime . |
void |
runIncrementalAcquisition()
Runs an incremental acquisition of the data source. |
Method Detail |
---|
boolean checkFullAcquisitionRequired()
IncrementalDataSourceRuntime
.
If CAS determines a full acquisition is required, this method will not be called. CAS does not call this method if the data source is first created and has never been run or when a configuration change requires full acquisition.
PipelineComponentConfiguration.isFullAcquisitionRequired(PipelineComponentConfiguration)
void runIncrementalAcquisition() throws FatalExecutionException
This method will only be called by CAS when the checkFullAcquisitionRequired() method on this instance returns false. However, if CAS determines a full acquisition is required, checkFullAcquisitionRequired will not be called and consequently this method will not be called either.
CAS does not ensure records will be processed in the ordered they were output, so it is important for the implementation to only output one record for a given record id.
FatalExecutionException
- if acquisition failed and all processing of records already
output should stop.
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |