Agidx brick

An Agidx brick runs Agidx on a machine, creating a set of Agidx indices that support the Agraph program in a distributed environment.

The Agidx brick is used only in distributed environments and is run sequentially on multiple machines. On the first machine, the Agidx brick takes the Dgidx output from that machine as its input. On the next machine, the output from the first Agidx run is copied over, using a Fetch brick. It, along with the Dgidx output from that machine, is used as Agidx brick input.

Note: In many cases, a single AgraphIndex brick can take the place of several Agidx bricks, thus reducing overall script length.

Agidx brick settings

Setting

Description

input

The file prefix to the output of Dgidx on this machine.

prev_output

The file prefix of the Agidx data from the previous run, which has been copied to this machine by a Fetch brick. The prev_output setting is optional, and should not be used when running the Agidx brick on the first data subset.

output

The file prefix to the output of the Agidx run on this machine.

agidx_binary

Path to the Agidx (aggregated indexing) program.

Note: You can use this setting to override the endeca_mdex_bin default setting.

agidx_options

Command-line flags to pass to Agidx.

stdout

Where to redirect stdout for the brick. By default, stdout is sent to the screen. Specifying a value for stdout overrides the stdout_base setting.

stderr

Where to redirect stderr for the brick. By default, stderr is sent to the screen. Specifying a value for stderr overrides the stderr_base setting.

In the following Windows example, the results of an Agidx brick called agidx01 are passed to agidx02 and aggregated to that machine’s Dgidx results:
agidx_all : Script
	agidx01
	copy_agidx01
	agidx02
	copy_agidx02

agidx01 : Agidx
	working_machine = idx01
	input = C:\endeca\data\idx\exmpl_dgidx01
	output = C:\endeca\data\idx\exmpl_agidx01

copy_agidx01 : Fetch
	working_machine = idx02
	source = \
		ftp://idx01//endeca/data/idx/exmpl_agidx01.*
	dest = C:\endeca\data\idx\

agidx02 : Agidx
	working_machine = idx02
	input = C:\endeca\data\idx\exmpl_dgidx02
	prev_output = C:\endeca\data\idx\exmpl_agidx01
	output = C:\endeca\data\idx\exmpl_agidx02

copy_agidx02 : Fetch
	working_machine = ag01
	source = \ 
		ftp://idx02//endeca/data/idx/exmpl_agidx02.*
	dest = C:\endeca\data\idx\
Note: In many cases, scenarios similar to the one shown in this example can be handled more concisely by using an AgraphIndex brick.