Configuring Batch Adapter Heuristic Properties

#

# --------------------------------------------------------------------------

#   Section:    MY AS400-UNIX

# --------------------------------------------------------------------------

#

MY AS400-UNIX!Commands Supported By FTP 
Server!value=APPE%CWD%DELE%LIST%MKD%NOOP%PASS%QUIT%RETR%RNFR%RNTO
%SITE%STOR%TYPE%USER!set=APPE%CWD%DELE%LIST%MKD%NOOP%PASS%QUIT%RETR
%RNFR%RNTO%SITE%STOR%TYPE%USER

MY AS400-UNIX!Header Lines To Skip!value=0!set=0

MY AS400-UNIX!Header Indication Regex Expression!value=!set=

MY AS400-UNIX!Trailer Lines To Skip!value=0!set=0

MY AS400-UNIX!Trailer Indication Regex Expression!value=!set=

MY AS400-UNIX!Directory Indication Regex Expression!value=!set=

MY AS400-UNIX!File Link Real Data Available!value=No!set=No%Yes

MY AS400-UNIX!File Link Indication Regex Expression!value=!set=

MY AS400-UNIX!File Link Symbol Regex Expression!value=!set=

MY AS400-UNIX!List Line Format!value=Fixed!set=Blank Delimited%Fixed

MY AS400-UNIX!Valid File Line Minimum Position!value=52!set=52

MY AS400-UNIX!File Name Is Last Entity!value=Yes!set=No%Yes

MY AS400-UNIX!File Name Position!value=52!set=52

MY AS400-UNIX!File Name Length!value=0!set=0

MY AS400-UNIX!File Extension Position!value=0!set=0

MY AS400-UNIX!File Extension Length!value=0!set=0

MY AS400-UNIX!File Size Verifiable!value=No!set=No%Yes

MY AS400-UNIX!File Size Position!value=0!set=0

MY AS400-UNIX!File Size Length!value=0!set=0

MY AS400-UNIX!Special Envelope For Absolute Pathname!value=!set=’’

MY AS400-UNIX!Listing Directory Yields Absolute Pathnames!value=No!set=No%Yes

MY AS400-UNIX!Absolute Pathname Delimiter Set!value=///!set=///

MY AS400-UNIX!Change Directory Before Listing!value=Yes!set=No%Yes

MY AS400-UNIX!Directory Name Requires Terminator!value=No!set=No%Yes

#

#

# --------------------------------------------------------------------------

#   Section:   UDH NT 4.0

# --------------------------------------------------------------------------

#

UDH NT 4.0!Commands Supported By FTP
 Server!value=APPE%CWD%DELE%LIST%MKD%NOOP%PASS%QUIT%RETR%RNFR%RNTO%SITE%
STOR%TYPE%USER!set=APPE%CWD%DELE%LIST%MKD%NOOP%PASS%QUIT%RETR%RNFR%RNTO%SITE%
STOR%TYPE%USER

UDH NT 4.0!Header Lines To Skip!value=0!set=0

UDH NT 4.0!Header Indication Regex Expression!value=!set=

UDH NT 4.0!Trailer Lines To Skip!value=0!set=0

UDH NT 4.0!Trailer Indication Regex Expression!value=!set=

UDH NT 4.0!Directory Indication Regex Expression!value=<DIR>!set=<DIR>

UDH NT 4.0!File Link Real Data Available!value=No!set=No%Yes

UDH NT 4.0!File Link Indication Regex Expression!value=\.lnk$!set=\.lnk$

UDH NT 4.0!File Link Symbol Regex Expression!value=!set=

UDH NT 4.0!List Line Format!value=Blank Delimited!set=Blank Delimited%Fixed

UDH NT 4.0!Valid File Line Minimum Position!value=4!set=4

UDH NT 4.0!File Name Is Last Entity!value=Yes!set=No%Yes

UDH NT 4.0!File Name Position!value=4!set=4

UDH NT 4.0!File Name Length!value=0!set=0

UDH NT 4.0!File Extension Position!value=0!set=0

UDH NT 4.0!File Extension Length!value=0!set=0

UDH NT 4.0!File Size Verifiable!value=Yes!set=No%Yes

UDH NT 4.0!File Size Position!value=3!set=3

UDH NT 4.0!File Size Length!value=0!set=0

UDH NT 4.0!Special Envelope For Absolute Pathname!value=!set=

UDH NT 4.0!Listing Directory Yields Absolute Pathnames!value=No!set=No%Yes

UDH NT 4.0!Absolute Pathname Delimiter Set!value=\\\\\\!set=\\\\\\

UDH NT 4.0!Change Directory Before Listing!value=No!set=No%Yes

UDH NT 4.0!Directory Name Requires Terminator!value=No!set=No%Yes

Commands Supported by FTP Server

Specifies the commands that the FTP server on the given host supports. 

One or more FTP commands as selected from the list. 

Header Lines To Skip

Specifies the number of beginning lines from a LIST command to be considered as a potential header (subject to the Header Indication Regex Expression configuration parameter, discussed below) and skipped.

A non-negative integer. Enter zero if there are no headers. 

For an example, see Header Lines To Skip.

Header Indication Regex Expression

Specifies a regular expression used to help identify lines which comprise the header in the output of a LIST command. All the declared lines of the header (see Header Lines To Skip, above) must match the regular expression.

A regular expression. The default varies based on the FTP server’s operating system. If there is no reliable way of identifying the header lines in the LIST command’s output, leave this parameter undefined.

Additional Information

The regular expression “^ *total” indicates that each line in the header starts with “total,” possibly preceded by blanks. For an example, see Header Indication Regex Expression.

If the regular expression is undefined, then the header is solely determined by the value of the configuration parameter Header Lines To Skip.

Trailer Lines To Skip

Specifies the number of ending lines from a LIST command that are to be considered as a potential Trailer (subject to the Trailer Indication Regex Expression) and skipped.

A non-negative integer. Enter zero if there are no trailers. 

Trailer Indication Regex Expression

Specifies the regular expression used to help identify lines which comprise the trailer in the output of a LIST command. All the declared lines of the trailer (see Trailer Lines To Skip) must match the regular expression.

A regular expression. If there is no reliable way of identifying the trailer lines in the LIST output, then leave this parameter undefined.

If the regular expression is undefined, then the header is determined solely by the value of the Trailer Lines To Skip configuration parameter.

Directory Indication Regex Expression

Specifies a regular expression used to identify external directories in the output of a LIST command. Directories cannot be retrieved and must be filtered out of the file list.

A regular expression. If there is no reliable way of identifying the directory in the LIST output, then leave this parameter undefined.

The regular expression “^ *d” specifies that a directory is indicated by a line starting with the lowercase ”d,’ possibly preceded by blanks. 

File Link Real Data Available

Specifies whether a file may be a file link (a pointer to a file) on those operating systems whereon an FTP server will return the data for the real file as opposed to the content of the link itself. 

Select Yes or No.

File Link Indication Regex Expression

Specifies a regular expression that identifies external file links in the output of a LIST command. File links are pointers to the real file and usually have some visual symbol, such as- >, mixed in with the file name in the output of the LIST command. Only the link name is desired within the returned list.

A regular expression. If there is no reliable way of identifying a file link within a LIST output, then leave this parameter undefined.

Additional Information

The regular expression “^ *l” specifies that a file link is indicated by a line starting with the lowercase “l,” preceded possibly by blanks. 

File Link Symbol Regex Expression

Specifies a regular expression that parses the external file link name in the output of a LIST command. Only the link name is required for the file list to be returned.

A regular expression. If there is no reliable way of identifying a file link within a LIST output, then leave this parameter undefined.

The regular expression “[ ] ->[ ]” defines that a file link symbol is represented by an arrow surrounded by spaces (“ -> “). When parsed, only the file name to the right of the symbol is used. 

In the example, File Link Symbol Regex Expression, only the public_html would be used, not the “p” character:

List Line Format

Specifies whether fields in each line are blank delimited or fixed, that is, whether information always appears at certain columns. 

Select Blank Delimited or Fixed.

For a Fixed list line format, enter a value equal to the number of columns, counting the first column at the far left as column 1. For a Blank Delimited list line format, enter a value equal to the number of fields, counting the first field on the far left as field 1.

For either case, if no minimum can be determined, set this value to zero (0). 

Additional Information

In the Blank Delimited line in the example in List Line Format, the minimum number of fields is 9:

Valid File Line Minimum Position

Specifies the minimum number of positions (inclusive) a listing line must have in order to be considered as a possible valid file name line. 

The URL FTP Proxy will fail on ascertaining file names that have leading blanks, trailing blanks, or both.

File Name Is Last Entity

Specifies whether the file name is the last entity on each line. This allows the file name to have imbedded blanks (however, leading or trailing blanks are not supported). 

Select Yes or No.

File Name Position

Specifies the starting position (inclusive) of a file name. 

For Fixed list line format, enter the column number, counting the first column on the far left as column 1. For Blank Delimited list line format, enter the field number, counting the first field on the extreme left as field 1.

Additional Information

For Blank Delimited List Line Format only, if the file name has imbedded blanks, then it can span over several fields. For an example, see File Name Position.

File Name Length

Represents the maximum width of a file name; valid only for Fixed list line format.

Enter any one of the following: 

• An Integer: Positive lengths imply that the file name is right-justified within the maximum field width, and thus leading-blanks are discarded.

  • Negative Lengths: That is, compared to the absolute length, imply that the file name is left-justified and trailing-blanks are discarded.

  • Zero (0) Value Length: If the file name is at the end of a file listing line, this value implies that the file name field extends to the end of the line.

    ---

    Note –

    For Blank Delimited list line format, this value is usually zero (0). However, if the File Name Length parameter is supplied even though a Blank Delimited list line format is specified, this implies that if the file name field exceeds the given length, then the rest of the List Line data occurs on the following line.

    ---

File Extension Position

Specifies the left-most position of the file extension for those operating systems that present the file name extension separated from the main file name. 

For Fixed list line format, enter the column number, counting the first column at the extreme left as column 1. For Blank Delimited list line format, enter the field number, counting the first field at the far left as field 1. If there is no file extension (as on UNIX systems) set the value to zero (0).

File Extension Length

Specifies the maximum width of the file extension; valid only for Fixed list line format.

Enter any one of the following: 

An Integer

• Positive Lengths: Imply that the file extension is right-justified within the maximum field width and therefore leading-blanks are discarded.

• Negative Lengths: Imply that the file extension is left-justified and trailing-blanks are discarded (the absolute length is used).

• Value of Zero (0): Always for the Blank Delimited list line format.

File Size Verifiable

Specifies whether the file size is verifiable, significant, and accurate within a directory listing. 

Select Yes or No. The File Size Stability Check configurable parameter must also be enabled.

Additional Information

Even if the file size field of a listing line is not significant (that is, it is there but only represents an approximate value), the value of this parameter must be No. However, the file size location must still be declared in the File Size Position to assist determining which line of listing represents a valid file name. For an example, see File Size Verifiable.

Use of this parameter does not guarantee that the file is actually stable. As this feature is intended only for backward compatibility with previous FTP implementations, we do not recommend that you rely on this functionality for critical data.

File Size Position

Specifies the left-most position in the listing line that represents the size of the file. Even though for some operating systems the value shown might not truly reflect the file size, this position is still important in ascertaining that the line contains a valid file name. 

A non-negative integer. For Fixed list line format, the position value is the column number (starting with one (1) on the far left). For Blank Delimited, this value represents the field number (starting with one (1) on the far left). If the LIST line does not have a size field, set this parameter to zero (0). For an example, see File Size Position.

File Size Length

Specifies the maximum width (number of columns) of the file size field, only valid for Fixed List Line Format.

A non-negative integer. For Blank Delimited list line format, set this value to zero (0).

Special Envelope For Absolute Path Name

Specifies special enveloping characters required to surround an absolute path name (for example, single quotes are used in MVS). Only use a single quote at the start of the directory name. 

A pair of enveloping characters. Even if the leading and trailing character is identical, enter it twice. 

If no enveloping characters are required for an operating system, leave this parameter undefined. 

On UNIX, this parameter is always undefined.

Listing Directory Yields Absolute Path Names

Specifies whether, when the DIR command is used on a directory name, the resulting file names are absolute.

Select Yes or No.

On UNIX, this character is always set to No.

Absolute Path Name Delimiter Set

Specifies any absolute path requiring certain delimiters to separate directory names (or their equivalent) from each other and from the file name. 

Enter the delimiters for the absolute path, starting from the left, for: 

• Initial (left-most) directory delimiter

• Intermediate directory delimiters

• Initial (left-most) file name delimiter

• Optionally, the ending (right-most) file name delimiter

Wherever there is no specific delimiter, use “\0” (backslash zero) to act as a placeholder. Delimiters that are backslashes need to be escaped with another backslash. 

Change Directory Before Listing

Determines whether a change directory (cd) command needs to be done before issuing the DIR command to get a listing of files under the desired directory.

Select Yes or No.

The current Batch Adapter implementation does not rely on this parameter.

Directory Name Requires Terminator

Determines whether a directory name that is not followed immediately by a file name requires the ending directory delimiter as a terminator (for example, as on VMS). 

Select Yes or No.

Header Lines To Skip

Header Indication Regex Expression

Directory Indication Regex Expression

File Link Indication Regex Expression

File Link Symbol Regex Expression

List Line Format

Directory Indication Regex Expression

File Name Position

File Size Verifiable

File Size Position

       -rw-r--r--   1 ed        usr           110 Apr 15 13:33 aaa
       ^^^^^^^^^^   ^ ^^        ^^^           ^^^ ^^^ ^^ ^^^^^ ^^^
            1        2  3         4             5   6  7    8    9
                                           File
                                              Size

The following text represents valid number representations of file sizes: 

      1234 or 1,234,567 or -12345 or +12345 or ’  1234  ’ 
or 12/34       or 1,234/56

The following text represents invalid number representations of file sizes (the ^ indicates where the error occurs): 

      ’12 34’ or 123,45,678 or 123-456-789 or --123 or 123-
         ^          ^                 ^        ^          ^
      or 12345678901 or any number > 4294967295 or < -2147483647
         ^ (too large)
      or 123.45 or 12AB34 or 0x45 or ,123,456 or 12//34
            ^        ^        ^      ^              ^
      or /123 or 123/ or 12,3/45
         ^          ^        ^

UNIX 

/dir1/dir2/file.ext

/ 

/ 

/ 

/// 

Windows 

C:\dir1\dir2\file.ext

\\ 

\\ 

\\ 

\\\\\\ 

VMS 

disk1:[dir1.dir2]file.ext;1

[ 

. 

] 

; 

[.]; 

MVS PDS 

dir1.dir2(member)

\0 

. 

( 

) 

\0.() 

MVS Sequential 

dir1.dir2.filename

\0 

. 

. 

\0.. 

MVS GDG 

dir1.dir2.file(version#) (see Note)

\0 

. 

. 

\0.. 

AS400 

dir1/file.ext

\0 

/ 

. 

\0/.