BEA Logo BEA MessageQ Release 5.0

  Corporate Info  |  News  |  Solutions  |  Products  |  Partners  |  Services  |  Events  |  Download  |  How To Buy

 

   MessageQ Doc Home   |   FML Programmer's Guide   |   Previous Topic   |   Next Topic   |   Contents   

Field Manipulation Functions

 

Introduction

This chapter describes all FML32 functions exception run-time mapping (which is described in Chapter 4). In this chapter you will learn:

FML and FML32

There are two variants of FML. The original FML interface is based on 16-bit values for the length of fields and contains information identifying fields (hence FML16). FML16 is limited to 8191 unique fields, individual field lengths of up to 64K bytes, and a total fielded buffer size of 64K.

A second interface, FML32, uses 32-bit values for field lengths and identifiers. It allows for about 30 million fields, and field and buffer lengths of about 2 billion bytes. The definitions, types, and function prototypes for FML32 are in fml32.h. Functions live in -lfml32.

BEA MessageQ supports only FML32. Do not use 16-bit FML functions in developing MessageQ applications.

The names of all definitions, types, and functions for FML32 have a "32" suffix (for example, MAXFBLEN32, FBFR32, FLDID32, FLDLEN32, Fchg32(), and error code Ferror32()). Also the environment variables are suffixed with "32" (for example, FLDTBLDIR32 and FIELDTBLS32). For FML32, a fielded buffer pointer is of type "FBFR32 *", a field length has the type FLDLEN32, and the number of occurrences of a field has the type FLDOCC32. Also note that the default required alignment for FML32 buffers is 4-byte alignment.

FML32 Parameters

To make it easier to remember the parameters for the FML32 functions, a convention has been adopted for the sequence of function parameters. FML32 parameters appear in the following sequence:

  1. For functions that require a pointer to a fielded buffer (FBFR32), this parameter is first. If a function takes two fielded buffer pointers (such as the transfer functions), the destination buffer comes first followed by the source buffer. A fielded buffer pointer must point to an area that is aligned on a short boundary (or an error is returned with Ferror32() set to FALIGNERR) and the area must be a fielded buffer (or an error is returned with Ferror32() set to FNOTFLD).

  2. For the input/output functions, a pointer to a stream follows the fielded buffer pointer.

  3. For functions that need one, a field identifier (type FLDID32) appears next (in the case of Fnext32(), it is a pointer to a field identifier).

  4. For functions that need a field occurrence (type FLDOCC32), this parameter comes next (for Fnext32(), it is a pointer to an occurrence number).

  5. In functions where a field value is passed to or from the function, a pointer to the beginning of the field value is given next (defined as a character pointer but may be cast from any other pointer type).

  6. When a field value is passed to a function that contains a character array (carray) field, you must specify its length as the next parameter (type FLDLEN32). For functions that retrieve a field value, a pointer to the length of the retrieval buffer must be passed to the function and this length parameter is set to the length of the value retrieved.

  7. A few functions require special parameters and differ from the preceding conventions; these special parameters appear after the above parameters and will be discussed in the individual function descriptions.

  8. The following NULL values are defined for the various field types: 0 for short and long; 0.0 for float and double; \0 for string (1 byte in length); and a zero-length string for carray.

Field Identifier Mapping Functions

Several functions allow the programmer to query field tables or field identifiers for information about fields during program execution.

Fldid32

Fldid32() returns the field identifier for a given valid field name and loads the field name/fieldid mapping tables from the field table files, if they do not already exist:

FLDID32
Fldid32(char *name)

where name is a valid field name.

The space used by the mapping tables in memory can be freed using the Fnmid_unload32() function. Note that these tables are separate from the tables loaded and used by the Fname32() function.

Fname32

Fname32() returns the field name for a given valid field identifier and loads the fieldid/name mapping tables from the field table files, if they do not already exist:

char *
Fname32(FLDID32 fieldid)

where fieldid is a valid field identifier.

The space used by the mapping tables in memory can be freed using the Fidnm_unload32() function. Note that these tables are separate from the tables loaded and used by the Fldid32() function.

Fldno32

Fldno32() extracts the field number from a given field identifier:

FLDOCC32
Fldno32(FLDID32 fieldid)

where fieldid is a valid field identifier.

Fldtype32

Fldtype32() extracts the field type (an integer, as defined in fml32.h) from a given field identifier.

int
Fldtype32(FLDID32 fieldid)

where fieldid is a valid field identifier.

Table 5-1 shows the possible values returned by Fldtype32() and their meanings.

Table 5-1 Field Types Returned by Fldtype

Return Value

Meaning

0

short integer

1

long integer

2

character

3

single-precision float

4

double-precision float

5

null-terminated string

6

character array

Ftype32

Ftype32() returns a pointer to a string containing the name of the type of a field given a field identifier:

char *
Ftype32(FLDID32 fieldid)

where fieldid is a valid field identifier.

For example:

char *typename
. . .
typename = Ftype32(fieldid);

returns a pointer to one of the following strings: short, long, char, float, double, string, or carray.

Fmkfldid32

As part of an application generator, or to reconstruct a field identifier, it might be useful to be able to make a field identifier from a type specification and an available field number. Fmkfldid32() provides this functionality:

FLDID32
Fmkfldid32(int type, FLDID32 num)

where

t type is a valid type (an integer; see Fldtype32(), above)

t num is a field number (it should be an unused field number, to avoid confusion with existing fields)

Buffer Allocation and Initialization

Most FML32 functions require a pointer to a fielded buffer as an argument. The typedef FBFR32 is available for declaring such pointers, as in this example:

FBFR32 *fbfr32;

In this chapter, the variable fbfr32 will be used to mean a pointer to a fielded buffer.

Never attempt to declare fielded buffers themselves, only pointers to them. The functions used to reserve space for fielded buffers are explained in the following pages, but first we will describe a function that can be used to determine whether a given buffer is in fact a fielded buffer.

Fielded32

Fielded32() is used to test whether the specified buffer is fielded.

int
Fielded32(FBFR32 *fbfr32)

Fielded32() returns true (1) if the buffer is fielded. If the buffer is not fielded, Fielded32() returns false (0) and does not set Ferror32().

Fneeded32

The amount of memory to allocate for a fielded buffer depends on the maximum number of fields that buffer will contain and the total amount of space needed for all the field values. The function Fneeded can be used to determine the amount of space (in bytes) needed for a fielded buffer; it takes the number of fields and the space needed for all field values (in bytes) as arguments.

long
Fneeded32(FLDOCC32 F, FLDLEN32 V)

where

t F is the number of fields

t V is the space for field values, in bytes

The space needed for field values is computed by estimating the amount of space that would be required by each field value if stored in standard structures (for example, a long is stored as a long and needs four bytes). For a variable length field, you should estimate the average amount of space needed. The space calculated by Fneeded includes a fixed overhead for each field in addition to the space needed for the field values.

Once you obtain the estimate of space from Fneeded32(), you can allocate the desired number of bytes using malloc(3) and set up a pointer to the allocated memory space. For example, the following allocates space for a fielded buffer large enough to contain 25 fields and 300 bytes of values:

#define NF 25
#define NV 300
extern char *malloc;
. . .
if((fbfr32 = (FBFR32 *)malloc(Fneeded32(NF, NV))) == NULL)
F_error("pgm_name"); /* no space to allocate buffer */

However, this allocated memory space is not yet a fielded buffer. Finit32() must be used to initialize it.

Finit32

The Finit32() function initializes an allocated memory space as a fielded buffer.

int
Finit32(FBFR32 *fbfr32, FLDLEN32 buflen)

where

t fbfr32 is a pointer to an uninitialized fielded buffer

t buflen is the length of the buffer, in bytes

A call to Finit32() to initialize the memory space allocated in the example above (in the Fneeded32() section) would look like the following:

Finit32(fbfr32, Fneeded32(NF, NV));

Now fbfr32 points to an initialized, empty fielded buffer. Up to Fneeded32(NF, NV) bytes minus a small amount are available in the buffer to hold fields.

Note: The numbers used in the malloc(3) call (see the example in the Fneeded32() section) and Finit32() call must be the same.

Falloc32

Calls to Fneeded32(), malloc(3) and Finit32() may be replaced by a single call to Falloc32(), which allocates the desired amount of space and initializes the buffer.

FBFR32 *
Falloc32(FLDOCC32
F, FLDLEN32 V)

where

t F is the number of fields

t V is the space for field values, in bytes

A call to Falloc32() that would replace the examples above would look like the following:

extern FBFR32 *Falloc32;
. . .
if((fbfr32 = Falloc32(NF, NV)) == NULL)
F_error("pgm_name"); /* couldn't allocate buffer */

Storage allocated with Falloc32() (or Fneeded32(), malloc(3) and Finit32()) should be freed with Ffree32().

Ffree32

Ffree32() is used to free memory space allocated as a fielded buffer.

int
Ffree32(FBFR32 *fbfr32)

where fbfr32 is a pointer to a fielded buffer

For example:

 #include  <fml32.h>
. . .
if(Ffree32(fbfr32) 0)
F_error("pgm_name"); /* not fielded buffer */

Ffree32() is recommended as opposed to free(3), because Ffree32() will invalidate a fielded buffer whereas free(3) will not. It is necessary to invalidate fielded buffers because malloc(3) re-uses memory that has been freed, without clearing it. Thus, if free(3) were used, it would be possible for malloc to return a piece of memory that looks like a valid fielded buffer, but is not.

Space for a fielded buffer may also be reserved directly. The buffer must begin on a short boundary.

The following code is analogous to the preceding example but Fneeded32() cannot be used to size the static buffer since it is not a macro.

/* the first line aligns the buffer */
static short buffer[500/sizeof(short)];
FBFR32 *fbfr32=(FBFR32 *)buffer;
. . .
Finit32(fbfr32, 500);

It should be emphasized that the following code is quite wrong:

FBFR32 badfbfr;
. . .
Finit32(&badfbfr, Fneeded32(NF, NV));

The structure for FBFR32 is not defined in the user header files so this code will produce a compilation error.

Fsizeof32

Fsizeof32() returns the size of a fielded buffer in bytes:

long
Fsizeof32(FBFR32 *fbfr32)

where fbfr32 is a pointer to a fielded buffer

For example:

long bytes;
. . .
bytes = Fsizeof32(fbfr32);

Fsizeof32() returns the same number that Fneeded32() returned when the fielded buffer was originally allocated.

Funused32

Funused32() may be used to determine how much space is available in a fielded buffer for additional data:

long
Funused32(FBFR32 *fbfr32)

where fbfr32 is a pointer to a fielded buffer

For example:

long unused;
. . .
unused = Funused32(fbfr32);

Note that Funused32() does not indicate where, in the buffer, the unused bytes are located; it indicates only the number of unused bytes.

Fused32

Fused32() may be used to determine how much space is used in a fielded buffer for data and overhead:

long
Fused32(FBFR32 *fbfr32)

where fbfr32 is a pointer to a fielded buffer

For example:

long used;
. . .
used = Fused32(fbfr32);

Note that Fused32() does not indicate where, in the buffer, the used bytes are located; it indicates only the number of used bytes.

Frealloc32

At some point (such as during the addition of a new field value) the buffer may run out of space. Frealloc32() can be used to increase (or decrease) the size of the buffer:

FBFR32 *
Frealloc32(FBFR32 *fbfr32, FLDOCC32 nf, FLDLEN32 nv)

where

t fbfr32 is a pointer to a fielded buffer

t nf is the new number of fields or 0

t nv is the new space for field values, in bytes

For example:

FBFR32 *newfbfr32;
. . .
if((newfbfr32 = Frealloc32(fbfr32, NF+5, NV+300)) == NULL)
F_error32("pgm_name"); /* couldn't re-allocate space */
else
fbfr32 = newfbfr32; /* assign new pointer to old */

In this case, the application needed to remember the number of fields and the number of bytes of space previously allocated for field values. Note that the arguments to Frealloc32() (as with its counterpart realloc(3)) are absolute values, not increments. This example will not work if space needs to be re-allocated several times.

The following example shows a second way of incrementing the allocated space:

/* define the increment size when buffer out of space */
#define INCR 400
FBFR32 *newfbfr32;
. . .
if((newfbfr32 = Frealloc32(fbfr32, 0, Fsizeof(fbfr32)+INCR)) == NULL)
F_error32("pgm_name"); /* couldn't re-allocate space */
else
fbfr32 = newfbfr32; /* assign new pointer to old */

Note that you do not need to know the number of fields or the amount of space for field values with which the buffer was last initialized. Thus, the easiest way to increase the size is to use the current size plus the increment as the space for field values. The above example could be executed as many times as needed without remembering past executions or values. The user need not call Finit32() after calling Frealloc32().

If the amount of additional space requested in the call to Frealloc32() is contiguous to the old buffer, newfbfr32 and fbfr32 in the examples above will be the same. However, defensive programming dictates that the user should declare newfbfr32 as a safeguard against the case where either a new value or NULL is returned. If Frealloc32() fails, do not use fbfr32 again.

Note: You cannot reduce the size of a fielded buffer to less than the amount of space (in bytes) currently being used in the buffer.

Functions for Moving Fielded Buffers

The only restriction on the location of fielded buffers is that they must be aligned on a short boundary. Otherwise, fielded buffers are position-independent and may be moved freely around in memory.

Fmove32

If src points to a fielded buffer and dest points to an area of storage big enough to hold it, then the following might be used to move the fielded buffer:

FBFR32 *src;
char *dest;
. . .
memcpy(dest, src, Fsizeof32(src));

The function memcpy (one of the C runtime memory management functions) moves the number of bytes indicated by its third argument from the area pointed to by its second argument to the area pointed to by its first argument.

While memcpy may be used to copy a fielded buffer, the destination copy of the buffer looks just like the source copy. In particular, for example, the destination copy has the same number of unused bytes as the source buffer.

Fmove32() acts like memcpy, but does not need an explicit length (it is computed):

int
Fmove32(char *dest, FBFR32 *src)

where

t dest is a pointer to the destination buffer

t src is a pointer to the source fielded buffer

For example:

FBFR32 *src;
char *dest;
. . .
if(Fmove32(dest,src) < 0)
F_error("pgm_name");

Fmove32() checks that the source buffer is indeed a fielded buffer, but does not modify the source buffer in any way.

The destination buffer need not be a fielded buffer (that is, it need not have been allocated using Falloc32()), but it must be aligned on a short boundary (4-byte alignment for FML32). Thus, Fmove32() provides an alternative to Fcpy32() (see below) when it is desired to copy a fielded buffer to a non-fielded buffer, but Fmove32() does not check to make sure there is enough room in the destination buffer to receive the source buffer.

Fcpy32

Fcpy32() is used to overwrite one fielded buffer with another:

int
Fcpy32(FBFR32 *dest, FBFR32 *src)

where

t dest is a pointer to the destination fielded buffer

t src is a pointer to the source fielded buffer

Fcpy32() preserves the overall buffer length of the overwritten fielded buffer; thus, Fcpy32() is useful for expanding or reducing the size of a fielded buffer. For example:

FBFR32 *src, *dest;
. . .
if(Fcpy32(dest, src) 0)
F_error32("pgm_name");

Unlike Fmove32(), where dest could point to an uninitialized area, Fcpy32() expects dest to point to an initialized fielded buffer (allocated using Falloc32()) and also checks to see that it is big enough to accommodate the data from the source buffer.

Note: You cannot reduce the size of a fielded buffer to less than the amount of space (in bytes) currently being used in the buffer.

As with Fmove32(), the source buffer is not modified by Fcpy32().

Field Access and Modification Functions

This section discusses how to update and access fielded buffers using the field types of the fields without doing any conversions. The functions that allow you to convert data from one type to another upon transfer to/from a fielded buffer are listed under "Conversion Functions" later in this chapter.

Fadd32

The Fadd32() function adds a new field value to the fielded buffer.

int
Fadd32(FBFR32 *fbfr32, FLDID32 fieldid, char *value, FLDLEN32 len)

where

t fbfr32 is a pointer to a fielded buffer

t fieldid is a field identifier

t value is a pointer to a new value. Its type is shown as char*, but when it is used, its type must be the same type as the value to be added (see below)

t len is the length of the value if its type is FLD_CARRAY

If no occurrence of the field exists in the buffer, then the field is added. If one or more occurrences of the field already exist, then the value is added as a new occurrence of the field, and is assigned an occurrence number 1 greater than the current highest occurrence. (To add a specific occurrence, Fchg32() must be used.)

Fadd32(), like all other functions that take or return a field value, expects a pointer to a field value, never the value itself.

If the field type is such that the field length is fixed (short, long, char, float, or double) or can be determined (string), the field length need not be given (it is ignored). If the field type is a character array, the length must be specified; the length is defined as type FLDLEN32. For example:

FLDID32 fieldid, Fldid32;
FBFR32 *fbfr32;
. . .
fieldid = Fldid32("fieldname");
if(Fadd32(fbfr32, fieldid, "new value", (FLDLEN32)9) < 0)
F_error32("pgm_name");

gets the field identifier for the desired field and adds the field value to the buffer.

It is assumed (by default) that the native type of the field is a character array so that the length of the value must be passed to the function. If the value being added is not a character array, the type of value must reflect the type of the value it points to; for instance, the following example adds a long field value:

long lval;
. . .
lval = 123456789;
if(Fadd32(fbfr32, fieldid, lval, (FLDLEN32)0) < 0)
F_error32("pgm_name");

For character array fields, null fields may be indicated by a length of 0. For string fields, the null string may be stored since the NULL terminating byte is actually stored as part of the field value: a string consisting of only the NULL terminating byte is considered to have a length of 1. For all other types (fixed length types), you may choose some special value that is interpreted by the application as a NULL, but the size of the value will be taken from its field type (e.g., length of four for a long) regardless of what value is actually passed. Passing a NULL value address will result in an error (FEINVAL).

Fappend32

The Fappend32() function appends a new field value to the fielded buffer.

int
Fappend32(FBFR32 *fbfr32, FLDID32 fieldid, char *value, FLDLEN32 len)

where

t fbfr32 is a pointer to a fielded buffer

t fieldid is a field identifier

t value is a pointer to a new value. Its type is shown as char *, but when it is used, its type must be the same type as the value to be appended (see below)

t len is the length of the value if its type is FLD_CARRAY

Fappend32() appends a new occurrence of the field fieldid with a value located at value to the fielded buffer and puts the buffer into append mode. Append mode provides optimized buffer construction for large buffers constructed of many rows of a common set of fields. A buffer that is in append mode is restricted as to what operations may be performed on the buffer. Only calls to the following FML32 routines are allowed in append mode: Fappend32(), Findex32(), Funindex32(), Ffree32(), Fused32(), Funused32() and Fsizeof32(). Calls to Findex32() or Funindex32() will end append mode. The following example shows the construction of a 500-row buffer with five fields per row using Fappend32().

for (i=0; i 500 ;i++) {
if ((Fappend32(fbfr32, LONGFLD1, &lval1[i], (FLDLEN32)0) < 0) ||
(Fappend32(fbfr32, LONGFLD2, &lval2[i], (FLDLEN32)0) < 0) ||
(Fappend32(fbfr32, STRFLD1, &str1[i], (FLDLEN32)0) < 0) ||
(Fappend32(fbfr32, STRFLD2, &str2[i], (FLDLEN32)0) < 0) ||
(Fappend32(fbfr32, LONGFLD3, &lval3[i], (FLDLEN32)0) < 0)) {
F_error32("pgm_name");
break;
}
}
Findex32(fbfr32, 0);

Fappend32(), like all other functions that take or return a field value, expects a pointer to a field value, never the value itself.

If the field type is such that the field length is fixed (short, long, char, float, or double) or can be determined (string), the field length need not be given (it is ignored). If the field type is a character array, the length must be specified; the length is defined as type FLDLEN32.

It is assumed (by default) that the native type of the field is a character array so that the length of the value must be passed to the function. If the value being appended is not a character array, the type of value must reflect the type of the value it points to.

For character array fields, null fields may be indicated by a length of 0. For string fields, the null string may be stored since the NULL terminating byte is actually stored as part of the field value: a string consisting of only the NULL terminating byte is considered to have a length of 1. For all other types (fixed length types), you may choose some special value that is interpreted by the application as a NULL, but the size of the value will be taken from its field type (e.g., length of four for a long) regardless of what value is actually passed. Passing a NULL value address will result in an error, (FEINVAL).

Fchg32

Fchg32() changes the value of a field in the buffer.

int
Fchg32(FBFR32 *fbfr32, FLDID32 fieldid, FLDOCC32 oc, char *value, FLDLEN32 len)

where

t fbfr32 is a pointer to a fielded buffer

t fieldid is a field identifier

t oc is the occurrence number of the field

t value is a pointer to a new value. Its type is shown as char *, but when it is used, its type must be the same type as the value to be added (see Fadd32())

t len is the length of the value if its type is FLD_CARRAY

For example, to change a field of type carray to a new value stored in value:

FBFR32 *fbfr32;
FLDID32 fieldid;
FLDOCC32 oc;
FLDLEN32 len;
char value[50];
. . .
strcpy(value, "new value");
flen = strlen(value);
if(Fchg32(fbfr32, fieldid, oc, value, len) < 0)
F_error32("pgm_name");

If oc is -1, then the field value is added as a new occurrence to the buffer. If oc is 0 or greater and the field is found, then the field value is modified to the new value specified. If oc is 0 or greater and the field is not found, then NULL occurrences are added to the buffer until the value can be added as the specified occurrence. For example, changing field occurrence 3 for a field that does not exist on a buffer will cause three NULL occurrences to be added (occurrences 0, 1 and 2), followed by occurrence 3 with the specified field value. Null values consist of the NULL string "\0" (1 byte in length) for string and character values, 0 for long and short fields, 0.0 for float and double values, and a zero-length string for a character array.

The new or modified value is contained in value. If it is a character array, its length is given in len (len is ignored for other field types). If the value pointer is NULL and the field is found, then the field is deleted. If the field occurrence to be deleted is not found, it is considered an error (FNOTPRES).

The buffer must have enough room to contain the modified or added field value, or an error is returned (FNOSPACE).

Fcmp32

Fcmp32() compares the field identifiers and field values of two fielded buffers.

int
Fcmp32(FBFR32 *fbfr321, FBFR32 *fbfr322)

where

t fbfr321 and fbfr322 are pointers to fielded buffers

The function returns a 0 if the buffers are identical; it returns a -1 on any of the following conditions:

t the fieldid of a fbfr321 field is less than the field id of the corresponding field of fbfr322

t the value of a fbfr321 field is less than the value of the corresponding field of fbfr322

t fbfr1 is shorter than fbfr322

Fcmp32() returns a 1 if the reverse of any of the above conditions is true (for example, if the field ID of a fbfr322 field is less than the field ID of the corresponding field of fbfr321, and so on).

Fdel32

The Fdel32() function deletes the specified field occurrence.

int
Fdel32(FBFR32 *fbfr32, FLDID32 fieldid, FLDOCC32 oc)

where

t fbfr32 is a pointer to a fielded buffer

t fieldid is a field identifier

t oc is the occurrence number

For example,

FLDOCC32 occurrence;
. . .
occurrence=0;
if(Fdel32(fbfr32, fieldid, occurrence) < 0)
F_error32("pgm_name");

deletes the first occurrence of the field indicated by the specified field identifier. If it does not exist, the function returns -1 (Ferror32() is set to FNOTPRES).

Fdelall32

Fdelall32() deletes all occurrences of the specified field from the buffer:

int
Fdelall32(FBFR32 *fbfr32, FLDID32 fieldid)

where

t fbfr32 is a pointer to a fielded buffer

t fieldid is a field identifier

For example:

if(Fdelall32(fbfr32, fieldid) < 0)
F_error32("pgm_name"); /* field not present */

If the field is not found, the function returns -1 (Ferror32() is set to FNOTPRES).

Fdelete32

Fdelete32() deletes all occurrences of all fields listed in the array of field identifiers, fieldid[]:

int
Fdelete32(FBFR32 *fbfr32, FLDID32 *fieldid)

where

t fbfr32 is a pointer to a fielded buffer

t fieldid is a pointer to the list of field identifiers to be deleted

The update is done directly to the fielded buffer. The array of field identifiers does not need to be in any specific order, but the last entry in the array must be field identifier 0 (BADFLDID). For example:

#include "fld.tbl.h"
FBFR32 *dest;
FLDID32 fieldid[20];
. . .
fieldid[0] = A; /* field id for field A */
fieldid[1] = D; /* field id for field D */
fieldid[2] = BADFLDID; /* sentinel value */
if(Fdelete32(dest, fieldid) < 0)
F_error32("pgm_name");

If the destination buffer has fields A, B, C, and D, this example will result in a buffer that contains only occurrences of fields B and C.

Fdelete32() is a more efficient way of deleting several fields from a buffer than using several Fdelall32() calls.

Ffind32

Ffind32() finds the value of the specified field occurrence in the buffer:

char *
Ffind32(FBFR32 *fbfr32, FLDID32 fieldid, FLDOCC32 oc, FLDLEN32 *len)

where

t fbfr32 is a pointer to a fielded buffer

t fieldid is a field identifier

t oc is the occurrence number

t len is the length of the value found

In the declaration above the return value to Ffind32() is shown as a character pointer data type (char* in C). The actual type of the pointer returned is the same as the type of the value it points to.

An example of the use of the function is:

#include "fld.tbl.h"
FBFR32 *fbfr32;
FLDLEN32 len;
char* Ffind32, *value;
. . .
if((value=Ffind32(fbfr32,ZIP,0, &len)) == NULL)
F_error32("pgm_name");

If the field is found, its length is returned in len (if len is NULL, the length is not returned), and its location is returned as the value of the function. If the field is not found, NULL is returned, and Ferror32() is set to FNOTPRES.

Ffind32() is useful for gaining "read-only" access to a field. The value returned by Ffind32() should not be used to modify the buffer. Field value modification should be done only by the function Fadd32() or Fchg32().

The value returned by Ffind32() is valid only so long as the buffer remains unmodified. The value is guaranteed to be aligned on a short boundary but may not be aligned on a long or double boundary, even if the field is of that type (see the conversion functions described later in this document for aligned values). On processors that require proper alignment of variables, referencing the value when not aligned properly will cause a system error, as in the following example:

long *l1,l2;
FLDLEN32 length;
char *Ffind32;
. . .
if((l1=(long *)Ffind32(fbfr32, ZIP, 0, &length)) == NULL)
F_error32("pgm_name");
else
l2 = *l1;

and should be re-written as:

if((l1==(long *)Ffind32(fbfr32, ZIP, 0, &length)) == NULL)
F_error32("pgm_name");
else
memcpy(&l2,l1,sizeof(long));

Ffindlast32

This function finds the last occurrence of a field in a fielded buffer and returns a pointer to the field, as well as the occurrence number and length of the field occurrence:

char *
Ffindlast32(FBFR32 *fbfr32, FLDID32 fieldid, FLDOCC32 *oc, FLDLEN32 *len)

where

t fbfr32 is a pointer to a fielded buffer

t fieldid is a field identifier

t oc is a pointer to the occurrence number of the last field occurrence found

t len is a pointer to the length of the value found

In the declaration above the return value to Ffindlast is shown as a character pointer data type (char* in C). The actual type of the pointer returned is the same as the type of the value it points to.

Ffindlast32() acts like Ffind32(), except that you do not specify a field occurrence. Instead, both the occurrence number and the value of the last field occurrence are returned. However, if you specify NULL for occurrence on calling the function, the occurrence number will not be returned.

The value returned by Ffindlast32() is valid only as long as the buffer remains unchanged.

Ffindocc32

Ffindocc32() looks at occurrences of the specified field on the buffer and returns the occurrence number of the first field occurrence that matches the user-specified field value:

FLDOCC32
Ffindocc32(FBFR32 *fbfr32, FLDID32 fieldid, char *value, FLDLEN32 len;)

where

t fbfr32 is a pointer to a fielded buffer

t fieldid is a field identifier

t value is a pointer to a new value. Its type is shown as char*, but when it is used, its type must be the same type as the value to be added (see Fadd32())

t len is the length of the value if type carray

For example,

#include "fld.tbl.h"
FBFR32 *fbfr32;
FLDOCC32 oc;
long zipvalue;
. . .
zipvalue = 123456;
if((oc=Ffindocc32(fbfr32,ZIP,&zipvalue, 0)) < 0)
F_error32("pgm_name");

would set oc to the occurrence for the specified zip code.

Regular expressions are supported for string fields. For example,

#include "fld.tbl.h"
FBFR32 *fbfr32;
FLDOCC32 oc;
char *name;
. . .
name = "J.*"
if ((oc = Ffindocc32(fbfr32, NAME, name, 1)) < 0)
F_error("pgm_name");

would set oc to the occurrence of NAME that starts with "J".

Note: To enable pattern matching on strings, the fourth argument to Ffindocc32() must be nonzero. If it is zero, a simple string compare is performed. If the field value is not found, -1 is returned.

For upward compatibility, a circumflex ( ^ ) and dollar sign ($) are assumed to surround the regular expression; thus, the above example is actually interpreted as "^(J.*)$". This means that the regular expression must match the entire string value in the field.

Fget32

Fget32() should be used to retrieve a field from a fielded buffer when the value is to be modified:

int
Fget32(FBFR32 *fbfr32, FLDID32 fieldid, FLDOCC32 oc, char *loc, FLDLEN32 *maxlen)

where

t fbfr32 is a pointer to a fielded buffer

t fieldid is a field identifier

t oc is the occurrence number

t loc is a pointer to a buffer to copy the field value into

t maxlen is a pointer to the length of the source buffer on calling the function, and a pointer to the length of the field on return

The caller provides Fget32 with a pointer to a private buffer, as well as the length of the buffer. If maxlen is specified as NULL, then it is assumed that the destination buffer is large enough to accommodate the field value, and its length is not returned.

Fget32() returns an error if the desired field is not in the buffer (FNOTPRES), or if the destination buffer is too small (FNOSPACE). For example,

FLDLEN32 len;
char value[100];
. . .
len=sizeof(value);
if(Fget32(fbfr32, ZIP, 0, value, &len) < 0)
F_error32("pgm_name");

gets the zip code assuming it is stored as a character array (carray) or string. If it is stored as a long, then it would be retrieved by:

FLDLEN32 len;
long value;
. . .
len = sizeof(value);
if(Fget32(fbfr32, ZIP, 0, value, &len) < 0)
F_error32("pgm_name");

Fgetalloc32

Like Fget32(), Fgetalloc32() finds and makes a copy of a buffer field, but it acquires space for the field via a call to malloc(3):

char *
Fgetalloc32(FBFR32 *fbfr32, FLDID32 fieldid, FLDOCC32 oc, FLDLEN32 *extralen)

where

t fbfr32 is a pointer to a fielded buffer

t fieldid is a field identifier

t oc is the occurrence number

t extralen is a pointer to the additional length to be acquired on calling the function, and a pointer to the actual length acquired on return

In the declaration above the return value to Fgetalloc32() is shown as a character pointer data type (char* in C). The actual type of the pointer returned is the same as the type of the value to which it points.

On success, Fgetalloc32() returns a valid pointer to the copy of the properly aligned buffer field; on error it returns NULL. If malloc(3) fails, Fgetalloc32() returns an error (Ferror32() is set to FMALLOC).

The last parameter to Fgetalloc32() specifies an extra amount of space to be acquired if, for instance, the gotten value is to be expanded before re-insertion into the fielded buffer. On success, the length of the allocated buffer is returned in extralen. For example:

FLDLEN32 extralen;
FBFR32 *fieldbfr
char *Fgetalloc32;
. . .
extralen = 0;
if (fieldbfr = (FBFR32 *)Fgetalloc32(fbfr32, ZIP, 0, &extralen) == NULL)
F_error32("pgm_name");

It is the responsibility of the caller to free space acquired by Fgetalloc32().

Fgetlast32

Fgetlast32() is used to retrieve the last occurrence of a field from a fielded buffer when the value is to be modified:

int
Fgetlast32(FBFR32 *fbfr32, FLDID32 fieldid, FLDOCC32 *oc, char *loc, FLDLEN32 *maxlen)

where

t fbfr32 is a pointer to a fielded buffer

t fieldid is a field identifier

t oc is a pointer to the occurrence number of the last field occurrence

t loc is a pointer to a buffer to copy the field value into

t maxlen is a pointer to the length of the source buffer on calling the function, and a pointer to the length of the field on return

The caller provides Fgetlast32() with a pointer to a private buffer, as well as the length of the buffer. Fgetlast32() acts like Fget32(), except that you do not specify a field occurrence. Instead, both the occurrence number and the value of the last field occurrence are returned. However, if you specify NULL for occ on calling the function, the occurrence number will not be returned.

Fnext32

Fnext32() finds the next field in the buffer after the specified field occurrence:

int
Fnext32(FBFR32 *fbfr32, FLDID32 *fieldid, FLDOCC32 *oc, char *value, FLDLEN32 *len)

where

t fbfr32 is a pointer to a fielded buffer

t fieldid is a pointer to a field identifier

t oc is a pointer to the occurrence number

t value is a pointer of the same type as the value contained in the next field

t len is a pointer to the length of *value

A fieldid of FIRSTFLDID should be specified to get the first field in a buffer; the field identifier and occurrence number of the first field occurrence are returned in the corresponding parameters; if the field is not NULL, its value is copied into the memory location addressed by the value pointer; the len parameter is used to determine if value has enough space allocated to contain the field value (Ferror32() is set to FNOSPACE if it does not); and, the length of the value is returned in the len parameter. Note that if the value of the field is non-null, then the len parameter is also assumed to contain the length of the currently allocated space for value.

If the field value is NULL, then the value and length parameters are not changed.

If no more fields are found, Fnext32() returns 0 (end of buffer) and fieldid, occurrence, and value are left unchanged.

If the value parameter is not NULL, the length parameter is also assumed to be non-NULL.

The following example reads all field occurrences in the buffer:

FLDID32 fieldid;
FLDOCC32 occurrence;
char *value[100];
FLDLEN32 len;
. . .
for(fieldid=FIRSTFLDID,len=sizeof(value);
Fnext32(fbfr32,fieldid,&occurrence,value,&len) > 0;
len=sizeof(value)) {
/* code for each field occurrence */
}

Fnum32

Fnum32() returns the number of fields contained in the specified buffer, or -1 on error:

FLDOCC32
Fnum(FBFR32 *fbfr32)

where

t fbfr32 is a pointer to a fielded buffer

For example:

if((cnt=Fnum32(fbfr32)) < 0)
F_error32("pgm_name");
else
fprintf(stdout,"%d fields in buffer\n",cnt);

would print the number of fields in the specified buffer.

Foccur32

Foccur32() returns the number of occurrences for the specified field in the buffer:

FLDOCC32
Foccur32(FBFR32 *fbfr32, FLDID32 fieldid)

where

t fbfr32 is a pointer to a fielded buffer

t fieldid is a field identifier

Zero is returned if the field does not occur in the buffer and -1 is returned on error. For example:

FLDOCC32 cnt;
. . .
if((cnt=Foccur32(fbfr32,ZIP)) < 0)
F_error32("pgm_name");
else
fprintf(stdout,"Field ZIP occurs %d times in buffer\n",cnt);

would print the number of occurrences of the field ZIP in the specified buffer.

Fpres32

Fpres32() returns true (1) if the specified field occurrence exists and false (0) otherwise:

int
Fpres32(FBFR32 *fbfr32, FLDID32 fieldid, FLDOCC32 oc)

where

t fbfr32 is a pointer to a fielded buffer

t fieldid is a field identifier

t oc is the occurrence number

For example:

Fpres32(fbfr32,ZIP,0)

would return true if the field ZIP exists in the fielded buffer pointed to by fbfr32.

Fvals32 and Fvall32

Fvals32() works like Ffind32() for string values but guarantees that a pointer to a value is returned. Fvall32() works like Ffind32() for long and short values, but returns the actual value of the field as a long, instead of a pointer to the value.

char* 
Fvals32(FBFR32 *fbfr32,FLDID32 fieldid,FLDOCC32 oc)

char*
Fvall32(FBFR32 *fbfr32,FLDID32 fieldid,FLDOCC32 oc)

where in both functions

t fbfr32 is a pointer to a fielded buffer

t fieldid is a field identifier

t oc is the occurrence number

For Fvals32(), if the specified field occurrence is not found, the NULL string, \0, is returned. This function is useful for passing the value of a field to another function without checking the return value. This function is valid only for fields of type string; the NULL string is automatically returned for other field types (i.e., no conversion is done).

For Fvall32(), if the specified field occurrence is not found, then 0 is returned. This function is useful for passing the value of a field to another function without checking the return value. This function is valid only for fields of type long and short; 0 is automatically returned for other field types (that is, no conversion is done).

Buffer Update Functions

The functions listed in this section access and update entire fielded buffers, rather than individual fields in the buffers. These functions use at most three parameters, dest, src, and fieldid, where

t dest is a pointer to a destination fielded buffer

t src is a pointer to a source fielded buffer

t fieldid is a field identifier or an array of field identifiers

Fconcat32

Fconcat32() adds fields from the source buffer to the fields that already exist in the destination buffer.

int
Fconcat32(FBFR32 *dest, FBFR32 *src)

Occurrences in the destination buffer are maintained (i.e., retained and not modified) and new occurrences from the source buffer are added with greater occurrence numbers than any existing occurrences for each field (the fields are maintained in field identifier order).

In the following example:

FBFR32 *src, *dest;
. . .
if(Fconcat32(dest,src) < 0)
F_error32("pgm_name");

if dest has fields A, B, and two occurrences of C, and src has fields A, C, and D, the resultant dest will have two occurrences of field A (destination field A and source field A), field B, three occurrences of field C (two from dest and the third from src), and field D.

This operation will fail if there is not enough space to contain the new fields (FNOSPACE); in this case, the destination buffer remains unchanged.

Fjoin32

Fjoin32() is used to join two fielded buffers based on matching fieldid/occurrence.

int
Fjoin32(FBFR32 *dest, FBFR32 *src)

For fields that match on fieldid/occurrence, the field value is updated in the destination buffer with the value from the source buffer. Fields in the destination buffer that have no corresponding fieldid/occurrence in the source buffer are deleted. Fields in the source buffer that have no corresponding fieldid/occurrence in the destination buffer are not added to the destination buffer. Thus,

if(Fjoin32(dest,src) < 0)
F_error32("pgm_name");

Using the input buffers in the previous example will result in a destination buffer that has source field value A and source field value C. This function may fail due to lack of space if the new values are larger than the old (FNOSPACE); in this case, the destination buffer will have been modified. However, if this happens, the destination buffer may be re-allocated (using Frealloc32()) and the Fjoin32() function may be repeated. (Even if the destination buffer has been partially updated, repeating the function will give the correct results.)

Fojoin32

Fojoin32() is similar to Fjoin32(), but it does not delete fields from the destination buffer that have no corresponding fieldid/occurrence in the source buffer.

int
Fojoin32(FBFR32 *dest, FBFR32 *src)

Note that fields that exist in the source buffer that have no corresponding fieldid/occurrence in the destination buffer are not added to the destination buffer. For example:

if(Fojoin32(dest,src) < 0)
F_error32("pgm_name");

Using the input buffers from the previous example, dest will contain the source field value A, the destination field value B, the source field value C, and the second destination field value C. As with Fjoin32(), this function can fail for lack of space (FNOSPACE) and can be re-issued again after allocating more space to complete the operation.

Fproj32

Fproj32() is used to update a buffer in place so that only the desired fields are kept (in other words, so that the result is a projection on specified fields).

int
Fproj32(FBFR32 *fbfr32, FLDID32 *fieldid)

These fields are specified in an array of field identifiers passed to the function. The update is performed directly in the fielded buffer. For example:

#include "fld.tbl.h"
FBFR32 *fbfr32;
FLDID32 fieldid[20];
. . .
fieldid[0] = A; /* field id for field A */
fieldid[1] = D; /* field id for field D */
fieldid[2] = BADFLDID; /* sentinel value */
if(Fproj32(fbfr32, fieldid) < 0)
F_error32("pgm_name");

If the buffer has fields A, B, C, and D, the example results in a buffer that contains only occurrences of fields A and D. Note that the entries in the array of field identifiers do not need to be in any specific order, but the last value in the array of field identifiers must be field identifier 0 (BADFLDID).

Fprojcpy32

Fprojcpy32() is similar to Fproj32() but the projection is done into a destination buffer.

int
Fprojcpy32(FBFR32 *dest, FBFR32 *src, FLDID32 *fieldid)

Any fields in the destination buffer are first deleted and the results of the projection on the source buffer are copied into the destination buffer. Using the above example,

if(Fprojcpy32(dest, src, fieldid) < 0)
F_error32("pgm_name");

will place the results of the projection in the destination buffer. The entries in the array of field identifiers may be re-arranged; the field identifier array is sorted if they are not in numeric order.

Fupdate32

Fupdate32() updates the destination buffer with the field values in the source buffer.

int
Fupdate32(FBFR32 *dest, FBFR32 *src)

For fields that match on fieldid/occurrence, the field value is updated in the destination buffer with the value in the source buffer (like Fjoin32()). Fields in the destination buffer for which there are no corresponding fields on the source buffer are left untouched (as in Fojoin32()). Fields in the source buffer for which there are no corresponding field on the destination buffer are added to the destination buffer (as in Fconcat32()). For example:

if(Fupdate32(dest,src) < 0)
F_error32("pgm_name");

If the src buffer has fields A, C, and D, and the dest buffer has fields A, B, and two occurrences of C, the updated destination buffer will contain: the source field value A, the destination field value B, the source field value C, the second destination field value C, and the source field value D.

Conversion Functions

FML32 provides a set of routines that perform data conversion upon reading or writing a fielded buffer.

Generally, the functions behave like their non-conversion counterparts, except that they provide conversion from a user type to the native field type when writing to a buffer, and from the native type to a user type when reading from a buffer.

The native type of a field is the type specified for it in its field table entry and encoded in its field identifier. (The only exception to this rule is CFfindocc32(), which, although it is a read operation, converts from the user-specified type to the native type before calling Ffindocc32().) The function names are the same as their non-conversion FML32 counterparts except that they have a "C" prefix.

CFadd32

The CFadd32() function adds a user supplied item to a buffer creating a new field occurrence within the buffer:

int
CFadd32(FBFR32 *fbfr32, FLDID32 fieldid, char *value, FLDLEN32 len, int type)

where

t fbfr32 is a pointer to a fielded buffer

t fieldid is the field identifier of the field to be added

t value is a pointer to the value to be added

t len is the length of the value, if of type carray

t type is the type of the value

Before the field addition, the data item is converted from a user supplied type to the type specified in the field table as the fielded buffer storage type of the field. If the source type is FLD_CARRAY (character array), the length argument should be set to the length of the array. For example,

if(CFadd32(fbfr32,ZIP,"12345",(FLDLEN32)0,FLD_STRING) < 0)
F_error32("pgm_name");

If the ZIP (zip code) field were stored in a fielded buffer as a long integer, the function would convert "12345" to a long integer representation, before adding it to the fielded buffer pointed to by fbfr32. (Note that the field value length is given as 0 since the function can determine it; the length is needed only for type FLD_CARRAY.) The following code fragment:

long zipval;
. . .
zipval = 12345;
if(CFadd32(fbfr32,ZIP,&zipval,(FLDLEN32)0,FLD_LONG) < 0)
F_error32("pgm_name");

puts the same value into the fielded buffer, but does so by presenting it as a long, instead of as a string. Note that the value must first be put into a variable, since C does not permit the construct &12345L. CFadd32() returns 1 on success, and -1 on error, in which case Ferror32() is set appropriately.

CFchg32

The function CFchg32() acts like CFadd32(), except that it changes the value of a field (after conversion of the supplied value):

int
CFchg32(FBFR32 *fbfr32, FLDID32 fieldid, FLDOCC32 oc, char *value, FLDLEN32 len, int type)

where

t fbfr32 is a pointer to a fielded buffer

t fieldid is the field identifier of the field to be changed

t oc is the occurrence number of the field to be changed

t value is a pointer to the value to be added

t len is the length of the value, if of type carray

t type is the type of the value

For example,

FLDOCC32 occurrence;
long zipval;
. . .
zipval = 12345;
occurrence = 0;
if(CFchg32(fbfr32,ZIP,occurrence,&zipval,(FLDLEN32)0,FLD_LONG) < 0)
F_error32("pgm_name");

would change the first occurrence (occurrence 0) of field ZIP to the specified value, doing any needed conversion.

If the specified occurrence is not found, then null occurrences are added to pad the buffer with multiple occurrences until the value can be added as the specified occurrence.

CFget32

CFget32() is the conversion analog of Fget32(). The difference is that it copies a converted value to the user-supplied buffer:

int
CFget32(FBFR32 *fbfr32, FLDID32 fieldid, FLDOCC32 oc, char *buf, FLDLEN32 *len, int type)

where

t fbfr32 is a pointer to a fielded buffer

t fieldid is the field identifier of the field to be retrieved

t oc is the occurrence number of the field

t buf is a pointer to the post-conversion buffer

t len is the length of the value, if of type carray

t type is the type of the value

Using the previous example,

FLDLEN32 len;
. . .
len=sizeof(zipval);
if(CFget32(fbfr32,ZIP,occurrence,&zipval,&len,FLD_LONG) < 0)
F_error32("pgm_name");

would get the value that was just stored in the buffer, no matter what format, and convert it back to a long integer. If the length pointer is NULL, then the length of the value retrieved and converted is not returned.

CFgetalloc32

CFgetalloc32() is like Fgetalloc32(); you are responsible for freeing the malloc'd space for the returned (converted) value with free:

char *
CFgetalloc32(FBFR32 *fbfr32, FLDID32 fieldid, FLDOCC32 oc, int type, FLDLEN32 *extralen)

where

t fbfr32 is a pointer to a fielded buffer

t fieldid is the field identifier of the field to be converted

t oc is the occurrence number of the field

t type is the type to which the value is converted

t extralen on calling the function is a pointer to the extra allocation amount; on return, it is a pointer to the size of the total allocated area

In the declaration above the return value to CFgetalloc32() is shown as a character pointer data type (char* in C). The actual type of the pointer returned is the same as the type of the value to which it points.

The previously stored value could be retrieved into space allocated automatically for you by the following code:

char *value;
FLDLEN32 extra;
. . .
extra = 25;
if((value=CFgetalloc32(fbfr32,ZIP,0,FLD_LONG,&extra)) == NULL)
F_error32("pgm_name");

The value extra in the function call indicates that the function should not only allocate enough space for the retrieved value but an additional 25 bytes and the total amount of space allocated will be returned in this variable.

CFfind32

CFfind32() returns a pointer to a converted value of the desired field:

char *
CFfind32(FBFR32 *fbfr32, FLDID32 fieldid, FLDOCC32 oc, FLDLEN32 len, int type)

where

t fbfr32 is a pointer to a fielded buffer

t fieldid is the field identifier of the field to be retrieved

t oc is the occurrence number of the field

t len is the length of the post-conversion value

t type is the type to which the value is converted

In the declaration above the return value to CFfind32() is shown as a character pointer data type (char* in C). The actual type of the pointer returned is the same as the type of the value to which it points.

Like Ffind32(), this pointer should be considered read only. For example:

char *CFfind32;
FLDLEN32 len;
long *value;
. . .
if((value=(long *)CFfind32(fbfr32,ZIP,occurrence,&len,FLD_LONG))== NULL)
F_error32("pgm_name");

would return a pointer to a long containing the value of the first occurrence of the ZIP field. If the length pointer is NULL, then the length of the value found is not returned. Unlike Ffind32(), the value returned is guaranteed to be properly aligned for the corresponding user-specified type.

Note: The duration of the validity of the pointer returned by CFfind32() is guaranteed only until the next buffer operation, even if it is non-destructive, since the converted value is retained in a single private buffer. This differs from the value returned by Ffind32(), which is guaranteed until the next modification of the buffer.

CFfindocc32

CFfindocc32() looks at occurrences of the specified field in the buffer and returns the occurrence number of the first field occurrence that matches the user-specified field value after it has been converted (it is converted to the type of the field identifier).

FLDOCC32
CFfindocc32(FBFR32 *fbfr32, FLDID32 fieldid, char *value, FLDLEN32 len, int type)

where

t fbfr32 is a pointer to a fielded buffer

t fieldid is the field identifier of the field to be retrieved

t value is a pointer to the unconverted matching value

t len is the length of the unconverted matching value

t type is the type of the unconverted matching value

For example,

#include "fld.tbl.h"
FBFR32 *fbfr32;
FLDOCC32 oc;
char zipvalue[20];
. . .
strcpy(zipvalue,"123456");
if((oc=CFfindocc32(fbfr32,ZIP,zipvalue,0,FLD_STRING)) < 0)
F_error32("pgm_name");

would convert the string to the type of fieldid ZIP (possibly a long) and set oc to the occurrence for the specified zip code. If the field value is not found, -1 is returned.

Note: Since CFfindocc32() converts the user-specified value to the native field type before examining the field values, regular expressions will work only when the user-specified type and the native field type are both FLD_STRING. Thus, CFfindocc32() has no utility with regular expressions.

Converting Strings

A set of functions (Fadds32(), Fchgs32(), Fgets32(), Fgetsa32(), and Ffinds32()) has been provided to handle the case of conversion to/from a user type of FLD_STRING. These functions call their non-string-function counterparts, providing a type of FLD_STRING, and a len of 0. Note that the duration of the validity of the pointer returned by Ffinds32() is the same as that described for CFfind32().

Ftypcvt32

The functions CFadd32(), CFchg32(), CFget32(), CFgetalloc32(), and CFfind32() use the function Ftypcvt32() to perform the appropriate data conversion. The synopsis of Ftypcvt32() usage is as follows (it does not follow the parameter order conventions):

char *
Ftypcvt32(FLDLEN32 *tolen, int totype, char *fromval, int fromtype, FLDLEN32 fromlen)

where

t tolen is a pointer to the length of the converted value

t totype is the type to which to convert

t fromval is a pointer to the value from which to convert

t fromtype is the type from which to convert

t fromlen is the length of the from value if the from type is FLD_CARRAY

Ftypcvt32() converts from the value *fromval, which has type fromtype, and length fromlen if fromtype is type FLD_CARRAY (otherwise fromlen is inferred from fromtype), to a value of type totype. Ftypcvt32() returns a pointer to the converted value, and sets *tolen to the converted length, upon success. Upon failure, Ftypcvt32() returns NULL. As an example of how Ftypcvt is used, the function CFchg32() is presented:


CFchg32(fbfr32,fieldid,oc,value,len,type)
FBFR32 *fbfr32; /* fielded buffer */
FLDID32 fieldid; /* field to be changed */
FLDOCC32 oc; /* occurrence of field to be changed */
char *value; /* location of new value */
FLDLEN32 len; /* length of new value */
int type; /* type of new value */
{
char *convloc; /* location of post-conversion value */
FLDLEN32 convlen; /* length of post-conversion value */
extern char *Ftypcvt32;

/* convert value to fielded buffer type */
if((convloc = Ftypcvt32(&convlen,FLDTYPE(fieldid),value,type,len)) == NULL)
return(-1);

if(Fchg32(fbfr32,fieldid,oc,convloc,convlen) < 0)
return(-1);
return(1);
}

The user may call Ftypcvt32 directly to do field value conversion without adding or modifying a fielded buffer.

Conversion Rules

A description of conversion rules is now presented. In this description, oldval represents a pointer to the data item being converted, and newval a pointer to the post-conversion value:

t When both types are identical, *newval is identical to *oldval.

t When both types are numeric (that is, when the values of both types are long, short, float, or double), the conversion is done by the C assignment operator, with proper type casting. For example, converting a short to a float is done by:

*((float *)newval) = *((short *) oldval)

t When converting from a numeric to a string, an appropriate sprintf is used. For example, converting a short to a string is done by:

sprintf(newval,"%d",*((short *)oldval))

t When converting from a string to a numeric, the appropriate function (for example, atof, atol) is used, with the result assigned to a typecasted receiving location, for example:

*((float *)newval) = atof(oldval)

t When converting from type char to any numeric type, or from a numeric type to a char, the char is considered to be a "shorter short." For example,

*((float *)newval) = *((char *)oldval)

is the method used to convert a char to a float. Similarly,

*((char *)newval) = *((short *)oldval)

is used to convert a short to a char.

t A char is converted to a string by appending a NULL character. In this regard, a char is not a "shorter short." If it were, assignment would be done by converting it to a short, and then converting the short to a string via sprintf. In the same sense, a string is converted to a char by assigning the first character of the string to the character.

t The carray type is used to store an arbitrary sequence of bytes. In this sense, it can encode any user data type. Nevertheless, the following conversions are specified for carray types:

Table 5-2 summarizes the conversion rules presented in this section.

Table 5-2 Summary of Conversion Rules

src typ

dest type

-

char

short

long

float

double

string

carray

dec_t

char

-

cast

cast

cast

cast

st[0]=c

array[0]=c

d

short

cast

-

cast

cast

cast

sprintf

sprintf

d

long

cast

cast

-

cast

cast

sprintf

sprintf

d

float

cast

cast

cast

-

cast

sprintf

sprintf

d

double

cast

cast

cast

cast

-

sprintf

sprintf

d

string

c=st[0]

atoi

atol

atof

atof

-

drop 0

d

carray

c=array[0]

atoi

atol

atof

atof

add 0

-

d

dec_t

d

d

d

d

d

d

d

-

Table 5-3 defiines the entries in Table 5-2.

Table 5-3 Meanings of Entries in the Summary of Conversion Rules

Entry

Meaning

-

no conversion need be done (src and dest are same type)

cast

conversion done using C assignment with type casting

sprintf

conversion done using sprintf function

atoi

conversion done using atoi function

atof

conversion done using atof function

atol

conversion done using atol function

add 0

conversion done by concatenating NULL byte

drop 0

conversion done by dropping terminating NULL byte

c=array[0]

character set to first byte of array

array[0]=c

first byte of array is set to character

c=st[0]

character set to first byte of string

st[0]=c

first byte of string set to c

d

decimal(3c) conversion function

Indexing Functions

When a fielded buffer is initialized by Finit32() or Falloc32(), an index is automatically set up. This index is used to expedite fielded buffer accesses and is transparent to you. As fields are added to or deleted from the fielded buffer, the index is automatically updated.

However, when storing a fielded buffer on a long-term storage device, or when transferring it between cooperating processes, it may be desirable to save space by eliminating its index and regenerating it upon receipt. The functions described in this section may be used to perform such index manipulations.

Fidxused32

This function returns the amount of space used by the index of a buffer:

long
Fidxused32(FBFR32 *fbfr32)

where fbfr32 is a pointer to a fielded buffer

You can use this function to determine the size of the index of a buffer and whether significant time or space would be saved by deleting the index.

Findex32

The function Findex32() may be used at any time to index an unindexed fielded buffer:

int
Findex32(FBFR32 *fbfr32. FLDOCC32 intvl)

where

t fbfr32 is a pointer to a fielded buffer

t intvl is the indexing interval

The second argument to Findex32() specifies the indexing interval for the buffer. If 0 is specified, the value FSTDXINT (defined in fml32.h) is used. The user may ensure that all fields are indexed by specifying an interval of 1.

Note that more space may be made available in an existing buffer for user data by increasing the indexing interval, and re-indexing the buffer. This represents a space/time trade-off, however, since reducing the number of index elements (by increasing the index interval), means, in general, that searches for fields will take longer. Most operations will attempt to drop the entire index if they run out of space before returning a "no space" error.

Frstrindex32

This function can be used instead of Findex32() in cases where the fielded buffer has not been altered since its index was removed:

int
Frstrindex32(FBFR32 *fbfr32, FLDOCC32 numidx)

where

t fbfr32 is a pointer to a fielded buffer.

t numidx is the value returned by the Funindex32 function.

Funindex32

Funindex32() discards the index of a fielded buffer and returns the number of index entries the buffer had before the index was stripped:

FLDOCC32
Funindex32(FBFR32 *fbfr32)

where fbfr32 is a pointer to a fielded buffer

Example

To transmit a fielded buffer without its index, something similar to the following should be done:

  1. Remove the index:

    save = Funindex32(fbfr32);

  2. Get the number of bytes to send (that is, the number of significant bytes from the beginning of the buffer):

    num_to_send = Fused32(fbfr32);

  3. Send the buffer without the index:

    transmit(fbfr32,num_to_send);

  4. Restore the index to the buffer:

    Frstrindex32(fbfr32,save);

On the receiving side, the index could be regenerated with the following statement:

Findex32(fbfr32);

Note that the receiving process cannot call Frstrindex32() because it did not remove the index itself, and the index was not sent with the file.

Note: The space used in memory by the index is not freed by calling Funindex32(); this function either saves space when storing a buffer on a disk or reduces transmission costs when sending a buffer to another process. Of course, you are always free to send a fielded buffer and its index to another process and avoid using these functions.

Input/Output Functions

The functions described in this section provide for input and output of fielded buffers to standard I/O or to file streams.

Fread32 and Fwrite32

The I/O functions Fread32() and Fwrite32() work with the Standard I/O Library:

int Fread32(FBFR32 *fbfr32, FILE *iop)
int Fwrite32(FBFR32 *fbfr32, FILE *iop)

The stream to or from which the I/O is directed is determined by a FILE pointer argument. This argument must be set up using the normal Standard I/O Library functions.

A fielded buffer may be written into a Standard I/O stream with the function Fwrite32(), like this:

if (Fwrite32(fbfr32, iop) < 0)
F_error32("pgm_name");

A buffer written with Fwrite32 may be read with Fread32(), as in:

if(Fread32(fbfr32, iop) < 0)
F_error32("pgm_name");

Although the contents of the fielded buffer pointed to by fbfr32 are replaced by the fielded buffer read in, the capacity of the fielded buffer (size of the buffer) remains unchanged.

Fwrite32() discards the buffer index, writing only as much of the fielded buffer as has been used (as returned by Fused32()).

Fread32() restores the index of a buffer by calling Findex32(). The buffer is indexed with the same indexing interval with which it was written by Fwrite32().

Fchksum32

A checksum may be calculated for verifying I/O:

long chk;
. . .
chk = Fchksum32(fbfr32);

The user is responsible for calling Fchksum32(), writing the checksum value out along with the fielded buffer, and checking it on input. Fwrite32() does not write the checksum automatically.

Fprint32 and Ffprint32

The function Fprint32() prints a fielded buffer on the standard output in ASCII format:

Fprint32(FBFR32 *fbfr32)

where fbfr32 is a pointer to a fielded buffer

Ffprint32() is similar to Fprint32(), except the text is printed to a specified output stream:

Ffprint32(FBFR32 *fbfr32, FILE *iop)

where

t fbfr32 is a pointer to a fielded buffer

t iop is a pointer of type FILE to the output stream

Each of these print functions prints, for each field occurrence, the field name and the field value, separated by a tab and followed by a new-line. Fname32() is used to determine the field name; if the field name cannot be determined, then the field identifier is printed. Non-printable characters in the field values for strings and character arrays are represented by a backslash followed by their two-character hexadecimal value. Backslashes occurring in the text are escaped with an extra backslash. A blank line is printed following the output of the printed buffer.

Fextread32

Fextread32() may be used to construct a fielded buffer from its printed format, that is, from the output of Fprint32() (hexadecimal values output by Fprint32() are interpreted properly).

int
Fextread32(FBFR32 *fbfr32, FILE *iop)

Fextread32() accepts an optional flag preceding the field-name/field-identifier specification in the output of Fprint32(), as shown in Table 5-4.

Table 5-4 Fextread Flags

flag

indicates

+

field should be changed in the buffer

-

field should be deleted from the buffer

=

one field should be assigned to another

#

comment line - ignored

If no flag is given, the default action is to Fadd32() the field to the buffer.

Field values may be extended across lines by having the overflow lines begin with a tab (the tab is discarded). A single blank line signals end of buffer; successive blank lines yield a null buffer.

If an error has occurred, -1 is returned, and Ferror32() is set accordingly. If end of file is reached before a blank line, Ferror32() is set to FSYNTAX.

Boolean Expressions of Fielded Buffers

The functions described in this section evaluate boolean expressions in which the "variables" are the values of fields in a fielded buffer. These functions allow you to:

t compile a boolean expression into a compact form suitable for evaluation

t evaluate a boolean expression against a fielded buffer, returning a true or false answer

t print a compiled boolean expression

A function is provided that compiles the expression into a compact form suitable for efficient evaluation. A second function evaluates the compiled form against a fielded buffer to produce a true or false answer.

Boolean Expressions

This section describes, in detail, the expressions accepted by the boolean compilation function and how each expression is evaluated. Table 5-5 shows the Backus-Naur Form (BNF) definitions of accepted boolean expressions.

Standard C language operators not supported include the shift operators (<< and >>), the bitwise "or" and "and" operators (|| and &&), the conditional operator (?), the prefix and postfix incrementation and decrementation operators (++ and --), the address and indirection operators (& and *), the assignment operator (=), and the comma operator (,). The following sections describe boolean expressions in greater detail.

Table 5-5 BNF Definitions of Boolean Expressions

Expression

Definition

<boolean>

<boolean> || <logical and> | <logical and>

<logical and>

<logical and> & <xor expr> | <xor expr>

<xor expr>

<xor expr> ^ <equality expr> | <equality expr>

<equality expr>

<equality expr> <eq op> <relational expr> | <relational expr>

<eq op>

== | != | %% | !%

<relational expr>

<relational expr> <rel op> <additive expr> | <additive expr>

<rel op>

< | <= | >= | > |

<additive expr>

<additive expr> <add op> <multiplicative expr> | <multiplicative expr>

<add op>

+ | -

<multiplicative expr>

<multiplicative expr> <mult op> <unary expr> | <unary expr>

<mult op>

* | / | %

<unary expr>

<unary op> <primary expr> | <primary expr>

<unary op>

+ | - | ~ | !

<primary expr>

( <boolean> ) | <unsigned constant> | <field ref>

<unsigned constant>

<unsigned number> | <string>

<unsigned number>

<unsigned float> | <unsigned int>

<string>

' <character> {<character>. . .} '

<field ref>

<field name> | <field name>[<field occurrence>]

<field occurrence>

<unsigned int> | <meta>

<meta>

?

Field Names and Types

The only variables allowed in boolean expressions are field references. There are several restrictions on field names. Names are made up of letters and digits; the first character must be a letter. The underscore (_) counts as a letter; it is useful for improving the readability of long variable names. Up to 30 characters are significant. There are no reserved words.

For a fielded buffer evaluation, any field that is referenced in a boolean expression must exist in a field table. This implies that the FLDTBLDIR32 and FIELDTBLS32 environment variables are set, as described in Chapter 3, before using the boolean compilation function. The field types used in booleans are those allowed for FML32 fields; namely, short, long, float, double, char, string, and carray. Along with the field name, the field type is kept in the field table. Thus, the field type can always be determined.

Strings

A string is a group of characters within single quotes. The ASCII code for a character may be substituted for the character via an escape sequence. An escape sequence takes the form of a backslash followed by exactly two hexadecimal digits. NOTE THAT THIS IS NOT AS IT IS IN C where a hexadecimal escape sequence starts with \x.

As an example, consider 'hello' and 'hell\\6f'. They are equivalent strings because the hexadecimal code for an 'o' is 6f.

Octal escape sequences and escape sequences such as "\n" are not supported.

Constants

Numeric integer and floating point constants are accepted, as in C (octal and hexadecimal constants are not recognized). Integer constants are treated as longs and floating point constants are treated as doubles (decimal constants for the dec_t type are not supported).

Conversion

To evaluate a boolean expression, the boolean compiler performs the following conversions:

t short and int values are converted to longs

t float and decimal values are converted to doubles

t characters are converted to strings

t when comparing a non-quoted string within a field with a numeric, the string is converted to a numeric value

t when comparing a constant (that is, quoted) string with a numeric, the numeric is converted to a string, and a lexical comparison is done

t when comparing a long and a double, the long is converted to a double

Primary Expressions

Boolean expressions are built from primary expressions, which can be any of the following:

t field name--a field name

t field name[constant]--a field name and a constant subscript

t field name[?]--a field name and the '?' subscript

t constant--a constant

t (expression)--an expression in parentheses

A field name or a field name followed by a subscript is a primary expression. The subscript indicates which occurrence of the field is being referenced. The subscript may be either an integer constant, or ? indicating any occurrence; the subscript cannot be an expression. If the field name is not subscripted, field occurrence 0 is assumed.

If a field name reference appears without an arithmetic, unary, equality, or relational operator, then its value is the long integer value 1 if the field exists and 0 if the field does not exist. This may be used to test the existence of a field in the fielded buffer regardless of field type (note that there is no * indirection operator).

A constant is a primary expression. Its type may be long, double, or carray, as discussed in the conversion section.

A parenthesized expression is a primary expression whose type and value are identical to those of the unadorned expression. Parentheses may be used to change the precedence of operators, which is discussed in the next section.

Expression Operators

Table 5-6 lists the precedence of expression operators, with the operators having the highest precedence at the top of the list.

Table 5-6 Boolean Expression Operators

Type

Operators

unary

+, -, !, ~

multiplicative

*, /, %

additive

+, -

relational

< , >, <=, >=, ==, !=

equality and matching

==, !=, %%, !%

exclusive OR

^

logical AND

&&

logical OR

||

Within each operator type, the operators have the same precedence. The following sections discuss each operator type in detail. As in C, you can override the precedence of operators by using parentheses.

Unary Operators

The unary operators recognized are the unary plus operator (+), the unary minus operator (-), the one's complement operator (~), and the logical not operator (!). Expressions with unary operators group right-to-left:

+ expression
- expression
~ expression
! expression

The unary plus operator has no effect on the operand (it is recognized and ignored). The result of the unary minus operator is the negative of its operand. The usual arithmetic conversions are performed. Unsigned entities do not exist in FML32 and thus cause no problems with this operator.

The result of the logical negation operator is 1 if the value of its operand is 0, and 0 if the value of its operand is non-zero. The type of the result is long.

The result of the one's complement operator is the one's complement of its operand. The type of the result is long.

Multiplicative Operators

The multiplicative operators *, /, and % group left-to-right. The usual arithmetic conversions are performed.

expression * expression
expression / expression
expression % expression

The binary * operator indicates multiplication. The * operator is associative and expressions with several multiplications at the same level may be rearranged by the compiler.

The binary / operator indicates division. When positive integers are divided truncation is toward 0, but the form of truncation is machine-dependent if either operand is negative.

The binary % operator yields the remainder from the division of the first expression by the second. The usual arithmetic conversions are performed. The operands must not be float or double.

Additive Operators

The additive operators + and - group left-to-right. The usual arithmetic conversions are performed.

expression + expression
expression - expression

The result of the + operator is the sum of the operands. The operator + is associative and expressions with several additions at the same level may be rearranged by the compiler. The operands must not both be strings; if one is a string, it is converted to the arithmetic type of the other.

The result of the - operator is the difference of the operands. The usual arithmetic conversions are performed. The operands must not both be strings; if one is a string, it is converted to the arithmetic type of the other.

Equality and Match Operators

These operators group left-to-right.

expression == expression
expression != expression
expression %% expression
expression !% expression

The == (equal to) and the != (not equal to) operators yield 0 if the specified relation is false and 1 if it is true. The type of the result is long. The usual arithmetic conversions are performed.

The %% operator takes, as its second expression, a regular expression against which it matches its first expression. The second expression (the regular expression) must be a quoted string. The first expression may be an FML32 field name or a quoted string. This operator yields a 1 if the first expression is fully matched by the second expression (the regular expression). The operator yields a 0 in all other cases.

The !% operator is the not regular expression match operator. It takes exactly the same operands as the %% operator, but yields exactly the opposite results. The relationship between %% and !% is analogous to the relationship between == and !=.

Relational Operators

These operators group left-to-right.

expression < expression
expression > expression
expression <= expression
expression >= expression

The operators < (less than), > (greater than), <= (less than or equal to) and >= (greater than or equal to) all yield 0 if the specified relation is false and 1 if it is true. The type of the result is long. The usual arithmetic conversions are performed.

Exclusive OR Operator

The ^ operator groups left-to-right.

expression ^ expression

It returns the bitwise exclusive OR function of the operands. The result is always a long.

Logical AND Operator

expression && expression

The && operator groups left-to-right. It returns 1 if both its operands are non-zero, 0 otherwise. The && operator guarantees left-to-right evaluation. Unlike in C, however, it is not guaranteed that the second operand is not evaluated if the first operand is 0. The operands need not have the same type. The result is always a long.

Logical OR Operator

The || operator groups left-to-right.

expression || expression

It returns 1 if either of its operands is non-zero, and 0 otherwise. The || operator guarantees left-to-right evaluation. However, it is not guaranteed that the second operand is not evaluated if the first operand is non-zero; this is different from the C language. The operands need not have the same type, and the result is always a long.

Sample Boolean Expressions

The following field table defines the fields used for the sample boolean expressions:

EMPID    200    carray
SEX 201 char
AGE 202 short
DEPT 203 long
SALARY 204 float
NAME 205 string

Recall that boolean expressions always evaluate to either true or false. Consider the following example:

"EMPID[2] %% '123.*' && AGE < 32"

The expression is true if field occurrence 2 of EMPID exists and begins with the characters "123" and the age field (occurrence 0) appears and is less than 32. This example uses a constant integer as a subscript to EMPID. The ? subscript is used in the following example:

"PETS[?] == 'dog'"

This expression is if PETS exists and any occurrence of it contains the characters "dog".

Boolean Functions

The following sections describe the various functions that take boolean expressions as arguments.

Fboolco32

Fboolco32() compiles a boolean expression for FML32 and returns a pointer to an evaluation tree:

char *
Fboolco32(char *expression)

where *expression is a pointer to an expression to be compiled.

Space is allocated using malloc(3) to hold the evaluation tree. For example,

#include "<stdio.h>"
#include "fml32.h"
extern char *Fboolco32;
char *tree;
. . .
if((tree=Fboolco32("FIRSTNAME %% 'J.*n' && SEX == 'M'")) == NULL)
F_error32("pgm_name");

would compile a boolean expression that checks whether the FIRSTNAME field is in the buffer, begins with 'J' and ends with 'n' (e.g., John, Joan, etc.), and whether the SEX field is equal to 'M'.

The first and second characters of the tree array form the least significant byte and the most significant byte, respectively, of an unsigned 16 bit quantity that gives the length, in bytes, of the entire array. This value is useful for copying or otherwise manipulating the array.

The evaluation tree produced by Fboolco32() is used by the other boolean functions listed below; thus, the expressiondoes not have to be re-compiled constantly.

free(3) should be used to free the space allocated to an evaluation tree when the boolean expression will no longer be used. Compiling many boolean expressions without freeing the evaluation tree when no longer needed may cause a program to run out of data space.

Fboolpr32

Fboolpr32() prints a compiled expression to the specified file stream. The expression is fully parenthesized, as it was parsed (as indicated by the evaluation tree),

void
Fboolpr32(char *tree, FILE *iop)

where

t *tree is a pointer to a boolean tree previously compiled by Fboolco32

t *iop is a pointer of type FILE to an output file stream

This function is useful for debugging.

Executing Fboolpr32() on the expression compiled above would yield the following:

(((FIRSTNAME[0]) %% ('J.*n')) && ((SEX[0]) == ('M')))

Fboolev32 and Ffloatev32

These functions evaluate a fielded buffer against a boolean expression.

int Fboolev32(FBFR32 *fbfr32,char *tree)

double Ffloatev
32(FBFR32 *fbfr32,char *tree)

where

t fbfr32 is the fielded buffer referenced by an evaluation tree produced by Fboolco32

t tree is a pointer to an evaluation tree that references the fielded buffer pointed to by fbfr32

Fboolev32() returns true (1) if the fielded buffer matches the boolean conditions specified in the evaluation tree. This function does not change either the fielded buffer or the evaluation tree. Using the evaluation tree compiled above, the following code would print "Buffer selected."

#include <stdio.h>
#include "fml32.h"
#include "fld.tbl.h"
FBFR32 *fbfr32;
. . .
Fchg32(fbfr32,FIRSTNAME,0,"John",0);
Fchg32(fbfr32,SEX,0,"M",0);
if(Fboolev32(fbfr32,tree) > 0)
fprintf(stderr,"Buffer selected\n");
else
fprintf(stderr,"Buffer not selected\n");

Ffloatev32() is similar to Fboolev32(), but returns the value of the expression as a double. For example, the following code would print "6.6."

#include <stdio.h>
#include "fml32.h"
FBFR32 *fbfr32;
. . .
main() {
char *Fboolco32;
char *tree;
double Ffloatev32;
if (tree=Fboolco32("3.3+3.3")) {
printf("%lf",Ffloatev32(fbfr32,tree));
}
}

If Fboolev32() were used in place of Ffloatev32() in the above example, a 1 would be printed.