Siebel Analytics Server Administration Guide > Administering the Query Environment > Administering Usage Tracking >

Selecting an Output Location


The parameter STORAGE_DIRECTORY in the Usage Tracking section of the NQSConfig.INI file determines the location of usage tracking log files. If usage tracking is enabled, but no storage folder is specified, the files are written in the Log folder in the Siebel Analytics software installation folder.

Current files are periodically written to disk, and new files are created. The parameter CHECKPOINT_INTERVAL_MINUTES controls the frequency with which usage tracking data is flushed to disk, and the parameter FILE_ROLLOVER_INTERVAL_MINUTES controls the frequency with which the current usage tracking log file is closed and a new file created.

When usage tracking is enabled, every query is logged to a usage tracking log file. This may require a large amount of available storage. For example, assume an average of 300 bytes of data output for each query and 10 queries per second over an 8 hour day. This results in approximately 83 MB of usage tracking data written to storage per day. If this example is extended to a 24 x 7 operation, the result is approximately .25 GB of storage per day.

The Siebel Analytics Server has no limit on the size or quantity of usage tracking log files that can exist in the specified location. It is the responsibility of the user to make sure that sufficient space is available, and to remove or archive old usage tracking files.

NOTE:  Insufficient storage space may cause you to lose usage tracking data. If the Siebel Analytics Server encounters an error accessing a usage tracking output file, it immediately discontinues the collection of usage tracking statistics and issues an error message to the Siebel Analytics Server log and, in Windows, to the Windows Event log. Even if additional storage space is made available, the collection of usage tracking statistics will not resume until the server is restarted.

File Naming Conventions

The file naming scheme for the usage tracking log files is NQAcct.yyyymmdd.hhmmss.log, where yyyy is the year, mm is the month, dd is the day, hh is the hour, mm is the minute, and ss is the second of the timestamp when the file was created. For example, if the server creates the usage tracking log file at 07:15:00 AM on February 12, 2003, the filename would be NQAcct.20030212.071500.log. After the specified rollover interval, this file is flushed to disk and closed and a new log file, with the current date and timestamp, is created.

Output File Format

The usage tracking log files are text files, in semicolon-delimited ( ; ) format.
(A semicolon is used as the column delimiter because the logical SQL text contains commas.) A line feed delimits the end of each row of data.

The schema is described in Table 26. For more information about the contents of each column, see Description of the Usage Tracking Data.

Table 26.  Usage Tracking Output File Format
Column Number
Column Name
Data Type
Max Data Size
Nullable

1

User name

Varchar

128

No

2

Repository name

Varchar

128

No

3

Subject area name

Varchar

128

No

4

Node ID

Varchar

15

No

5

Start timestamp

Char (Timestamp)

19

No

6

Start date

Char (yyyy-mm-dd)

10

No

7

Start hourMin

Char (hh:mm)

5

No

8

End timestamp

Char (Timestamp)

19

No

9

End date

Char (yyyy-mm-dd)

10

No

10

End hourMin

Char (hh:mm)

5

No

11

Query Text

Varchar

1024

No

12

Success indicator

Integer (see following Note)

4

No

13

Row count

Integer (see following Note)

4

Yes

14

Total time (secs)

Integer (see following Note)

4

Yes

15

Compilation time (secs)

Integer (see following Note)

4

Yes

16

Number db queries

Integer (see following Note)

4

Yes

17

Cumulative db time (secs)

Integer (see following Note)

4

Yes

18

Cumulative db rows

Integer (see following Note)

4

Yes

NOTE:  All data in the output file is in character format. The data in columns 12 through 18 are output as text representations of integer numbers. In this regard, they behave more like Varchar(10) columns than integers. For example, if the row count is one million rows, then 1000000 appears in the output file in column 13 (Row count). This constitutes seven bytes of data, even though the data represents a 4-byte internal integer value.

  • In column 12, a Success indicator value of 0 signifies a successful query. All nonzero values indicate failure. The following failure indicators are currently defined:
    • 1 indicates timeout
    • 2 indicates row limit violation
    • 3 indicates unknown error

The subsequent columns are valid only if the Success indicator signifies a successful query (value is 0):

  • The Start timestamp and End timestamp columns indicate the wall clock time when the logical query started and finished. Each value is 19 bytes of character data representing a SQL-92 timestamp. The format is yyyy-mm-dd-hh:mm:ss. The related columns, Start date and End date, contain just the date component from the respective timestamps (in the yyyy-mm-dd format). Finally, the related columns, Start hourMin and End hourMin, contain just the hour and minute components from the respective timestamps (in a char hh:mm format).

While there is no guaranteed unique key for the usage tracking data, a combination of User name, Node ID, Start timestamp and Query text will usually be sufficient.

For information about sample scripts to help you extract data from usage tracking log files and load it to appropriately formatted relational database tables, see Usage Tracking Data Descriptions and Using the Log File Method.

Siebel Analytics Server Administration Guide