JavaScript is required to for searching.
Skip Navigation Links
Exit Print View
Sun ZFS Storage 7000 System Administration Guide
search filter icon
search icon

Document Information

Preface

1.  Introduction

2.  Status

3.  Configuration

4.  Services

5.  Shares

6.  Analytics

Analytics

Introduction

Concepts

Analytics

Drilldown Analysis

Statistics

Datasets

Actions

Worksheets

Statistics

Introduction

Descriptions

Analytics

Advanced Analytics

Default Statistics

Tasks

Statistics Tasks

CPU Percent utilization

CPU: Percent Utilization

Example

When to check

Breakdowns

Further Analysis

Details

Cache ARC accesses

Cache: ARC accesses

When to check

Breakdowns

Details

Metadata

Prefetch

Further Analysis

Cache L2ARC IO bytes

Cache: L2ARC I/O bytes

When to check

Breakdowns

Further Analysis

Cache L2ARC accesses

Cache: L2ARC accesses

When to check

Breakdowns

Further Analysis

Data Movement NDMP bytes transferred tofrom disk

Data Movement: NDMP bytes transferred to/from disk

When to check

Breakdowns

Further Analysis

Data Movement NDMP bytes transferred tofrom tape

Data Movement: NDMP bytes transferred to/from tape

When to check

Breakdowns

Further Analysis

Data Movement Shadow migration bytes

Data Movement: Shadow migration bytes

When to check

Breakdowns

Further Analysis

Data Movement Shadow migration ops

Data Movement: Shadow migration ops

When to check

Breakdowns

Further Analysis

Data Movement Shadow migration requests

Data Movement: Shadow migration requests

When to check

Breakdowns

Further Analysis

Disk Disks

Disk: Disks

When to check

Breakdowns

Interpretation

Further Analysis

Details

Disk IO bytes

Disk: I/O bytes

When to check

Breakdowns

Further Analysis

Disk IO operations

Disk: I/O operations

When to check

Breakdowns

Further Analysis

Network Device bytes

Network: Device bytes

When to check

Breakdowns

Further Analysis

Network Interface bytes

Network: Interface bytes

Example

When to check

Breakdowns

Further Analysis

Protocol SMB operations

Protocol: SMB operations

Example

When to check

Breakdowns

Further Analysis

Protocol Fibre Channel bytes

Protocol: Fibre Channel bytes

Example

When to check

Breakdowns

Further Analysis

Protocol Fibre Channel operations

Protocol: Fibre Channel operations

Example

When to check

Breakdowns

Further Analysis

Protocol FTP bytes

Protocol: FTP bytes

Example

When to check

Breakdowns

Further Analysis

Protocol HTTPWebDAV requests

Protocol: HTTP/WebDAV requests

When to check

Breakdowns

Further Analysis

Protocol iSCSI bytes

Protocol: iSCSI bytes

When to check

Breakdowns

Further Analysis

Protocol iSCSI operations

Protocol: iSCSI operations

When to check

Breakdowns

Further Analysis

Protocol NFSv2 operations

Protocol: NFSv2 operations

Example

When to check

Breakdowns

Further Analysis

Protocol NFSv3 operations

Protocol: NFSv3 operations

When to check

Breakdowns

Further Analysis

Protocol NFSv4 operations

Protocol: NFSv4 operations

Example

When to check

Breakdowns

Further Analysis

Protocol SFTP bytes

Protocol: SFTP bytes

Example

When to check

Breakdowns

Further Analysis

Protocol SRP bytes

Protocol: SRP bytes

Example

When to check

Breakdowns

Further Analysis

Protocol SRP operations

Protocol: SRP operations

Example

When to check

Breakdowns

Further Analysis

CPU CPUs

CPU: CPUs

When to check

Breakdowns

Details

CPU Kernel spins

CPU: Kernel spins

When to check

Breakdowns

Cache ARC adaptive parameter

Cache: ARC adaptive parameter

When to check

Breakdowns

Cache ARC evicted bytes

Cache: ARC evicted bytes

When to check

Breakdowns

Cache ARC size

Cache: ARC size

When to check

Breakdowns

Cache ARC target size

Cache: ARC target size

When to check

Breakdowns

Cache DNLC accesses

Cache: DNLC accesses

When to check

Breakdowns

Cache DNLC entries

Cache: DNLC entries

When to check

Breakdowns

Cache L2ARC errors

Cache: L2ARC errors

When to check

Breakdowns

Cache L2ARC size

Cache: L2ARC size

When to check

Breakdowns

Data Movement NDMP file system operations

Data Movement: NDMP file system operations

When to check

Breakdowns

Data Movement NDMP jobs

Data Movement: NDMP jobs

When to check

Breakdowns

Disk Percent utilization

Disk: Percent utilization

When to check

Breakdowns

Notes

Disk ZFS DMU operations

Disk: ZFS DMU operations

When to check

Breakdowns

Disk ZFS logical IO bytes

Disk: ZFS logical I/O bytes

When to check

Breakdowns

Disk ZFS logical IO operations

Disk: ZFS logical I/O operations

When to check

Breakdowns

Memory Dynamic memory usage

Memory: Dynamic memory usage

When to check

Breakdowns

Memory Kernel memory

Memory: Kernel memory

When to check

Breakdowns

Memory Kernel memory in use

Memory: Kernel memory in use

When to check

Breakdowns

Memory Kernel memory lost to fragmentation

Memory: Kernel memory lost to fragmentation

When to check

Breakdowns

Network IP bytes

Network: IP bytes

When to check

Breakdowns

Network IP packets

Network: IP packets

When to check

Breakdowns

Network TCP bytes

Network: TCP bytes

When to check

Breakdowns

Network TCP packets

Network: TCP packets

When to check

Breakdowns

System NSCD backend requests

System: NSCD backend requests

When to check

Breakdowns

System NSCD operations

System: NSCD operations

When to check

Breakdowns

Open Worksheets

Worksheets

Graph

Quantize Plot

Show Hierarchy

Common

Background Patterns

Saving a Worksheet

Toolbar Reference

CLI

Tips

Tasks

BUI

Saved Worksheets

Introduction

Properties

BUI

CLI

Datasets

Introduction

BUI

CLI

Viewing available datasets

Reading datasets

Suspending and Resuming all datasets

7.  Application Integration

Glossary

Index

Datasets

Introduction

The term dataset refers to the in memory cached and on disk saved data for a statistic, and is presented as an entity in Analytics with administration controls.

Datasets are automatically created when statistics are viewed in Open Worksheets, but are not saved to disk for future viewing unless they are archived. See the Actions section of Concepts.

BUI

The Analytics->Datasets page in the BUI lists all datasets. These include open statistics that are being viewed in a worksheet (and as such are temporary datasets - they will disappear when the worksheet is closed), and statistics that are being archived to disk.

The following fields are displayed in the Dataset view for all datasets:

Field
Description
Status icon
See below table
Name
Name of the statistic/dataset
Since
First timestamp in dataset. For open statistics, this is the time the statistic was opened - which may be minutes earlier. For archived statistics, this is the first time in the archived dataset which indicates how far back in the past this dataset goes - which may be days, weeks, months. Sorting this column will show the oldest datasets available.
On Disk
Space this dataset consumes on disk
In Core
Space this dataset consumers in main memory

The following icons are visible in the BUI view; some of these will only be visible during mouse over of a dataset entry:

icon
description
Status: On
Dataset is actively collecting data
Status: Disabled
Dataset is currently suspended from collecting data
Power
Suspend/Resume archived datasets
Analytics: Archive dataset
Enable archiving of this dataset to disk
Destroy
Destroy this dataset

See Actions for descriptions for these dataset actions.

CLI

The analytics datasets context allows management of datasets.

Viewing available datasets

Use the show command to list datasets:

caji:analytics datasets> show
Datasets:

DATASET     STATE   INCORE ONDISK NAME
dataset-000 active    674K  35.7K arc.accesses[hit/miss]
dataset-001 active    227K  31.1K arc.l2_accesses[hit/miss]
dataset-002 active    227K  31.1K arc.l2_size
dataset-003 active    227K  31.1K arc.size
dataset-004 active    806K  35.7K arc.size[component]
dataset-005 active    227K  31.1K cpu.utilization
dataset-006 active    451K  35.6K cpu.utilization[mode]
dataset-007 active   57.7K      0 dnlc.accesses
dataset-008 active    490K  35.6K dnlc.accesses[hit/miss]
dataset-009 active    227K  31.1K http.reqs
dataset-010 active    227K  31.1K io.bytes
dataset-011 active    268K  31.1K io.bytes[op]
dataset-012 active    227K  31.1K io.ops
...

Many of the above datasets are archived by default, there is only one that is additional: "dataset-007", which has no ONDISK size, indicating that it is a temporary statistic that isn't archived. The names of the statistics are abbreviated versions of what is visible in the BUI: "dnlc.accesses" is short for "Cache: DNLC accesses per second".

Specific dataset properties can be viewed after selecting it:

caji:analytics datasets> select dataset-007
caji:analytics dataset-007> show
Properties:
                          name = dnlc.accesses
                      grouping = Cache
                   explanation = DNLC accesses per second
                        incore = 65.5K
                          size = 0
                     suspended = false
Reading datasets

Datasets statistics can be read using the read command, followed by the number of previous seconds to display:

caji:analytics datasets> select dataset-007
caji:analytics dataset-007> read 10
DATE/TIME                  /SEC       /SEC BREAKDOWN
2009-10-14 21:25:19         137          - -
2009-10-14 21:25:20         215          - -
2009-10-14 21:25:21         156          - -
2009-10-14 21:25:22         171          - -
2009-10-14 21:25:23        2722          - -
2009-10-14 21:25:24         190          - -
2009-10-14 21:25:25         156          - -
2009-10-14 21:25:26         166          - -
2009-10-14 21:25:27         118          - -
2009-10-14 21:25:28        1354          - -

Breakdowns will also be listed if available. The following shows CPU utilization broken down CPU mode (user/kernel), which was available as dataset-006:

caji:analytics datasets> select dataset-006
caji:analytics dataset-006> read 5
DATE/TIME                 %UTIL      %UTIL BREAKDOWN
2009-10-14 21:30:07           7          6 kernel
                                         0 user
2009-10-14 21:30:08           7          7 kernel
                                         0 user
2009-10-14 21:30:09           0          - -
2009-10-14 21:30:10          15         14 kernel
                                         1 user
2009-10-14 21:30:11          25         24 kernel
                                         1 user

The summary is shown in "%UTIL", and contributing elements in "%UTIL BREAKDOWN". At 21:30:10, there 14% kernel time and 1% user time. The 21:30:09 line shows 0% in the "%UTIL" summary, and so does not list breakdowns ("--").

Suspending and Resuming all datasets

The CLI has a feature that is not yet available in the BUI: the ability to suspend and resume all datasets. This may be useful when benchmarking the appliance to determine its absolute maximum performance. Since some statistics can consume significant CPU and disk resources to archive, benchmarks performed with these statistics enabled are invalid.

To suspend all datasets use suspend:

caji:analytics datasets> suspend
This will suspend all datasets. Are you sure? (Y/N) y 
caji:analytics datasets> show
Datasets:

DATASET     STATE   INCORE ONDISK NAME
dataset-000 suspend   638K   584K arc.accesses[hit/miss]
dataset-001 suspend   211K   172K arc.l2_accesses[hit/miss]
dataset-002 suspend   211K   133K arc.l2_size
dataset-003 suspend   211K   133K arc.size
...

To resume all datasets use resume:

caji:analytics datasets> resume
caji:analytics datasets> show
Datasets:

DATASET     STATE   INCORE ONDISK NAME
dataset-000 active    642K   588K arc.accesses[hit/miss]
dataset-001 active    215K   174K arc.l2_accesses[hit/miss]
dataset-002 active    215K   134K arc.l2_size
dataset-003 active    215K   134K arc.size
...