5 Data Sets in Big Data Discovery

This section describes what is a data set in BDD, discusses sampled and full data sets, and access to data sets. It also discusses a data set's lifecycle in Studio, and BDD projects and applications.

• About data sets
  Data sets in BDD are called BDD data sets. This helps you to distinguish them from source data sets in Hive tables.
• Data sets in Catalog vs data sets in projects
  It is important to distinguish between data sets in the Catalog, and data sets you add to a project.
• Data Set Manager
  In Studio, the Data Set Manager includes information about all project data sets. You access Data Set Manager once you are in a project, from Project Settings.
• Sampled and full data sets
  Data sets in BDD can be sampled, or they can represent a full data set.
• Data set lifecycle in Studio
  As a data set flows through Big Data Discovery, it is useful to know what happens to it along the way.
• Projects and applications in Big Data Discovery
  When you work with data sets in BDD, you add them in projects in Studio. Some BDD projects can become BDD applications.
• Data set access, access to projects, and user roles
  Studio Administrators and project authors manage access to data sets and projects in Studio.