[/map {"- map/map "}) [/map/title {"- topic/title "}) Prerequisites (title] [/map/topicref {"- map/topicref "}) [/map/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicmeta/navtitle {"- topic/navtitle "}) Prerequisites (navtitle][/map/topicref/topicmeta/linktext {"- map/linktext "}) Prerequisites (linktext][/map/topicref/topicmeta/shortdesc {"- map/shortdesc "}) The following sections describe the hardware and software requirements your environment must meet before you can install BDD. (shortdesc] (topicmeta][/map/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Supported platforms (navtitle][/map/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Supported platforms (linktext][/map/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) The following tables list the platforms and versions supported in each BDD release. (shortdesc] (topicmeta] (topicref][/map/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Hardware requirements (navtitle][/map/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Hardware requirements (linktext][/map/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) The hardware requirements for your BDD installation depend on the amount of data you will process. Oracle recommends the following minimum requirements: (shortdesc] (topicmeta] (topicref][/map/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Memory requirements (navtitle][/map/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Memory requirements (linktext][/map/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) The amount of RAM your system requires depends on the amount of data you plan on processing. (shortdesc] (topicmeta] (topicref][/map/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Disk space requirements (navtitle][/map/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Disk space requirements (linktext][/map/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) Each type of BDD node has specific disk space requirements. (shortdesc] (topicmeta] (topicref][/map/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Network requirements (navtitle][/map/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Network requirements (linktext][/map/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) The hostname of each BDD machine must be externally-resolvable and accessible using the machine's IP address. Oracle recommends using only Fully Qualified Domain Names (FQDNs). (shortdesc] (topicmeta] (topicref][/map/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Supported operating systems (navtitle][/map/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Supported operating systems (linktext][/map/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) BDD supports the following operating systems: (shortdesc] (topicmeta] (topicref][/map/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Required Linux utilities (navtitle][/map/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Required Linux utilities (linktext][/map/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) The BDD installer requires several Linux utilities. (shortdesc] (topicmeta][/map/topicref/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Installing the required Perl modules (navtitle][/map/topicref/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Installing the required Perl modules (linktext][/map/topicref/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) Three Perl modules are required on the install machine. (shortdesc] (topicmeta] (topicref] (topicref][/map/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) OS user requirements (navtitle][/map/topicref/topicref/topicmeta/linktext {"- map/linktext "}) OS user requirements (linktext][/map/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) The entire installation must be performed by a single OS user, called the bdd user. After installing, this user will run all BDD processes. (shortdesc] (topicmeta][/map/topicref/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Enabling passwordless SSH (navtitle][/map/topicref/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Enabling passwordless SSH (linktext][/map/topicref/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) You must enable passwordless SSH on all nodes in the cluster for the bdd user. (shortdesc] (topicmeta] (topicref] (topicref][/map/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Hadoop requirements (navtitle][/map/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Hadoop requirements (linktext][/map/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) One of the following Hadoop distributions must be running on your cluster before you install BDD: (shortdesc] (topicmeta][/map/topicref/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) YARN setting changes (navtitle][/map/topicref/topicref/topicref/topicmeta/linktext {"- map/linktext "}) YARN setting changes (linktext][/map/topicref/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) To ensure that each YARN worker node has access to sufficient resources during processing, you need to update the following YARN-specific Hadoop properties. (shortdesc] (topicmeta] (topicref][/map/topicref/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Required Hadoop client libraries (navtitle][/map/topicref/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Required Hadoop client libraries (linktext][/map/topicref/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) BDD requires a number of client libraries to interact with Hadoop. When the installer runs, it adds these libraries to a single JAR, called the Hadoop fat JAR, which it then distributes to all BDD nodes. (shortdesc] (topicmeta] (topicref][/map/topicref/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Required HDP JARs (navtitle][/map/topicref/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Required HDP JARs (linktext][/map/topicref/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) If you have HDP, make sure that the following JAR files are present on all of your Hadoop nodes. (shortdesc] (topicmeta] (topicref][/map/topicref/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) MapR-specific requirements (navtitle][/map/topicref/topicref/topicref/topicmeta/linktext {"- map/linktext "}) MapR-specific requirements (linktext][/map/topicref/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) If you have MapR, your system must meet a few additional requirements. (shortdesc] (topicmeta][/map/topicref/topicref/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Updating the YARN ResourceManager configuration (navtitle][/map/topicref/topicref/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Updating the YARN ResourceManager configuration (linktext][/map/topicref/topicref/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) If you have MapR, you must set the yarn.resourcemanager.hostname property in yarn-site.xml to the fully-qualified domain name (FQDN) of your YARN ResourceManager. (shortdesc] (topicmeta] (topicref][/map/topicref/topicref/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Applying the MapR patches (navtitle][/map/topicref/topicref/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Applying the MapR patches (linktext][/map/topicref/topicref/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) If you have MapR, you must apply three sets of patches to your Hadoop cluster before installing BDD. (shortdesc] (topicmeta] (topicref] (topicref] (topicref][/map/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) JDK requirements (navtitle][/map/topicref/topicref/topicmeta/linktext {"- map/linktext "}) JDK requirements (linktext][/map/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) BDD requires one of the following JDK versions: (shortdesc] (topicmeta] (topicref][/map/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Security options (navtitle][/map/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Security options (linktext][/map/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) The following sections describe methods for securing your BDD cluster. (shortdesc] (topicmeta][/map/topicref/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Kerberos (navtitle][/map/topicref/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Kerberos (linktext][/map/topicref/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) The Kerberos network authentication protocol enables client/server applications to identify one another in a secure manner, even when communicating over an unsecured network. (shortdesc] (topicmeta] (topicref][/map/topicref/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Sentry (navtitle][/map/topicref/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Sentry (linktext][/map/topicref/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) Sentry provides role-based authorization in Hadoop clusters. Among other things, it can be used to restrict access to Hive data at a granular level. (shortdesc] (topicmeta] (topicref][/map/topicref/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) TLS/SSL (navtitle][/map/topicref/topicref/topicref/topicmeta/linktext {"- map/linktext "}) TLS/SSL (linktext][/map/topicref/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) BDD can be installed on Hadoop clusters secured with TLS/SSL. (shortdesc] (topicmeta] (topicref][/map/topicref/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) HDFS data at rest encryption (navtitle][/map/topicref/topicref/topicref/topicmeta/linktext {"- map/linktext "}) HDFS data at rest encryption (linktext][/map/topicref/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) HDFS data at rest encryption allows data to be stored in encrypted HDFS directories called encryption zones. All files within an encryption zone are transparently encrypted and decrypted on the client side, meaning decrypted data is never stored in HDFS. (shortdesc] (topicmeta] (topicref][/map/topicref/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Other security options (navtitle][/map/topicref/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Other security options (linktext][/map/topicref/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) You can further protect BDD by installing it behind a firewall and enabling TLS/SSL on Studio's outward-facing ports. (shortdesc] (topicmeta] (topicref] (topicref][/map/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Dgraph database requirements (navtitle][/map/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Dgraph database requirements (linktext][/map/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) The data sets the Dgraph queries are stored in databases. For high availability, these can be stored on HDFS/MapR-FS or a shared NFS. They can also be stored on the local disk for a non-HA option. (shortdesc] (topicmeta][/map/topicref/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) HDFS (navtitle][/map/topicref/topicref/topicref/topicmeta/linktext {"- map/linktext "}) HDFS (linktext][/map/topicref/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) Storing your databases on HDFS provides increased high availability for the Dgraph—the contents of the databases are distributed across multiple nodes, so the Dgraph can continue to process queries if a node goes down. It also increases the amount of data your databases can contain. (shortdesc] (topicmeta][/map/topicref/topicref/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Setting up cgroups (navtitle][/map/topicref/topicref/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Setting up cgroups (linktext][/map/topicref/topicref/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) Control groups, or cgroups, are a Linux kernel feature that enable you to allocate resources like CPU time and system memory to specific processes or groups of processes. If you need to host the Dgraph on nodes running Spark, you should use cgroups to ensure sufficient resources are available to it. (shortdesc] (topicmeta] (topicref][/map/topicref/topicref/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Installing the HDFS NFS Gateway service (navtitle][/map/topicref/topicref/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Installing the HDFS NFS Gateway service (linktext][/map/topicref/topicref/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) If you have MapR, CDH 5.7.1, or HDFS data at rest encryption, and you want to store your Dgraph databases on HDFS, you must install the HDFS NFS Gateway service (called the MapR NFS service in MapR). (shortdesc] (topicmeta] (topicref][/map/topicref/topicref/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Installing FUSE (navtitle][/map/topicref/topicref/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Installing FUSE (linktext][/map/topicref/topicref/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) Filesystem in Userspace (FUSE) enables unprivileged users to access filesystems without having to make changes to the kernel. In the context of BDD, it enables the Dgraph to read and write data to HDFS by making HDFS behave like a mountable local disk. The Dgraph supports FUSE 2.8+. (shortdesc] (topicmeta] (topicref] (topicref][/map/topicref/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) NFS (navtitle][/map/topicref/topicref/topicref/topicmeta/linktext {"- map/linktext "}) NFS (linktext][/map/topicref/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) If you don't want to store your databases on HDFS, you can keep them on a shared NFS. (shortdesc] (topicmeta] (topicref][/map/topicref/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Increasing the number of open file descriptors (navtitle][/map/topicref/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Increasing the number of open file descriptors (linktext][/map/topicref/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) Regardless of where you put your Dgraph databases, you must set the hard and soft limits on the number of open file descriptors to 65536, at a minimum. (shortdesc] (topicmeta] (topicref] (topicref][/map/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Studio database requirements (navtitle][/map/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Studio database requirements (linktext][/map/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) Studio requires a relational database to store configuration and state, including component configuration, user permissions, and system settings. If you install with multiple Studio instances, all of them must be connected to the same database. (shortdesc] (topicmeta][/map/topicref/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Sample commands for production databases (navtitle][/map/topicref/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Sample commands for production databases (linktext][/map/topicref/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) Below are sample commands you can use to create users and schemas for Oracle and MySQL databases. You are not required to use these exact commands when setting up your component databases—these are just examples to help get you started. (shortdesc] (topicmeta] (topicref] (topicref][/map/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Supported Web browsers (navtitle][/map/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Supported Web browsers (linktext][/map/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) Studio supports the following Web browsers: (shortdesc] (topicmeta] (topicref][/map/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Screen resolution requirements (navtitle][/map/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Screen resolution requirements (linktext][/map/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) BDD has the following screen resolution requirements: (shortdesc] (topicmeta] (topicref][/map/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Studio support for iPad (navtitle][/map/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Studio support for iPad (linktext][/map/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) You can use the Safari Web browser on an iPad running iOS 7+ to sign in to Studio and view projects. You cannot use an iPad to create, configure, or export projects. (shortdesc] (topicmeta] (topicref] (topicref] (map]