Hitachi Content Intelligence (HCI) is a search and data processing solution. It allows the extraction, classification, enrichment, and categorization of data, regardless of where the data lives or what format it’s in.
Content Intelligence provides tools at large scale across multiple repositories. These tools are useful for identifying, blending, normalizing, querying, and indexing data for search, discovery, and reporting purposes.
HCI has components called data connections that it uses to access the places where your data is stored (these places are called data sources). A data connection contains all the authentication and access information that HCI needs to read the files in the data source.
HCI is extensible with published application programming interfaces (APIs) that support customized data connections, transformation stages, or building new applications.
HCI is composed of many services running on Docker.
[centos@hci ~]$ sudo docker ps -a [sudo] password for centos: CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 0547ec8761cd com.hds.ensemble:220.127.116.119 "/home/centos/hci/..." 23 minutes ago Up 23 minutes admin-app 1f22db4aec4b com.hds.ensemble:18.104.22.1689 "/home/centos/hci/..." 23 minutes ago Up 23 minutes sentinel-service fa54650ec03a com.hds.ensemble:22.214.171.1249 "/home/centos/hci/..." 23 minutes ago Up 23 minutes haproxy-service 6b82daf15093 com.hds.ensemble:126.96.36.1999 "/home/centos/hci/..." 23 minutes ago Up 23 minutes marathon-service a12431829a56 com.hds.ensemble:188.8.131.529 "/home/centos/hci/..." 23 minutes ago Up 23 minutes mesos_master_service 812eda23e759 com.hds.ensemble:184.108.40.2069 "/home/centos/hci/..." 23 minutes ago Up 23 minutes mesos_agent_service f444ab8e66ee com.hds.ensemble:220.127.116.119 "/home/centos/hci/..." 23 minutes ago Up 23 minutes zookeeper-service c7422cdf3213 com.hds.ensemble:18.104.22.1689 "/home/centos/hci/..." 23 minutes ago Up 23 minutes watchdog-service
Below a representation of all services of HCI platform.
HCI has been qualified using these Linux distributions:
- Fedora 24
- Centos 7.2
- Ubuntu 16.04 LTS
HCI requires Docker software installed in each server running HCI. Docker version > 1.3.0 must be installed on all instances.
Each HCI instance must have a static IP address and the multiple ports must be opened for HCI tools such as Zookeeper, Mesos, Cassandra, Kafka, etc…
To see the list of port, refer to HCI official documentation. For our testing environment, we will stop the firewall service.
System configuration & Installation
HCI can run on physical or virtual servers, or hosted on public or private clouds. It is instantiated as a set of containers and provided to users as a self-service facility with support for detailed queries and ad hoc natural language searches. HCI can run in the single instance or in a cluster mode. For our blog, we will use a single instance.
[centos@hci ~]$ docker --version Docker version 1.13.1, build 87f2fab/1.13.
If Docker is not installed, please follow the installation methods from the Docker official website.
- Backup current SELinux configuration:
[centos@hci ~]$ sudo cp /etc/selinux/config /etc/selinux/config.bak
- Disable SELinux:
[centos@hci ~]$ sudo sed -i s/SELINUX=enforcing/SELINUX=disabled/g /etc/selinux/config
Create user and group:
[centos@hci ~]$ sudo groupadd hci -g 10001 [centos@hci ~]$ sudo useradd hci -u 10001 -g 1000
Disable firewall service:
[centos@hci ~]$ sudo service firewalld stop Redirecting to /bin/systemctl stop firewalld.service
Run Docker service:
[centos@hci ~]$ sudo systemctl status docker * docker.service - Docker Application Container Engine Loaded: loaded (/usr/lib/systemd/system/docker.service; disabled; vendor preset: disabled) Active: active (running) since Thu 2018-08-02 10:08:38 CEST; 1s ago
Configure the Docker service to start automatically at boot:
[centos@hci ~]$ sudo systemctl enable docker Created symlink from /etc/systemd/system/multi-user.target.wants/docker.service to /usr/lib/systemd/system/docker.service
Change the vm.max_map_count value:
Add ‘vm.max_map_count = 262144’ to /etc/sysctl.conf
[centos@hci ~]$ sudo vi /etc/sysctl.conf [centos@hci ~]$ sudo sysctl -w vm.max_map_count=262144
Create first your Hitachi Vantara account, https://sso.hitachivantara.com/en_us/user-registration.html.
Then, from the Hitachi Vantara Community website https://community.hitachivantara.com/hci, clicks “Downloads”. You will have access to a 90-day trial license with the full feature set.
Create a directory called /hci, in the location of your choice. We recommend you to use the largest disk partition:
[centos@hci ~]$ mkdir hci
Move the installation package to your hci directory:
[centos@hci ~]$ mv HCI-22.214.171.124.tgz hci/
Extract the installation package:
[centos@hci hci]$ sudo tar –xzf HCI-126.96.36.199.tgz
Run the installation script in the version-specific directory:
[centos@hci hci]$ sudo 188.8.131.52/bin/install
Run the hci_setup script:
[centos@hci50 bin]$ sudo ./setup -i <ip-address-instance>
Run the hci_run script, and ensure that the method you use can keep the hci_run script running and can automatically restart in case of server reboot:
We recommend running the script as a service using systemd:
In the installation package, a service file is provided and you can edit this file according to your configuration:
- Edit the HCI.service file:
[centos@hci bin]$ vi HCI.service
- Ensure the ExecStart parameter is properly set, with the right path:
If not, change it to your hci installation path.
- Copy the HCI.service file to the appropriate location for your OS:
[centos@hci bin]$ sudo cp /hci/bin/HCI.service /etc/systemd/system
- Enable and start HCI service:
[centos@hci bin]$ sudo systemctl enable HCI.service Created symlink from /etc/systemd/system/multi-user.target.wants/HCI.service to /etc/systemd/system/HCI.service. [centos@hci bin]$ sudo systemctl start HCI.service
Check if the service has properly started:
[centos@dhcp-10-32-0-50 bin]$ sudo systemctl status HCI.service * HCI.service - HCI Loaded: loaded (/etc/systemd/system/HCI.service; enabled; vendor preset: disabled) Active: active (running) since Thu 2018-08-02 11:15:09 CEST; 45s ago Main PID: 5849 (run) Tasks: 6 Memory: 5.3M CGroup: /system.slice/HCI.service |-5849 /bin/bash /home/centos/hci/bin/run |-8578 /bin/bash /home/centos/hci/bin/run `-8580 /usr/bin/docker-current start -a watchdog-service
With your favorite web browser, connect to HCI administrative App:
On the Welcome page, set a password for the admin user:
Choose what you would like to deploy:
Click on Hitachi Content Search button and click on Continue button.
Click on Deploy Single Instance button:
Wait for the HCI deployment until it finishes.