Turning operational data into something people can decide on: business intelligence platforms, reporting, data warehousing, big data and the data engineering behind them. Our consultants share what they learned on analytics projects.
After the deployment step with Terraform and the configuration/installation with Ansible, we will continue the installation of our Cloudera cluster with Cloudera Manager. By following the below steps you will see how to install CDH on our hosts using Cloudera Manager. Connection First, Login to Cloudera manager URL. When you connect to C.M for the first time, you need to…
By Franck Pachot . With this trend of CQRS architectures where the transactions are streamed to a bunch of heterogenous eventually consistent polyglot-persistence microservices, logical replication and Change Data Capture becomes an important component, already at the architecture design phase. This is good for existing products vendors such as Oracle GoldenGate (which must be licensed even to use only the…
In this part of the blog posts series, we will show how ansible helps us to configure our cluster and install all pre-requisite needed for Cloudera Manager. Ansible is one of the most important automation tools currently. Ansible will help us to configure all nodes for a manual installation using Cloudera Manager. Our playbook will contain the following roles: cm_repo:…
Deploying a Cloudera distribution of Hadoop automatically is very interesting in terms of time-saving. Infrastructure as Code tools such as Ansible, Puppet, Chef, Terraform, allow now to provision, manage and deploy configuration for large clusters. In this blog posts series, we will see how to deploy and install a CDH cluster with Terraform and Ansible in the Azure cloud. The…
In this blog post, we will see how to manage Oracle Public Cloud Big Data service Compute Edition with REST API. Scheduling the start/stop/restart of a metered PaaS in the Oracle Cloud can be interesting for managing efficiently the consumption of your cloud credits. We should first have a look at the official documentation so as to understand what the API is composed…
Since few years, Oracle decided to move forward in the Big Data area, as their main competitor. The goal of this blog post is to explain you, how the Oracle Big Data offering is composed. As the Oracle Big Data offering is continuously improving, I’m always open to your feedback 🙂 Oracle Big Data offering is split in 2 parts:…
By Franck Pachot . We still see some developers not declaring referential integrity constraints in datawarehouse databases because they think they don’t need it (integrity of data has been validated by the ETL). Here is a small demo I did to show why you need to declare them, and how to do it to avoid any overhead on the ETL.…
By Franck Pachot . Going to multitenant architecture is not a big change. The administration things (DBA, monitoring, backups) connect to the CDB and the application things connect to the PDB. Without the multitenant option, it is still recommended to go to the CDB architecture. The non-CDB is deprecated and the multitenant architecture brings interesting features. People often ask how…
Je n’ai pas encore blogué sur le sujet mais il est temps de le faire. Cette année, aura lieu la première édition francophone des 24h du PASS les 20 et 21 septembre 2016. L’idée est plutôt simple: proposer une série de 24 webinaires gratuits de 10h jusqu’à 22h (heure française) pendant 2 jours. C’est l’occasion de recevoir et d’échanger les dernières informations autour…
A lot of customer’s feedbacks are about difficulties to find easily SQL Server tools. Now, it is easier… 😉 A unified web page for SQL Server Tools The first good news is that Microsoft unified and gathered these tools for SQL Server on a single web page: https://msdn.microsoft.com/en-us/library/mt238365.aspx As DBA, this page is absolutely to be marked in your browser.…
In my last article, I wrote about the R Services into SQL Server. Now, Microsoft provides an open source R platform to complete this new SQL Server integrated feature in 2016. On the Microsoft Website, you can download directly R Server 2016 for different operating systems: Windows of course SUSE Linux Red Hat Linux Version for Hadoop on Red Hat…
I was during a long time captivated by the R programming language. I’m happy to see that SQL Server 2016 provides now a SQL Server R Services. This service enables SQL Server to execute R scripts. The first step is to install the R Services during the installation of SQL Server. As you can see on the picture, you have…
