The great challenge of Big Data: Continuous integration
Sergio Rodríguez de Guzmán, CTO PUE
The state of maturity of continuous integration is a challenge that organizations often face and that also has an impact on Big Data applications. The aggravating factor in the continuous integration for Big Data platforms is the realization of end-to-end tests and the complexity of the testing infrastructure.
In this practical session, Sergio Rodríguez de Guzmán, CTO at PUE will show us how to reduce the costs and times for start-ups. Both through the use and taking advantage of the flexibility of the Cloud to create infrastructures of test environments as well as through the erection of clusters for temporary end-to-end tests.
During this workshop, scenarios related to the integration and continuous deployment and their associated technologies will be addressed. Examples based on Docker about Kubernetes, Cloudera and Google Cloud Dataproc will be specifically looked at.