Super ETL’s com as novidades do SSIS 2016 Dennes Torres

Speaker Bio Arquiteto e Software Instrutor Diretor da Búfalo Informática Instrutor MCT, MCSE Data Platform, MCSE BI, MCSD Web Development Líder do devSQL PASS Chapter Rio de Janeiro DevSQL http://facebook.com/devSQL Bufaloinfo http://bufaloinfo.cloudapp.net Dennes.Torres @Dennes https://br.linkedin.com/in/dennestorres dennes@bufaloinfo.com.br http://youtube.com/c/dennestorres

Patrocinadores

Links http://facebook.com/devSQL devsql-subscribe@yahoogrupos.com.br SQL Server Discovery Day http://www.eventbrite.com/e/sql-discovery-day-tickets-25185568714 http://youtube.com/c/dennestorres http://bufaloinfo.cloudapp.net Utilize nossa hashtag no twitter: #SqlSatRJ

Agenda Nova configuração de log Suporte a versões anteriores Recursos para Big Data Criação de Control Parts Deployment Incremental

Niveis de log personalizados In this logging level, only the most important events are selected.

Integração com Big Data

Hadoop Cluster

HDInsight Cluster

Conexão com Big Data control flow data flow Some Hadoop objects have been added in SSIS 2016.

Conexão com Cloud control flow data flow Connection managers: Azure Storage & Azure Subscription Tasks: Azure Blob Upload/Download, Azure HDInsight Hive Task, Azure HDInsight Pig Task, Azure HDInsight Create/Delete Cluster Task Data Flow: Azure Blob Source/Destination Azure Blob Enumerator

Instalação A conexão com cloud é instalada a parte SSIS Azure Feature Pack

Cloud connectivity Connection managers: Azure Storage & Azure Subscription Tasks: Azure Blob Upload/Download, Azure HDInsight Hive Task, Azure HDInsight Pig Task, Azure HDInsight Create/Delete Cluster Task Data Flow: Azure Blob Source/Destination Azure Blob Enumerator

Conexões As conexões devem ser estabelecidas no connection manager A conexão com o azure exige um certificado O certificado é gerado para a máquina local e deve ser subido para o azure A conexão com storage utiliza SAS

SSIS e HDInsight No demo on this because of probably no internet connection.

Demo SSIS e Big data

Control flow parts

Control Flow Parts Flexibility is quite limited.

Incremental Package Deployment Server & Tools Business 6/30/2018 Incremental Package Deployment © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Demo Control flow parts

Outras Novidades SSISDB suporta Always On Suporte para Always Encrypted AutoAdjustBufferSize Balanced Data Distributor

Patrocinadores

Obrigado!

Links http://facebook.com/devSQL devsql-subscribe@yahoogrupos.com.br SQL Server Discovery Day http://www.eventbrite.com/e/sql-discovery-day-tickets-25185568714 http://youtube.com/c/dennestorres http://bufaloinfo.cloudapp.net Utilize nossa hashtag no twitter: #SqlSatRJ