Job Description

Contract job Position!

Job Title: Bigdata Azure Consultant  

Work Location: Chicago, IL

Job Description :

10+ Years of Experience.

DataStage

Python, Scala

Awareness of cloud technologies

Big Data Profiles with Azure having more than 6+ years of experience

Participate in developing DataStage tool and having good experience on DataStage and having experience on ETL Architecture.

Participate in design and implementation of the Data Lake, big data migration using Azure cloud as platform

Having Experience on Python & Scala.

Experience in working on Hadoop Distribution, good understanding of core concepts and best practices

Working knowledge of DataStage tool

Understanding of Big data, Data Lake Data Warehousing concepts

Must have experience with Java,Scala,Big data,Hive,Spark, ControlM, Python and Microsoft Azure Synapse Cloud.

Ability to build Azure data solutions and provide a technical perspective on storage, big data platform services Develops and maintains scalable data pipelines and builds out new API integrations to support continuing increases in data volume and complexity.

Create and maintain optimal data pipeline architecture, including optimal extraction, transformation and loading of data, leveraging Databricks notebooks, Apache Spark (SQL, Python, Scala, Java) and other Microsoft Azure or open-source tools as required Strong experience as an Azure Databricks experience would be an preferrable