Job description

Job Description

    Contract job Position!


    Job Title: Bigdata Azure Consultant  

    Work Location: Chicago, IL


    Job Description :

    10+ Years of Experience.


    Python, Scala

    Awareness of cloud technologies


    Big Data Profiles with Azure having more than 6+ years of experience

    Participate in developing DataStage tool and having good experience on DataStage and having experience on ETL Architecture.

    Participate in design and implementation of the Data Lake, big data migration using Azure cloud as platform

    Having Experience on Python & Scala.

    Experience in working on Hadoop Distribution, good understanding of core concepts and best practices

    Working knowledge of DataStage tool

    Understanding of Big data, Data Lake Data Warehousing concepts

    Must have experience with Java,Scala,Big data,Hive,Spark, ControlM, Python and Microsoft Azure Synapse Cloud.

    Ability to build Azure data solutions and provide a technical perspective on storage, big data platform services Develops and maintains scalable data pipelines and builds out new API integrations to support continuing increases in data volume and complexity.

    Create and maintain optimal data pipeline architecture, including optimal extraction, transformation and loading of data, leveraging Databricks notebooks, Apache Spark (SQL, Python, Scala, Java) and other Microsoft Azure or open-source tools as required Strong experience as an Azure Databricks experience would be an preferrable