Job Details
otal Experience : 3 + years to 7yrsMandatory Skills :Spark Dveloper, Pyspark & AWS Glue, Java , Scala, EmrNotice Period : Immediate Joiners Contract : 6 Months -Extendable Target Date :2nd Jan'2023 Please share profiles on priority Data Engineer: Total Experience 3 + years Job Description: Exceptional programming skills with PySpark Strong knowledge on optimizing workloads developed using Spark SQL/DataFrame Working knowledge of AWS services such as Glue, Lambda, S3, EMR and Cloud Formation etc 2+ years' experience in Advanced SQL knowledge and experience with relational databases 2+ years of hands on experience with data core modernization and data ingestion with structured, semi structured and unstructured datasets Experience building and optimizing 'big data' ETL pipelines, architectures Experience with Cloud using Amazon Web Services (AWS) and/or Microsoft Azure, and/or Google Cloud Platform (GCP) Experience in Databricks and snowflake is a plus.
Experience in developing data cleansing routines utilizing typical data quality functions involving standardization, transformation and rationalization Understanding of integration code artefacts with source code management tools (Git, BitBucket, repo etc) Independent thinker, willing to engage, challenge and learn new technologies