Associate Data Engineer Middle Office Technology Job In Dbs In Hyderabad / Secunderabad, Telangana

Associate, Data Engineer, Middle Office TechnologyBusiness FunctionGroup Technology and Operations (T&O) enables and empowers the bank with an efficient, nimble and resilient infrastructure through a strategic focus on productivity, quality & control, technology, people capability and innovation In Group T&O, we manage the majority of the Bank's operational processes and inspire to delight our business partners through our multiple banking delivery channels Roles & Responsibilities

• Create Spark jobs for data transformation and aggregation
• Produce unit tests for Spark transformations and helper methods
• Deep understanding of distributed systems (eg Partitioning, replication, consistency, and consensus)
• Used Spark and Spark-SQL to read the parquet data and create the tables in hive using the Scala API.
  
  
• Work closely with Business Analysts team to review the test results and obtain sign off
• Prepare necessary design/operations documentation for future usage
• Perform peers Code quality review and be gatekeeper for quality checks
• Hands-on coding, usually in a pair programming environment
• Working in highly collaborative teams and building quality code
• The candidate must exhibit a good understanding of data structures, data manipulation, distributed processing, application development, and automation
• Familiar with Oracle, Spark streaming, Kafka, ML
• To develop an application by using Hadoop tech stack and delivered effectively, efficiently, on-time, in-specification and in a cost-effective manner
• Ensure smooth production deployments as per plan and post-production deployment verification
• This Hadoop Developer will play a hands-on role to develop quality applications within the desired timeframes and resolving team queries.
  
  

Requirements

• Hadoop developer with 38 - 65 years of experience and should have strong experience in Hadoop, Apache Spark 2x, Hive, Apache Nifi, Java 8 & 11, Junit, Impala, CICD, Git, Jenkins, Agile Methodologies, DevOps, Cloudera Distribution
• Relevant 3.
  
  5 years of Hadoop & Spark experience is mandatory
• Strong in enterprise data architectures and data models
• Good experience in Core Banking, Finance domain
• Good to have Cloud experience on AWS

India-Telangana-Hyderabad - DAH2 Skyview SEZ

Dbs is looking for .

Dbs is looking for Any Graduate / Post Graduate profile candidates.