Data Hub Engineer (ETL/BI)Key Responsibilities & Experience Range
- Lead the efforts to build, maintain and extend data warehousing solutions
- Hands-on ETL solutions such as Informatica Intelligent Cloud Services/ Informatica PowerCenter or any other ETL applications and very conversant with ETL realm and technology solution
- Develop, maintain, and support ETL processes for loading data from multiple data sources into a Redshift data warehouse
- Develop and implement solutions pertaining to data load performance, audit/logging, load balancing, control and error handling framework
- Experience in Building task flow and data pipeline using IICS with implementation knowledge of advance complex transformations
- Maintain large, multi-terabyte data warehouse which includes performance tuning and data retention/purge processes
- Research and troubleshoot data quality issues, providing fixes and proposing both short- and long-term solutions
- Represents the team in planning and product meetings, effectively communicating the available platform features and constraints
- Ability to participate in major incident management, production stability, etc as and when required
- Ability to lead a team of 8-10 engineers and act as a guide and mentor in the team
Primary Skills (Must Have)
- 10 + years of overall IT experience with minimum 7+ years of experience as Data Engineering in Data warehousing (AWS preferred) and experience in leading a full life cycle implementation of Data Pipelines using Informatica/ similar ETL tools
- Strong design and development skills of Data Engineering.
Experience on AWS Glue Pipeline is a plus - In-depth knowledge with ETL tool(s) implementation with performance tuning approaches
- Hands-on experience and good knowledge on SQL query/tuning and database concepts
- Strong SQL skills to perform Data analysis exploration and transformation
- Strong hands-on Python skills to support data engineering process
- Strong Analytical skills to understand the business requirements and translate them into Technical specifications
- Should have worked on AWS technologies and migrating apps to AWS Cloud
- Should have experience in AWS technology stack - EC2, AWS Data bases, Identity Access Management, Lambda, Serverless programming, S3 Bucket, API Gateway, Dynamo DB, Auto scaling, Load Balancing, DNS, VPC, HA Architecture etc.
- Prior experience in the leading the Data Engineering team with of 5/10
- Excellent verbal and written communication and should be able to work with all the stakeholders
- Exposure to code versioning tool GIT and project collaboration platform JIRA
- Good experience on Unix, shell scripting
Secondary Skills (Good to Have)
- Good exposure to AWS Data storage products like AWS S3 and AWS Redshift
- Good Understanding of Data Lake systems preferably with DataBricks
- Good to have Business Intelligence/Analytics skills preferably with Tableau
- Experience on working in Agile project management practices is a plus
Qualification & CertificationsBE/BTech degree in Computer Science or related fieldUSP of the RoleThe role would require the person to have a good function knowledge and a strong technical knowledge required to design ,develop and maintain the Data Engineering solution for a modern DatawarehouseAbout State StreetWhat we do.
State Street is one of the largest custodian banks, asset managers and asset intelligence companies in the world From technology to product innovation, we're making our mark on the financial services industry For more than two centuries, we've been helping our clients safeguard and steward the investments of millions of people We provide investment servicing, data & analytics, investment research & trading and investment management to institutional clientsWork, Live and Grow.
We make all efforts to create a great work environment Our benefits packages are competitive and comprehensive Details vary by location, but you may expect generous medical care, insurance and savings plans, among other perks You'll have access to flexible Work Programs to help you match your needs And our wealth of development programs and educational support will help you reach your full potential.
Inclusion, Diversity and Social Responsibility We truly believe our employees' diverse backgrounds, experiences and perspectives are a powerful contributor to creating an inclusive environment where everyone can thrive and reach their maximum potential while adding value to both our organization and our clients We warmly welcome candidates of diverse origin, background, ability, age, sexual orientation, gender identity and personality Another fundamental value at State Street is active engagement with our communities around the world, both as a partner and a leader You will have tools to help balance your professional and personal life, paid volunteer days, matching gift programs and access to employee networks that help you stay connected to what matters to you.
State Street is an equal opportunity and affirmative action employerDiscover more at StateStreetcom/careers