Databricks Data Engineer Job In Agilisium Consulting In Chennai

Job Title : Databricks Data Engineer Experience: 3-5 yearsWork from Office Location: Chennai Job Description Programming Side: Understanding of Spark architecture Programming experience in Python/Scala Other Responsibilities: Experience working in Azure Cloud Platform Experience working with REST API's and services, messaging and event technologies Experience with ETL or building Data Pipeline tools using Azure Data Factory, Azure Databricks and Azure Data Lake Gen 2 Experience with streaming platforms such as Kafka/Azure Event Hubs Experience with relational databases (such as SQL Server, Postgres) and analytics databases (SSAS, Apache Pinot, Elastic Search).

Experience with business intelligence tools (Power BI) Demonstrated experience working with large and complex data sets Ability to document data pipeline architecture and design Primary Skills: Hadoop Ecosystem(HDP/Cloudera/MapR/EMR etc) Azure data factory/Airflow/control-M/Luig PL/SQL Spark Core, Spark SQL SQL/Hive/Impala Git/SVN/Any other VCS and Data warehousing Exposure to NOSQL(Hbase/Cassandra/GraphDB(Neo4J)/MongoDB) File formats (Parquet/ORC/AVRO/Delta/Hudi etc) Kafka/Kinesis/Eventhub

Experience With Etl Or Building Data Pipeline Tools Using Azure Data Factory, Azure Databricks And Azure Data Lake Gen 2.

Agilisium Consulting is looking for Any Graduate / Post Graduate profile candidates.