Senior Data Engineer
Job Description
NutaNXT is looking for supporting the planning and implementation of data design services, providing sizing and configuration assistance and performing needs assessments. Delivery of architectures for transformations and modernizations of enterprise data solutions using Azure cloud data technologies. As a Senior Data Engineer, you will collect, aggregate, store, and reconcile data in support of Customer’s business decisions. You will design and build data pipelines, data streams, data service APIs,
data generators and other end-user information portals and insight tools.
Responsibilities
- Plan, build and implement data solutions based on DataBricks or other ETL Tools.
- Design and build Modern Data Pipelines and Data Streams
- Develop and Maintain Data Warehouse
- Design and create ETL processes supplying Data Warehouse
- Implement effective metrics and monitoring process
- Preprocess of structured and unstructured data, create queries in databases
- Ability to conduct data profiling, cataloging, and mapping for technical design and construction of technical data flows
- Experience with any programming language used for data engineering purpose: Python, Scala, R, Java etc.
Qualifications
- Experience working with Azure Databricks
- Familiarity with PySpark
- Very good in communication, both verbal and written
- Mastery of SQL (T-SQL or PL SQL preferred)
- Knowledge of at least one component: Azure Data Factory, Azure Data Lake, Azure SQL DW, Azure SQL
- Minimum experience of 8+ Years in the ETL & Data Engineering space.
- Microsoft Certified: Azure Data Engineer
- Knowledge of the following components of Azure Analytics: Azure HDInsight with Spark, Azure Stream Analytics, Azure IoT Hub, or Azure Event Hub, Azure CosmosDB
- Experience preparing data for Data Science and Machine Learning
- Knowledge of Jupyter Notebooks or Databricks Notebooks for Python development
Europe and APAC regions