Data Engineering Consultant
Job Description
NutaNXT is looking for supporting the planning and implementation of data design services, providing sizing and configuration assistance and performing needs assessments. Delivery of architectures for transformations and modernizations of enterprise data solutions using Azure cloud data technologies. As a Data Engineering Consultant, you will collect, aggregate, store, and reconcile data in support of Customer’s business decisions. You will design and build data pipelines, data streams, data service APIs, data generators and other end-user information portals and insight tools.
Responsibilities
- Demonstrable experience in enterprise level data platforms involving implementation of end-to-end data pipelines with Python or Scala
- Hands-on experience with at least one of the leading public cloud data platforms (Ideally Azure)
- Experience with different Databases (like column-oriented database, NoSQL database, RDBMS)
- Experience in architecting data pipelines and solutions for both streaming and batch integrations using tools/frameworks like Azure Databricks, Azure Data Factory, Spark, Spark Streaming, etc.
- Understanding of data modeling, warehouse design and fact/dimension concepts
- Good Communication
Qualifications
- Experience working with Azure Databricks.
- Familiarity with PySpark
- Very good in communication, both verbal and written
- Mastery of SQL (T-SQL or PL SQL preferred)
- Knowledge of at least one component: Azure Data Factory, Azure Data Lake, Azure SQL DW, Azure SQL
- Minimum experience of 8+ Years in the ETL & Data Engineering space.
- Microsoft Certified: Azure Data Engineer
- Knowledge of the following components of Azure Analytics: Azure HDInsight with Spark, Azure
- Stream Analytics, Azure IoT Hub, or Azure Event Hub, Azure CosmosDB
- Experience preparing data for Data Science and Machine Learning
- Knowledge of Jupyter Notebooks or Databricks Notebooks for Python development
Europe and APAC regions