Job Description

Job Title: Data Engineer

Location: Remote

Duration: Long Term

Job Description

Data Engineer with extensive Azure experience

Minimum 10 years of work-related experience in T-SQL, SSRS and ETL.

7 years of experience with development and maintenance of Data Factory data pipelines.

5 years of experience with development and maintenance of data pipelines on the DataBricks platform in Azure.

3 years of experience using DevOps CI/CD in Azure.

Understanding of data lakehouse architecture in Azure.

SUMMARY

The purpose of this position is to perform Data Development functions including design new or enhance existing enterprise database systems, maintain or develop critical databases processes, perform unit and system testing, perform support and help desk tasks. It also requires defining and adopting best practices for each of the data development functions as well as visualization and ETL processes. The position is responsible for architecting report solutions using SSRS reports by collaborating with management team. This position is also responsible for architecting ETL functions between a multitude of relational databases and external data files.

ESSENTIAL DUTIES AND RESPONSIBILITIES

Work with a highly dynamic team focused towards Digital Transformation

Understand the domain and business processes to implement successful data pipelines.

Provide work status, and coordinate with Data Engineers

Manage customer deliverables and regularly report the status via Weekly/Monthly reviews.

Ability to work in a dynamic environment with changing requirements.

Good communication and presentation skills

Working experience with a wide range of data technologies, data modeling, and metadata management.

Working experience with T-SQL and relational databases including currently supported versions of Microsoft SQL Server in Azure.

Design, develop and maintain Stored Procedures, Functions and Views

Working experience with development and maintenance of Data Factory data pipelines.

Working experience with development and maintenance of data pipelines on the Databricks platform in Azure.

Working experience using DevOps CI/CD in Azure.

Program in T-SQL with relational databases including currently supported versions of Microsoft SQL Server

Working experience using SQL and Python.

Write high performance SQL queries using Joins, Cross Apply, Aggregate Queries, Merge, Pivot

Design, develop and maintain Stored Procedures, Functions and Views

Design normalized database tables with proper indexing and constraints

Perform SQL query tuning and performance optimization on complex inefficient queries

Provide guidance in the use of table variable, temporary table, CTE appropriately to deal with large datasets

Collaborate with DBA on database design and performance enhancements

Leading in all phases of the software development life cycle in a team environment

Debug existing code and troubleshoot for issues

Design and provide a framework for maintaining existing data warehouse for reporting and data analytics

Following best practices, design, develop, test and document ETL processes

Develop data cleansing routines utilizing typical data quality functions involving standardization, transformation, rationalization, linking and matching

Keep up-to-date with the latest database features, techniques, and technologies

Support current business applications including the implementation of bug fixes as needed

Able to multi-task and adapt to shifting priorities

Able to meet deadlines set in project planning

Effectively communicate progress through the project execution phase

Follow industry and company standard coding practices

Produce technical and application documentation

Produce quality deliverables upon deployment

Other duties as assigned.

QUALIFICATIONS AND REQUIREMENTS

To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or abilities.

Minimum 10 years of work-related experience in T-SQL, SSRS and ETL. If candidate has relevant education in computer science, computer information systems, or related field, lack of experience can be supplemented by education as follows:

Microsoft Certifications 1 year

Minimum 7 years of experience with development and maintenance of Data Factory data pipelines.

Minimum 5 years of experience with development and maintenance of data pipelines on the DataBricks platform in Azure.

Minimum of 3 years of experience using DevOps CI/CD in Azure.

Understanding of data lakehouse architecture in Azure.

Minimum of 3 years of supervising data infrastructure, and data flows.

Experience in developing, maintaining, and supporting database processes using Microsoft SQL Server with emphasis on .NET technologies.

Proficient at a senior level with the following; T-SQL, SSRS, SSIS, SSAS, Data warehousing, ETL, Python.

Demonstrated ability to perform above listed essential job functions.

Aditya Kumar
Technical Recruiter

Email:

Aditya@stellentit.com

Address:
505 Knolle Court
Saint Augustine, FL 32092

Telephone:
+1 732-795-9133

Job Tags

Temporary work, Work experience placement, Shift work,

Similar Jobs