Job Summary
This position involves the design and development of contemporary data pipelines and essential enterprise data solutions, integrating data from various sources for both routine and on-demand analysis. The role requires effective translation of business and client requirements into structured data designs, implementation of metrics and monitoring strategies, promotion of technical best practices, and support for business stakeholders in making data-driven decisions.
Responsibilities
- Design and implement modern data pipelines for comprehensive data integration.
- Consolidate data from diverse sources to facilitate routine and ad-hoc analytical tasks.
- Translate the needs of the business and clients into efficient data architectures.
- Establish and manage metrics for monitoring data pipelines and performance.
- Promote and adhere to technical best practices in data engineering.
- Assist business partners in data-informed decision-making processes.
Qualifications
- A minimum of 5 years of experience in data engineering.
- At least 4 years of hands-on experience with Azure Databricks.
- Experience in preparing and managing AI-ready data.
- Proficiency with agile methodologies and DevOps practices, along with expertise in Git.
- Strong command of T-SQL and ANSI SQL.
- Solid skills in Python programming.
