Job Summary
The position involves designing and maintaining efficient data pipelines, cloud infrastructure, and processing workflows to enable machine learning and artificial intelligence applications. The role is focused on preparing and verifying training data, developing feature engineering pipelines, and optimizing overall data performance. Collaboration with data science and engineering teams is essential to support model workflows.
Responsibilities
- Design and implement scalable data pipelines to support machine learning workflows.
- Maintain and optimize cloud data infrastructure and processing workflows.
- Prepare and validate training datasets for machine learning applications.
- Develop feature engineering pipelines for improved model performance.
- Work alongside data science and engineering teams to enhance model development processes.
Qualifications
- 3 to 8 years of experience in a relevant field.
- Proficient in Python and SQL.
- Hands-on expertise with ETL/ELT processes and distributed data processing.
- Familiarity with cloud platforms, databases, and data warehouse solutions.
- Experience with workflow orchestration tools.
- Understanding of machine learning data preparation techniques and feature engineering.
- Knowledge of version control with Git, CI/CD practices, and automated testing.
- A degree in a related field is preferred, along with experience in MLOps, streaming, or generative AI.
EdgeQ Technologies Private Limited provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.
