Data Engineering Specialist

Location(s)

Montreal, QC (Canada)

Job Description

Mandate

The Data Engineering Specialist will be responsible for creating end-to-end data pipelines for machine learning (ML) algorithms and assisting in the development of data warehouses for other analytical and reporting purposes. The incumbent will also assist in creating data visualizations and transformations for reporting, analysis, and predictive modelling and translate ML algorithms into easy-to-use and scalable cloud-based software systems which can easily integrate with other systems in the business.

The ideal candidate has experience in designing, building, and maintaining large data platforms in a cloud-based environment and is passionate about the use of data engineering, data science, and cloud computing to drive business transformations. This person possesses a strong understanding of business concepts to better gather and serve business needs from a data engineering perspective.

Main Responsibilities

Build and maintain complex data workflows/pipelines for data science and other business projects that require integration of several data sources.

Deliver trained ML algorithms and other data science products into easy-to-use cloud-based solutions for business consumers.

Build APIs for ML systems to integrate with other technologies in the company.

Assist with the programming, integration, and task automation of data science projects.

Catalog company data sources and assist in the integration of siloed systems.

Extend and maintain existing cloud-based BI solutions.

Identify opportunities to improve internal processes as well as design and implement improvements.

Design and create feedback loop systems for machine learning algorithms in production for evaluation, reporting and optimization purposes.

Integrate new features and functionalities for existing and new data science products.

Enrich in-house data from external sources using web-scraping tools.

Work closely with IT and DBAs to explore databases to leverage relevant information to optimize processes and existing algorithms.

Maintain existing data science products.

Requirements

Education

Bachelor’s degree in computer science, software engineering or related technical field.
Microsoft Azure certifications in data related services and data engineering.
Coursework in database management systems.

Experience

3 – 5 years experience in a data engineering or data-intensive software development role.
Experience in transforming and manipulating large dimensional data.
Experience in data warehousing and ETL development.
Experience in using visualization technologies such as Power BI/Tableau.
Experience with open-source container platforms.
Experience in communicating technical concepts to business professionals.
Experience in API development and cloud platforms such as Azure.
Programming experience in scripting languages such as Python, Bash, Shell.
Experience or basic knowledge of web development.
Prior work experience in a manufacturing environment.

Knowledge and Competencies

Fully proficient in R, Python and SQL.
Basic familiarity or exposure to machine learning algorithms.
Motivated and able to quickly learn new technologies.
Highly analytical and technically oriented.

Apply now!