Software Developer ETL 9315-3009
Job Description
Description
Join to apply for the Software Developer ETL role at Foilcon
HM Note: This hybrid contract role requires three (3) days in the office. Candidates’ resumes must include their first and last names.
Description
Responsibilities:
- Design and implement comprehensive test plans for data pipelines and transformations using Microsoft Azure, Databricks, and Power BI.
- Conduct data quality assessments, validation, and profiling with tools like Great Expectations.
- Develop and maintain automated testing frameworks integrated into CI/CD pipelines.
- Collaborate with data engineers to adhere to Medallion Architecture best practices.
- Monitor pipeline performance, scalability, and data integrity.
- Implement DevOps practices with Azure DevOps, Git, and related tools.
- Document test cases, validation rules, and QA processes clearly.
- Perform functional testing on Power BI reports and dashboards.
- Participate in Agile ceremonies and contribute to sprint planning and retrospectives.
Skills
Experience and Skill Set Requirements
Public Sector Experience: 5+ years in federal/provincial/public-sector as a software developer, data specialist, or QA tester.
Core ETL Development Skills: 5+ years in data engineering with expertise in:
- Designing and implementing data pipelines in Azure, Databricks, Power BI.
- Microsoft Azure Data Services (ADF, ADLS Gen 2, Synapse, Azure SQL).
- Azure Databricks, PySpark, SQL.
- Power BI (data prep, modeling, visualization).
- CI/CD and DevOps practices with Azure DevOps, Git, Visual Studio Code.
- Adherence to Medallion Architecture (Staging, Bronze, Silver, Gold).
Certifications (preferred): Microsoft Certified: Azure Data Engineer Associate, Databricks Certified Data Engineer, etc.
Quality Assurance Skills & Experience:
5+ years in QA and automated testing with tools like JIRA, Selenium, JMeter, Great Expectations, and experience in CI/CD pipelines.
Certifications (preferred): CSTE, Test Automation Engineer.
Must Haves:
- 5+ years in data engineering with expertise in Azure, Databricks, Power BI.
- Experience with CI/CD, DevOps, automated testing, and data quality assessments.
Additional Details
- Seniority level: Mid-Senior level
- Employment type: Contract
- Job function: Engineering and IT
- Industries: IT Services and Consulting
#J-18808-Ljbffr
Company
Foilcon
Location
Toronto
Country
Canada
Salary
100.000
URL