Lead Data Engineer

December 19 2024
Industries Bank, Insurance, Financial services
Categories Data analyst, BI, Mining, AI,
Remote
Toronto, ON | Waterloo, ON • Full time

You are as unique as your background, experience and point of view. Here, you'll be encouraged, empowered and challenged to be your best self. You'll work with dynamic colleagues - experts in their fields - who are eager to share their knowledge with you. Your leaders will inspire and help you reach your potential and soar to new heights. Every day, you'll have new and exciting opportunities to make life brighter for our Clients - who are at the heart of everything we do. Discover how you can make a difference in the lives of individuals, families and communities around the world.

Job Description:

We seek an experienced and high-performing individual to join our team as a Lead Data Engineer. This senior technical leadership role is responsible for the design, building, deployment and support of data integration for BI reporting and analytic solutions, and application integration solutions using Python, AWS Glue and supporting tools and services. The Delivery team is involved in exciting projects using leading-edge technologies and leveraging our AWS Cloud based data platform for advanced analytics and data science.

IMPORTANT: As a condition of the role, the successful candidate must be able to obtain a Government of Canada Reliability Status security clearance through Sun Life.

What will you do?

  • Provide coding and design leadership on the construction and maintenance of robust and efficient data applications and reusable frameworks
  • Develop data pipelines in an AWS Cloud environment using Python and AWS Glue (PySpark) technology
  • Responsible for coordinating or participating in all aspects of the development cycle from design and development to release planning and implementation of data systems.
  • Mentor and guide other data developers across various locations to ensure all code follows applicable standards and is efficient and easily maintainable
  • Translate requirements into detailed functional and technical design using architecturally approved technology
  • Provide high level solution options and estimates for project proposals, and detailed work estimates in support of assigned work
  • Deliver solutions according to Systems Development Life Cycle (SDLC) methodology for either waterfall or agile projects
  • Provide consultation for the evaluation of data and software systems.
  • Develop and manage effective working relationships with other departments, groups or personnel with whom work must be coordinated.

What do you need to succeed?

  • 7 to 10 years or more of up-the-ranks experience developing solutions for data warehouse loads and system integrations using ETL tools.
  • 2 or more years developing data pipelines using AWS Glue.
  • Minimum 2 years of experience with Python script development using PySpark, Python libraries, configuration driven and object-oriented ETL.
  • Demonstrated strong core competency in SQL is essential.
  • Minimum 3 years of experience with Big Data including knowledge of Hive
  • Experience with creating complex data frames/structures in Hadoop for data integration and complex calculations
  • Experience with HDFS, Tez, and Spark is an asset.
  • An understanding and/or hands-on experience with Step and Lambda functions will be an asset.
  • Experience with data modeling concepts and data structure design for supporting high performing read SQLs.
  • Advanced level of SQL writing skills for handling large volume of data efficiently
  • Ability to deep dive in existing data integration code to analyze and reverse engineer.
  • Experience with handling complex multi level data transformations to integrate source system data to deliver on business needs.
  • Experience with production implementation change management processes
  • Experience with project management and software development life cycle/SDLC in an Agile environment.
  • Strong analytical skills, including conceptual, requirements interpretation, solution creation and problem-solving abilities
  • Excellent collaboration and leadership skills and proven ability to adapt to challenges, coaching and mentoring
  • Ability to work in a global multi-site environment and working in a matrix environment, onshore/offshore IT mode
  • Ability to lead a team of diverse skill sets and interface with peripheral technical teams

While we strongly prefer experience with AWS (AWS Glue). In the absence of a strong candidate with this skill, we may also consider candidates from GCP (Data Fusion) or Azure (Data Factory) cloud environments.

What's in it for you?

  • Canada Order of Excellence for Mental Health at Work® certification from Excellence Canada. Sun Life is one of only four companies in Canada to ever receive this certification - 2024
  • Top Work Places® for Remote Work - Monster Canada - 2024
  • Great Place to Work® Certified for Most Trusted Executive Team in Canada - 2024 and 2023
  • Great Place to Work® Certified for Best Workplaces in Canada - 2024 and 2022
  • Great Place to Work® Certified for Best Workplaces for Women in Canada - 2024
  • Great Place to Work® Certified for Best Workplaces in Ontario - 2023
  • Great Place to Work® Certified in Canada in Financial Services and Insurance - 2023
  • Flexible hybrid work model. #LI-Hybrid
  • Pension, stock and savings programs to help build and enhance your future financial security
  • Work and professional development that is united by our Purpose: to help Clients and Employees achieve lifetime financial security and live healthier lives
  • A friendly, collaborative and inclusive culture
  • Be part of our continuous improvement journey in developing the next greatest digital enterprise experience.
  • Competitive salary and bonus structure influenced by market range data
  • The opportunity to move along a variety of career paths with amazing networking potential

The Base Pay range is for the primary location for which the job is posted. It may vary depending on the work location of the successful candidate or other factors. In addition to Base Pay, eligible Sun Life employees participate in various incentive plans, payment under which is discretionary and subject to individual and company performance. Certain sales focused roles have sales incentive plans based on individual or group sales results.

Diversity and inclusion have always been at the core of our values at Sun Life. A diverse workforce with wide perspectives and creative ideas benefits our clients, the communities where we operate and all of us as colleagues. We welcome applications from qualified individuals from all backgrounds.

Persons with disabilities who need accommodation in the application process or those needing job postings in an alternative format may e-mail a request to thebrightside@sunlife.com.

At Sun Life we strive to create a flexible work environment where our employees are empowered to do their best work. Several flexible work options are available and can be discussed throughout the selection process depending on the role requirements and individual needs.

We thank all applicants for showing an interest in this position. Only those selected for an interview will be contacted.

Salary Range:

84,000/84 000 - 138,000/138 000

Job Category:

IT - Technology Services

Posting End Date:

05/01/2025
Apply now!

Similar offers

Searching...
No similar offer found.
An error has occured, try again later.

Jobs.ca network