Senior Data Engineer
Job Summary
Job Description
As a Senior Data Engineer within the QTS TES team, you will take part in the modernization of transactional data reporting. You will build new applications in the Azure cloud using Databricks and migrate legacy applications on various technology stacks to Databricks. Your key stakeholders include Equity Trading Front Office, Compliance, Supervision and Surveillance.
What will you do?
Ingest and transform large-scale datasets to be used for reporting and data visualization
Design and optimize data pipelines for dashboarding and reporting
Work with numerous data sources across QTS to help business stakeholders with their reporting needs
Use GitHub, Airflow, Jenkins, Artifactory, and Spark to develop and deploy ETL's/DAG's
Help improve data management processes towards acquiring, transforming, and storing data
Leverage DevOps practices to streamline and automate software delivery
What do you need to succeed?
Must-have
Bachelors in Computer Science, Software Engineering, or other STEM majors
3+ years of experience working with the Big Data Ecosystem (Hadoop, Spark, Hive)
Professional software development experience with Python, Spark, SQL and Java
Experience integrating codebases with Git, Jenkins, Artifactory, and similar tools
Experience using job scheduling tools to manage ETLs
Nice-to-have
Capital markets experience, knowledge of equity trading preferred
Experience with REST API and microservice frameworks
Experience working with containers (Docker, Kubernetes)
Experience with dashboarding and reporting tools (SSRS/Power BI/Tableau)
What's in it for you?
We thrive on the challenge to be our best, progressive thinking to keep growing, and working together to deliver trusted advice to help our clients thrive and communities prosper. We care about each other, reaching our potential, making a difference to our communities, and achieving success that is mutual.
A comprehensive Total Rewards Program including bonuses and flexible benefits, competitive compensation, commissions, and stock where applicable
Leaders who support your development through coaching and managing opportunities
Flexible work/life balance options
Work in a dynamic, collaborative, progressive, and high-performing team
Ability to make a difference and lasting impact
#TECHPJ
#LI-hybrid
#LI-post
Job Skills
Apache Hadoop, Apache Spark, Application Development, Application Integrations, Application Maintenance, Applications Architecture, Big Data, Data Warehousing (DW), Detail-Oriented, Enterprise Application Delivery, ETL Development, Group Problem Solving, Java, Microsoft SQL Server, Programming Languages, Python (Programming Language), Software Development Life Cycle (SDLC), System ApplicationsAdditional Job Details
Address:
City:
Country:
Work hours/week:
Employment Type:
Platform:
Job Type:
Pay Type:
Posted Date:
Application Deadline:
Note: Applications will be accepted until 11:59 PM on the day prior to the application deadline date above
Inclusion and Equal Opportunity Employment
At RBC, we embrace diversity and inclusion for innovation and growth. We are committed to building inclusive teams and an equitable workplace for our employees to bring their true selves to work. We are taking actions to tackle issues of inequity and systemic bias to support our diverse talent, clients and communities.
We also strive to provide an accessible candidate experience for our prospective employees with different abilities. Please let us know if you need any accommodations during the recruitment process.
Join our Talent Community
Stay in-the-know about great career opportunities at RBC. Sign up and get customized info on our latest jobs, career tips and Recruitment events that matter to you.
Expand your limits and create a new future together at RBC. Find out how we use our passion and drive to enhance the well-being of our clients and communities at jobs.rbc.com.