Dev Lead/SME to lead a group of developers building data pipelines using big data technologies (Spark, Flink, Databricks) on medium to large scale datasets for batch as well as real time streaming patterns. These pre-trades datasets will serve as an Authoritative Provisioning Point on Databricks Cloud and expedite the demise of on-prem Capital Markets Data Lake.
What is the opportunity?
This is a Senior Technology Lead position responsible for maintaining and advancing the technology implementation that drives the Capital Markets Data Strategy. This is a central platform with capabilities and initiatives delivered in partnership with Central Architecture team and other business and technology partners across QTS. You will be responsible for managing the Data Lake platform and various critical business & regulatory programs that run on this platform.
What will you do?
Lead a group of developers building data pipelines for batch as well as real time streaming patterns for ingesting in the data lake platform
Manage existing ETL processes to support on premise clients and build the next generation ETL processes leveraging Databricks in Cloud
Drive the Data Virtualization initiative and identify new and emerging solutions to build data access layers for Data Lake clients
Execute in a creative & collaborative environment driven by agile methodologies with focus on CI/CD, Application Resiliency Standards
Experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the team
Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in around data ingestion & transformation on-prem and in cloud
Collaborate with product owners, business stakeholders to understand requirements, prioritize tasks and work with the scrum master/development team to meet program timelines
Mentor team on technical aspects, participate in design/code reviews to ensure code is designed well, elegantly coded, and effectively tuned for performance
What do you need to succeed?
Must-have
Bachelor’s degree in computer science or equivalent
Solid experience in Data Architecture, ETL implementation both on-premise and in cloud
Excellent communication skills both written and oral along with good presentation skills
Strong leadership skills managing a team of developers focused on data pipelines, providing oversight on implementation, performing code reviews, and managing Production rollouts
Working experience using big data technologies (Spark, Flink, Databricks) on medium to large scale datasets
Experienced in cloud-based platforms preferably Azure DataLake and Azure Databricks.
Knowledge of best practices, architectural patterns in Big Data ecosystem
Knowledge and experience in non-functional requirements like Security and Performance
Other qualifications include experience
Building and working with rest api’s using Java or python
Working with Agile Engineering practices.
Nice-to-have
Notes:
- Experience in financial industry or Capital Markets
- Azure Certifications in Data Engineering space
What’s in it for you?
We thrive on the challenge to be our best, progressive thinking to keep growing, and working together to deliver trusted advice to help our clients thrive and communities prosper. We care about each other, reaching our potential, making a difference to our communities, and achieving success that is mutual.
A comprehensive Total Rewards Program including bonuses and flexible benefits, competitive compensation, commissions, and stock where applicable
Leaders who support your development through coaching and managing opportunities
Ability to make a difference and lasting impact
Work in a dynamic, collaborative, progressive, and high-performing team
A world-class training program in financial services
Flexible work/life balance options
Opportunities to do challenging work
Opportunities to take on progressively greater accountabilities
Opportunities to building close relationships with clients
Access to a variety of job opportunities across business and geographies
703019113
#LI-POST
#LI-Hybrid
Job Skills
Active Learning, Agile Methodology, Apache Spark, Application Integrations, Big Data, Detail-Oriented, DevOps, Emerging Technologies, Enterprise Application Delivery, Group Problem Solving, Java, Microsoft Azure, Programming Languages, Python (Programming Language), Software Development Life Cycle (SDLC)
Additional Job Details
RBC CENTRE, 155 WELLINGTON ST W:TORONTO
TORONTO
Canada
37.5
Full time
CAPITAL MARKETS
Regular
Salaried
2024-09-13
2024-09-20
Inclusion and Equal Opportunity Employment
At RBC, we embrace diversity and inclusion for innovation and growth. We are committed to building inclusive teams and an equitable workplace for our employees to bring their true selves to work. We are taking actions to tackle issues of inequity and systemic bias to support our diverse talent, clients and communities.
We also strive to provide an accessible candidate experience for our prospective employees with different abilities. Please let us know if you need any accommodations during the recruitment process.
Join our Talent Community
Stay in-the-know about great career opportunities at RBC. Sign up and get customized info on our latest jobs, career tips and Recruitment events that matter to you.
Expand your limits and create a new future together at RBC. Find out how we use our passion and drive to enhance the well-being of our clients and communities at jobs.rbc.com.