Having 10 years of experience in Big Data Development, Data Engineering and Analytical experience in Investment Banking, Credit Risk, AML
Experience of setting up Data Pipelines on multi cloud implementations GCP /AWS / AZURE
Good knowledge in Development tools like Pyspark, Python, Java and Hadoop Ecosystem with experience in working with GCP / AWS /Azure / cloud and Databricks ecosystem.
Good knowledge on Data Governance , Data Lineage and Data Pipelines setup for Batch , Transactional , Streaming Data on Databricks
Good hands on Leveraging Spark Streaming Autoloaders to build Streaming Data Pipelines to consume data from Stream / Transactional sources
Extensive experience in implementing various Data architectures Data Lake, Datawarehouse, lake house, Data vault, dimensional modelling.
Strong Hand-on in leveraging Delta Live Pipelines for Transforming data between Layers
Expertise in setting up ingestion framework for various types of Data (CSV,FIXED, BINARY,JSON , XML) from various sources (Mainframe/ODS/API) into Lakehouse following medallion architecture.
Experience in following leveraging Docker / Kubernetes services for setting up data pipelines for handling complex high volume data, Airflow for orchestrating data pipelines on various cloud technologies by using in-house operators and building custom operators, building end to end data ingestion frameworks for Analytics , ETL and ELT processes
About Virtusa
Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 30,000 people globally that cares about your growth — one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.
Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.
Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.
