Senior Software & Data Engineer Consultant

About the Senior Software & Data Engineer Consultant Role at Virtusa

Virtusa is seeking a highly skilled Senior Software & Data Engineer Consultant with extensive expertise in Python, AWS, Snowflake, and modern data engineering practices. In this role, you will be instrumental in designing, developing, and maintaining robust data pipelines and backend systems. You will operate at the intersection of software development and data engineering, taking full ownership of the entire data workflow—from infrastructure as code (IaC) and pipeline orchestration to comprehensive testing and deployment.

You will join a high-performing, cross-functional Agile/Data Engineering team dedicated to delivering reliable, secure, and scalable data solutions crucial for supporting R&D and business analytics. This position involves close collaboration with data scientists, engineers, and various stakeholders to ensure the delivery of high-quality, production-grade software and data products.

Key Responsibilities

• Design and develop end-to-end data pipelines using Python, DBT, and Snowflake, requiring first-class SQL writing skills.
• Ensure code quality through best practices, including writing clean, efficient, and maintainable code.
• Conduct and actively participate in code reviews to uphold high code standards and provide constructive feedback to peers.
• Utilize Infrastructure as Code tools such as Terraform or CloudFormation to automate infrastructure deployment as needed.
• Integrate data from multiple sources using AWS services like Glue, Lambda, Athena, S3, and Step Functions.
• Ensure robust data quality using unit testing and automated testing frameworks such as DBT Tests, Great Expectations, or Pytest.
• Implement continuous integration/continuous deployment (CI/CD) pipelines using GitHub Actions, Jenkins, or similar tools.
• Optimize pipeline performance and cost, and proactively monitor for issues in production environments.
• Support version-controlled, testable, and maintainable code, adhering to clean coding principles.
• Maintain up-to-date documentation for software designs, processes, and codebases to facilitate knowledge sharing and project continuity.
• Contribute actively to project planning and estimation efforts.
• Stay updated with new technologies, tools, and industry trends to bring innovative solutions to the team.
• Collaborate effectively across teams and mentor junior team members in data and software best practices.

Key skills/competency

• Python
• AWS
• Snowflake
• Data Engineering
• DBT
• SQL
• Infrastructure as Code (IaC)
• Terraform
• CI/CD
• Data Quality