Big Data Solutions Architect

Big Data Solutions Architect (Professional Services)

As a Big Data Solutions Architect (Resident Solutions Architect) in our Professional Services team, you will work with clients on short to medium-term customer engagements addressing their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology project expertise, including integration with client systems, training, and other technical tasks to help customers maximize value from their data. Resident Solutions Architects are billable, focus on completing projects according to specifications, and deliver excellent customer service. You will report to the regional Manager/Lead.

The Impact You Will Have

• Design and build reference architectures, create how-to guides, and productionalize customer use cases.
• Collaborate with engagement managers to scope professional services work with customer input.
• Guide strategic customers through transformational big data projects and 3rd party migrations.
• Consult on architecture and design, bootstrapping or implementing customer projects to ensure successful adoption of Databricks.
• Provide escalated support for customer operational issues.
• Work with the Databricks technical team, Project Manager, Architect, and Customer team to ensure successful delivery of technical components.
• Provide product and implementation feedback to Engineering and Databricks Customer Support, guiding rapid resolution for engagement-specific issues.

What We Look For

• 6+ years of experience in data engineering, data platforms, and analytics.
• Strong expertise in data warehousing concepts, architecture, and migration strategies.
• Proficiency in writing code in Python, Pyspark, or Scala.
• Working knowledge of two or more common cloud ecosystems (AWS, Azure, GCP), with expertise in at least one.
• Deep experience with distributed computing using Apache Spark™ and understanding of Spark runtime internals.
• Familiarity with CI/CD for production deployments.
• Working knowledge of MLOps.
• Experience in designing and deploying performant end-to-end data architectures.
• Proven experience with technical project delivery, including managing scope and timelines.
• Strong documentation and white-boarding skills.
• Experience working with clients and managing conflicts.
• Ability to build skills in technical areas supporting the deployment and integration of Databricks-based solutions.
• Data Science expertise is a plus.
• Willingness to travel to customers 10-20% of the time.
• Databricks Certification is a plus.

About Databricks

Databricks is the data and AI company. More than 10,000 organizations worldwide, including Comcast, Condé Nast, and Grammarly, and over 50% of the Fortune 500, rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics, and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark™, Delta Lake, and MLflow. To learn more, follow Databricks on Twitter, LinkedIn, and Facebook.

Benefits

At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all our employees. For specific details on the benefits offered in your region, please visit https://www.mybenefitsnow.com/databricks.

Our Commitment to Diversity and Inclusion

At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics.

Compliance

If access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.

Key skills/competency

• Big Data Solutions Architect
• Data Engineering
• Data Science
• Cloud Technology
• Databricks Platform
• Apache Spark
• AWS, Azure, GCP
• Data Warehousing
• CI/CD
• MLOps