
Databricks Senior Data & AI Engineer
V2 Strategic Advisors · United States
- Hybrid
- Full-time
- $150,000 / year
- United States
Job highlights
- Design and implement Databricks Lakehouse solutions.
- Build scalable data pipelines and AI integrations.
- Optimize Databricks SQL for enterprise analytics.
- Collaborate on practice building and client delivery.
- Requires strong Databricks and consulting experience.
About the role
About V2 Strategic Advisors
V2 Strategic Advisors is where velocity meets voltage - a boutique management and technology consulting firm that has spent 20+ years transforming media and advertising sales organizations. We're the firm that global and high-growth organizations call when they need more than a strategy deck - they need results.Our edge? We offer a rare blend of management consulting, data, analytics, AI, and systems integration - all under one roof, powered by best-in-class platforms including Salesforce, Databricks, Snowflake, HubSpot, and leading AI platforms like Claude and Gemini. We understand the nuances of our clients' most complex challenges and deliver solutions that move the needle.
We're a lean, elite team of consultants, technical architects, and data experts who operate with the rigor of global management consulting and systems integration consultancies and the energy and agility of a startup. We approach every day with a sense of purpose to deliver with excellence, grow our capabilities, and find fulfillment in what we do. If that sounds like your kind of environment, keep reading.
The Opportunity
V2’s Databricks practice is growing rapidly, and we’re looking for a senior practitioner to accelerate that growth. You’ll work directly with our SVP of Architecture, Data & Analytics and a sharp group of technical professionals to execute with precision and raise the bar across every engagement.You bring the hands-on depth to design and implement production-grade Lakehouse solutions, and build pipelines, models, and intelligent applications that deliver exceptional results for our clients. You'll be a force multiplier for the team: elevating the work, setting the standard, and helping us win in a market where the Databricks platform is increasingly powerful and relevant for the future of business systems.
If you want to build something that matters with people who operate at a high standard, keep reading.
What You'll Focus On
Lakehouse Architecture & Data Engineering
- Design and implement medallion architecture (bronze/silver/gold) using Delta Lake as the foundational layer across client environments.
- Build and optimize scalable data pipelines using Apache Spark and Lakeflow (Declarative Pipelines, Jobs, and Connect for ingestion).
- Architect and implement Unity Catalog as the backbone that governs data lineage, fine-grained access control (including row/column-level security), Lakehouse Federation, and Delta Sharing.
- Drive best practices for performance tuning, cost governance, and compute optimization on Databricks.
Data Warehousing & SQL Analytics
- Implement and optimize Databricks SQL for enterprise analytics, including AI/BI Dashboards and BI tool integration (Tableau, Power BI, Looker).
- Design data models that serve both operational reporting and strategic analytics use cases.
- Partner with business stakeholders to translate complex data requirements into reliable, performant solutions.
AI Integration
- Build production AI solutions on the Databricks platform with tools including RAG pipelines using Mosaic Vector Search, agent development with the Mosaic AI Agent Framework, Model Serving endpoints, and external model APIs (OpenAI, Anthropic, Gemini, and others).
- Leverage Mosaic AI, AI/BI Genie, and Databricks Apps to develop intelligent, data-driven applications that deliver real client value.
- Stay current on Databricks AI capabilities and bring emerging patterns to the practice proactively.
ML Engineering (Not Required But Preferred)
- Apply MLflow for experiment tracking, model registry, and deployment lifecycle management where engagements call for it.
- Utilize Feature Engineering in Unity Catalog and production model serving to operationalize machine learning at scale.
- Collaborate with data science experts on model development when needed - you don't need to be a data scientist, but you need to speak the language fluently.
Practice Building & Client Delivery
- Serve as a foundational technical resource for V2's Databricks practice, helping shape standards, methodologies, and delivery frameworks.
- Operate across client engagements as a hands-on practitioner and technical advisor, translating business problems into platform solutions.
- Support pre-sales and solutioning efforts: scoping engagements, contributing to proposals, and demonstrating credibility in client conversations.
- Supercharge the broader technical team by leading code reviews, conducting formal and informal knowledge transfer, and elevating the people around you.
What You Bring
- Platform mastery: Databricks depth that is real and demonstrable. Proficiency across Delta Lake, Unity Catalog, DLT, Databricks SQL, and Spark. Databricks Certifications (especially Data Engineer Professional and ML Engineer Professional) are strongly preferred.
- End-to-end engineering: You've built pipelines, governed data platforms, and designed Lakehouse architectures in production environments.
- AI integration experience: Hands-on experience integrating LLMs, building RAG pipelines, and deploying AI-powered solutions using Databricks.
- Consulting or professional services instincts: You understand how consulting engagements work and have experience with scoping, client communication, delivery under pressure, and building trust with senior stakeholders.
- Broad data platform fluency: Experience with cloud platforms (Azure, AWS, or GCP) and familiarity with adjacent data technologies, including Snowflake, Salesforce Data Cloud, or dbt, is a differentiator.
- Cultural alignment: You operate with speed and agility and enjoy fast-paced, entrepreneurial environments.
Why V2?
Because you won't find another firm doing exactly what we do, and you won't find another role like this one. You'll be close to the action, building something real, with people who care deeply about doing exceptional work. V2 was built on the idea that consulting could be done better. We're still proving it every day.If you're ready to bring the voltage, we want to hear from you.
Apply at: v2sa.com/careers | or reach out directly on LinkedIn.
We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.
Key skills/competency
- Databricks
- Data Engineering
- AI Integration
- Lakehouse Architecture
- Apache Spark
- Delta Lake
- Unity Catalog
- Consulting
- ML Engineering
- Data Warehousing
Skills & topics
- Databricks
- Data Engineering
- AI Engineer
- Senior Data Engineer
- Lakehouse
- Delta Lake
- Unity Catalog
- Spark
- Apache Spark
- Consulting
How to get hired
- Tailor your resume: Highlight Databricks expertise, Delta Lake, Unity Catalog, and AI integration experience. Quantify achievements in production environments.
- Showcase consulting skills: Emphasize client communication, project scoping, and delivery under pressure.
- Prepare for technical interviews: Be ready to discuss Lakehouse architecture, data pipeline design, and AI solutions on Databricks.
- Demonstrate cultural fit: Articulate your experience in fast-paced, entrepreneurial environments and your drive for excellence.
Technical preparation
Master Databricks Delta Lake and Unity Catalog.,Build production-grade data pipelines with Spark.,Develop AI solutions using RAG and agents.,Practice Databricks SQL for analytics and BI.
Behavioral questions
Describe a complex client problem solved.,How do you handle delivery under pressure?,Explain your consulting engagement experience.,How do you contribute to team growth?
Frequently asked questions
- What specific Databricks certifications does V2 Strategic Advisors prefer for the Senior Data & AI Engineer role?
- V2 Strategic Advisors strongly prefers Databricks certifications, particularly the Data Engineer Professional and ML Engineer Professional certifications, for the Senior Data & AI Engineer position. Demonstrating proficiency through these certifications will significantly enhance your application.
- How does V2 Strategic Advisors utilize AI in its hiring process for the Senior Data & AI Engineer role?
- V2 Strategic Advisors may use AI tools to assist in reviewing applications, analyzing resumes, and assessing candidate responses for the Senior Data & AI Engineer role. These tools support the recruitment team but do not replace human judgment in the final hiring decisions.
- What is the typical client profile that V2 Strategic Advisors serves for Databricks projects?
- V2 Strategic Advisors typically works with global and high-growth organizations, particularly in the media and advertising sales sectors, that require transformative solutions beyond strategy. They focus on clients needing results through management consulting, data, analytics, and AI integration.
- What are the key responsibilities for a Senior Data & AI Engineer at V2 Strategic Advisors?
- Key responsibilities include designing and implementing Databricks Lakehouse architecture (medallion, Delta Lake, Unity Catalog), building scalable data pipelines with Spark, integrating AI solutions (RAG, agents), optimizing Databricks SQL, and supporting practice building and client delivery through technical advisory and pre-sales efforts.
- Is prior experience in ML Engineering required for the Senior Data & AI Engineer position?
- While not strictly required, prior experience in ML Engineering is preferred for the Senior Data & AI Engineer role. This includes applying MLflow for experiment tracking and model deployment, and utilizing Feature Engineering in Unity Catalog.
- What differentiates V2 Strategic Advisors from other consulting firms in the data and AI space?
- V2 Strategic Advisors differentiates itself by offering a unique blend of management consulting, data, analytics, AI, and systems integration under one roof. They focus on delivering tangible results for media and advertising sales organizations, leveraging best-in-class platforms like Databricks, Snowflake, and leading AI models.
- What kind of environment can a Senior Data & AI Engineer expect at V2 Strategic Advisors?