Senior Software Development Engineer, Big Data

About The Team

The Engagement Data Warehouse team at Zillow, part of the Analytics Data Engineering organization, collaborates closely with product and analytics teams. Your contributions will directly impact the design and implementation of data engineering solutions, enhancing the efforts of Data Science, AI/ML, Business Operations, and Product teams, thereby improving Zillow's offerings for customers. This dedicated team is crucial in supporting Zillow's Growth and Shopping business areas.

About The Role

The Senior Software Development Engineer, Big Data role at Zillow offers an outstanding opportunity to lead brand-new data engineering work. We are seeking an individual who can:

• Design and implement scalable data pipelines to collect, process, and store large volumes of critical data from various sources.
• Ensure data reliability and uptime by monitoring and troubleshooting data pipeline performance and scalability for efficient operations.
• Be a “lazy” engineer – continuously seeking to improve team efficiency by automating repeatable processes.
• Facilitate engineering discussions with collaborators, customers, partners, and team members from various departments to understand business needs and translate them into technical requirements.
• Be a fast learner with strong business insight, collaborating with product partners to quickly gain a deep understanding of business processes feeding into the team’s data pipelines.
• Authoritatively translate business use cases into well-thought-out data models that are easy to evolve with the business.
• Communicate technical concepts effectively to non-technical audiences.
• Be a bar-raiser for engineering best practices – carefully reviewing specifications, designs, pull requests, and providing constructive feedback to enhance team output quality.
• Consistently write high-quality code, refactor, and optimize for better scalability, performance, and readability.
• Provide leadership within the team and mentor junior engineers.

This is a Remote position, meaning employees work from a physical location of their choice within the 50 United States, with limited exceptions.

Who you are

• A degree (BS+) in Computer Science or a related field.
• 5+ years of experience building and maintaining data-intensive applications.
• Experience developing sophisticated data pipelines scaling to billions of rows with production quality deployment, monitoring, and reliability at petabyte scale.
• Extensive experience with modern data technologies such as Spark and Airflow.
• Strong proficiency in programming languages such as Python, Java, or Scala.
• Extensive experience with SQL.
• Proven data modeling experience, translating business requirements into clean and easily evolvable data models.
• Excellent interpersonal skills and a passion for collaborating across organizational boundaries.

Nice to have

• Experience working with cloud services (AWS/Azure/GCP).
• Experience with Databricks.

At Zillow, we value candidates with non-traditional backgrounds and encourage you to apply if you possess transferable skills or related experiences.

Key skills/competency

• Data Engineering
• Big Data
• Scalable Data Pipelines
• Spark
• Airflow
• Python
• Java
• Scala
• SQL
• Data Modeling
• Cloud Services (AWS/Azure/GCP)
• Data Reliability
• Automation
• Mentorship