Junior Data Engineer

Junior Data Engineer at City of Houston

Houston, TX, the fourth largest city in the country, manages a budget exceeding 6 billion dollars and employs 20,000 individuals across 23 departments, all generating fascinating data and a wide range of analytical questions. The City of Houston is dedicated to fostering healthy and resilient communities through smart civic investments, dynamic partnerships, education, and innovation, striving to be a place where everyone can prosper and feel at home.

About the Role

The Junior Data Engineer will play a crucial role in assisting with the construction and upkeep of data systems that underpin the City’s analytics and core business functions. This position is ideally suited for individuals with a strong passion for data, a keen desire to master modern technologies, and a commitment to contributing to public service. Working under the mentorship of senior team members, the Junior Data Engineer will be responsible for the following key functions:

• Support data integration efforts by interacting with diverse data sources, including various databases, APIs, and external data providers.
• Actively monitor and troubleshoot data pipelines to ensure their continuous reliability and optimal performance.
• Prepare data rigorously by performing cleaning, transformation, and validation processes to guarantee high quality and consistency.
• Engage in continuous learning and practical application of leading cloud technologies such as Microsoft Azure, AWS, and Snowflake for effective data storage and processing.
• Develop and optimize SQL queries essential for efficient data retrieval and manipulation.
• Collaborate closely with team members and data analysts to thoroughly understand data requirements and deliver effective solutions.
• Document processes and workflows meticulously to facilitate knowledge sharing and streamline troubleshooting efforts.
• Adhere strictly to established standards and best practices, ensuring full compliance with IT policies and robust security guidelines.
• Demonstrate a strong sense of curiosity and a proactive willingness to learn about business processes, alongside exploring both new and existing technologies.
• Perform other assigned duties as needed to support team objectives.

Minimum Requirements

Education Requirements

A Bachelor's degree in Computer Science, Management and Information Systems (MIS), or a closely related field is required. Application-specific technical certifications may substitute for one year of experience.

Experience Requirements

Candidates must possess at least three (3) years of technology experience focused on creating or configuring software applications. Relevant professional experience can substitute for the education requirement on a year-for-year basis.

Preferred Qualifications

Preference will be given to candidates demonstrating proficiency in the following areas:

• Strong knowledge of SQL and practical experience in writing complex queries.
• Proficiency in programming with Python and its core libraries.
• Experience utilizing cloud platforms such as Azure or AWS.
• Familiarity with fundamental data concepts including data modeling, ETL processes, or data warehousing (demonstrated through coursework or personal projects).
• Experience with data visualization tools like Power BI, Matplotlib, Seaborn, or Shiny.
• Proven ability to work collaboratively within a team environment and communicate effectively.
• Completion of relevant coursework, internships, and professional certifications.

Key skills/competency

• SQL
• Python
• Microsoft Azure
• AWS
• Snowflake
• Data Integration
• Data Pipelines
• Data Transformation
• Data Modeling
• ETL