Data Engineer
AgileGrid Solutions · United States
- On site
- Full-time
- United States
Tailored resume — keyword-matched to this role.
Hiring manager — we find who's hiring.
Intro email — drafted to reach them directly.
About the role
About The Company
GrabJobs is a leading global platform dedicated to connecting talented professionals with innovative organizations across diverse industries. Our mission is to streamline the hiring process by providing cutting-edge technology solutions that facilitate seamless recruitment experiences for both employers and job seekers. With a strong presence in multiple countries, GrabJobs prides itself on fostering an inclusive, dynamic, and growth-oriented environment. We are committed to leveraging the latest advancements in technology to create impactful employment opportunities and to support the career development of our team members. Our company values innovation, collaboration, and integrity, ensuring that every employee contributes to our vision of transforming the future of work.
About The Role
We are seeking a highly skilled Data Engineer to join our innovative team at GrabJobs. In this role, you will be responsible for designing, building, and implementing large-scale, sophisticated data pipelines that support our core business functions and strategic initiatives. Your expertise will be instrumental in developing scalable data ingestion and processing systems using Apache NiFi within an AWS cloud environment. You will work closely with cross-functional teams, including data science, analytics, and engineering, to ensure the integrity, efficiency, and security of our data architecture. This position offers the flexibility to work remotely from anywhere in the United States, providing an excellent opportunity for professionals seeking a dynamic and autonomous work environment. The ideal candidate will have a passion for data engineering, a strong technical background, and a proactive approach to problem-solving.
Qualifications
Joining GrabJobs offers a vibrant and collaborative environment with colleagues from around the world, including offices in Europe, Asia, and the United States. We provide various social events and team-building activities to foster a sense of community. Employees enjoy flexible working hours and the autonomy to manage their daily tasks effectively. Our inclusive culture promotes diversity and supports groups such as Women in Tech and Pride, welcoming all participants. We also offer comprehensive benefits, including a global Employee Assistance Program, access to well-being apps like Calm and Reulay, online training resources, and opportunities for professional development. Our competitive compensation package includes performance bonuses, equity stock options, and 401(k) contributions, all designed to recognize and reward your contributions to our success.
Equal Opportunity
GrabJobs is committed to fostering an inclusive and diverse workplace. We provide equal employment opportunities to all applicants and employees regardless of age, race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status. We believe that diverse teams drive innovation and excellence, and we encourage individuals with varied backgrounds and experiences to apply. All qualified candidates will receive consideration for employment based on their skills, experience, and potential. We are dedicated to creating a workplace where everyone feels valued, respected, and empowered to succeed.
GrabJobs is a leading global platform dedicated to connecting talented professionals with innovative organizations across diverse industries. Our mission is to streamline the hiring process by providing cutting-edge technology solutions that facilitate seamless recruitment experiences for both employers and job seekers. With a strong presence in multiple countries, GrabJobs prides itself on fostering an inclusive, dynamic, and growth-oriented environment. We are committed to leveraging the latest advancements in technology to create impactful employment opportunities and to support the career development of our team members. Our company values innovation, collaboration, and integrity, ensuring that every employee contributes to our vision of transforming the future of work.
About The Role
We are seeking a highly skilled Data Engineer to join our innovative team at GrabJobs. In this role, you will be responsible for designing, building, and implementing large-scale, sophisticated data pipelines that support our core business functions and strategic initiatives. Your expertise will be instrumental in developing scalable data ingestion and processing systems using Apache NiFi within an AWS cloud environment. You will work closely with cross-functional teams, including data science, analytics, and engineering, to ensure the integrity, efficiency, and security of our data architecture. This position offers the flexibility to work remotely from anywhere in the United States, providing an excellent opportunity for professionals seeking a dynamic and autonomous work environment. The ideal candidate will have a passion for data engineering, a strong technical background, and a proactive approach to problem-solving.
Qualifications
- Master’s degree in Computer Science, Computer Engineering, or a closely related field.
- Minimum of 1 year of professional experience as a Data Engineer or in a related role.
- Proficiency in Python and Java programming languages.
- Hands-on experience with Apache Kafka for data streaming and messaging.
- Strong knowledge of AWS cloud services and architecture.
- Experience with ETL development and data warehousing solutions.
- Proficiency in SQL for data analysis and debugging.
- Experience working within an Agile development environment.
- Knowledge of designing scalable data architectures and data models.
- Experience with Docker to ensure consistent development and testing environments.
- Strong problem-solving skills and the ability to work independently in a fast-paced environment.
- Design, develop, and maintain large-scale, sophisticated data pipelines using Apache NiFi for downstream analytics and data science applications related to sports performance products.
- Create scalable ingestion pipelines within AWS cloud services to process real-time and batch data from various external sources, ensuring seamless integration with storage, processing, and analytics tools.
- Develop and optimize ETL processes using Python and Java, including creating triggers and filters to enhance data flow efficiency and resource utilization.
- Implement monitoring, error handling, and alerting mechanisms to ensure the reliability and observability of all data pipelines.
- Establish and enforce rigorous unit testing protocols to maintain system robustness and data integrity.
- Design and implement data models for internal and external data representations, supporting efficient data transformation and storage.
- Utilize Kafka to facilitate effective data movement throughout the pipeline and support downstream data science and analytics efforts.
- Conduct data analysis and debugging to identify and rectify issues related to data quality, including writing SQL queries to troubleshoot bad data.
- Automate data cleaning processes to remove unusable data, with logging to monitor issue frequency and severity.
- Collaborate with engineering teams to adopt best practices, promote scalability, and ensure consistency across data systems.
- Maintain awareness of company standards and technological guidance, using project management tools like JIRA to coordinate efforts.
- Follow industry best practices for scalable and consistent data architecture, utilizing Java within the NiFi framework to build data processors.
- Use Docker to create isolated, repeatable environments for development, testing, and deployment.
- Work independently to meet project deadlines driven by sports analytics needs, demonstrating proactive problem-solving and initiative.
Joining GrabJobs offers a vibrant and collaborative environment with colleagues from around the world, including offices in Europe, Asia, and the United States. We provide various social events and team-building activities to foster a sense of community. Employees enjoy flexible working hours and the autonomy to manage their daily tasks effectively. Our inclusive culture promotes diversity and supports groups such as Women in Tech and Pride, welcoming all participants. We also offer comprehensive benefits, including a global Employee Assistance Program, access to well-being apps like Calm and Reulay, online training resources, and opportunities for professional development. Our competitive compensation package includes performance bonuses, equity stock options, and 401(k) contributions, all designed to recognize and reward your contributions to our success.
Equal Opportunity
GrabJobs is committed to fostering an inclusive and diverse workplace. We provide equal employment opportunities to all applicants and employees regardless of age, race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status. We believe that diverse teams drive innovation and excellence, and we encourage individuals with varied backgrounds and experiences to apply. All qualified candidates will receive consideration for employment based on their skills, experience, and potential. We are dedicated to creating a workplace where everyone feels valued, respected, and empowered to succeed.