AI Data Engineer

AI Data Engineer

Please note that this is a contract role providing services to Microsoft through external staffing partners of Allegis Global Solutions. If you are selected for this role, you will be employed by AGS and will not be an employee of Microsoft.

We are seeking a talented data professional to join a dynamic team responsible for building and maintaining cutting-edge data infrastructure. In this role, you will design, develop, and optimize scalable data platforms and pipelines that power critical business insights and decision-making across the organization. You will collaborate closely with cross-functional stakeholders to translate complex business requirements into robust technical solutions, ensuring data accuracy, reliability, and accessibility. This position offers the opportunity to work with modern data technologies and make a meaningful impact on data-driven initiatives that shape the future of the organization.

Key Responsibilities

• Design, build, and maintain scalable data platforms and pipelines using Python, SQL, Airflow, and Spark.
• Collaborate with stakeholders to understand and translate business requirements into technical specifications.
• Develop and implement data models that support analytics and reporting needs.
• Ensure data accuracy, consistency, and reliability by implementing robust data validation and quality checks.
• Work with cross-functional teams, including data analysts, data scientists, and business leaders, to deliver high-quality data solutions.
• Continuously monitor and optimize data pipelines for performance, scalability, and cost-efficiency.
• Build and implement monitoring and observability metrics to ensure data quality and detect anomalies in data pipelines.
• Maintain clear and comprehensive documentation of data processes and communicate technical concepts effectively to non-technical stakeholders.
• Debug and resolve issues related to data ingestion and data warehouse operations.

Required Qualifications

• Minimum of 2 years of experience in data engineering and infrastructure.
• Demonstrated track record of stable employment history without frequent job changes.
• Experience with cloud platforms such as AWS, GCP, or Azure is preferred.
• Familiarity with data warehousing technologies such as Deltalake, Azure Fabric, Snowflake, Redshift, or BigQuery is preferred.
• Knowledge of data governance and data security best practices is preferred.
• Bachelor's degree in Computer Science, Engineering, Information Systems, or a related field.
• Proficiency in Python programming.
• Strong SQL expertise.
• Experience with Kubernetes.
• Hands-on experience with Apache Airflow.
• Knowledge of Scala.
• Data warehouse management capabilities.
• Expertise in Apache Spark.
• Strong experience building and maintaining robust data pipelines and ETL processes.
• Analytical skills with the ability to gather business requirements and troubleshoot complex data issues.
• Excellent verbal and written communication skills with the ability to convey technical information to non-technical audiences.
• Proven ability to work effectively in a collaborative, cross-functional environment.

Additional Details

• Location: Remote
• Duration: 4 months
• Pay Range*: $46.50 - $52.50 per hour
• Weekly Schedule: 40 hours
• Job Status: Non-Exempt
• Application Deadline: Apply within 72 hours of the posting date to ensure consideration.

Benefits and Perks (for contract roles through AGS)

• Medical, dental & vision plans
• Hospital plans
• 401(k) Retirement Plan – Pre-tax and Roth post-tax contributions available
• Life Insurance (Company paid Basic Life and AD&D as well as voluntary Life & AD&D for the employee and dependents)
• Company paid short and long-term disability
• Health & Dependent Care Spending Accounts (HSA & DCFSA)
• Employee Assistance Program
• Time Off/Leave (PTO, Allegis Group Paid Family Leave, Parental Leave)

Benefits are subject to change and may be subject to specific elections, plan, or program terms.

Equal Opportunity and Accommodations

AGS is an Equal Opportunity Employer and will consider all applications without regard to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law. If you would like to request a reasonable accommodation, such as the modification or adjustment of the job application process or interviewing process due to a disability, please email accommodation@allegisglobalsolutions.com for other accommodation options.

Employment is contingent upon verification of identity and authorization to work in the United States. All persons hired will be required to complete Form I-9 and provide acceptable documentation as required by law.

We may use artificial intelligence (AI) tools to screen, assess, or select applicants for this position. If you have questions about our use of AI in the hiring process, or would like more information, please contact us.

We reserve the right to pay above or below the posted wage based on factors unrelated to protected classifications. Individual compensation offered for this position within this range will depend on many factors, including qualifications, skills, relevant experience, job knowledge, geographic location, internal equity, and other pertinent job-related factors.

Key skills/competency

• Data Engineering
• Data Pipelines
• ETL Processes
• Python Programming
• SQL
• Apache Spark
• Apache Airflow
• Cloud Platforms (Azure, AWS, GCP)
• Data Warehousing
• Data Quality