Data Engineer
Deccan AI Experts
Job Overview
Who's the hiring manager?
Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.
Job Description
About Deccan AI Experts
Deccan AI Experts is a pioneering company founded by IIT Bombay and IIM Ahmedabad alumni, with a strong founding team from IITs, NITs, and BITS. We specialize in delivering high-quality human-curated data, AI-first scaled operations services, and more. Based in SF and Hyderabad, we are a young, fast-moving team on a mission to build AI for Good, driving innovation and positive societal impact.
About the Data Engineer Role
We are looking for a Data Engineer to join us for critical projects. You will be working with big techs to help them in building cutting-edge AI foundational models meant to perform exceptionally well on engineering and infrastructure tasks. In this role, you will be part of a highly skilled team with niche domain expertise, being at the forefront to improve the accuracy & performance of SOTA models.
Key Responsibilities
- Design, build, and maintain scalable data pipelines and ETL workflows.
- Optimize data architecture for performance and reliability.
- Collaborate with data scientists and analysts to meet data needs.
- Ensure data quality, security, and compliance standards.
- Annotate and evaluate AI-generated data pipeline scripts and solutions.
- Review AI outputs related to data ingestion, transformation, and storage for correctness and efficiency.
- Provide feedback to improve AI understanding of data engineering best practices and architectures.
Required Qualifications
- Strong experience in SQL, Python, and big data technologies (Spark, Hadoop, etc.).
- Familiarity with cloud data platforms (AWS, GCP, Azure).
- Understanding of data warehousing and ETL tools.
- Enthusiasm to make foundational AI models perform better.
- Background in Computer Science, Data Engineering, or related field.
Why Join Deccan AI Experts?
- Competitive hourly pay: up to ₹1500 per hour.
- Fully remote and flexible work schedule.
- Opportunity to contribute to the advancement of AI technology.
Key skills/competency
- Data Pipeline
- ETL
- Data Architecture
- SQL
- Python
- Spark
- Hadoop
- Cloud Platforms
- Data Quality
- AI Foundational Models
How to Get Hired at Deccan AI Experts
- Research Deccan AI Experts' mission: Understand their 'AI for Good' philosophy and founding team's vision from IITs/IIM.
- Tailor your resume for data engineering: Highlight strong experience in SQL, Python, big data technologies, and cloud platforms.
- Showcase relevant project experience: Emphasize work with data pipelines, ETL, data architecture optimization, and AI model evaluation.
- Prepare for technical assessments: Expect questions on distributed computing (Spark, Hadoop), cloud services (AWS, GCP, Azure), and data warehousing concepts.
- Demonstrate passion for AI advancement: Be ready to discuss how you would contribute to improving foundational AI model accuracy and performance.
Frequently Asked Questions
Find answers to common questions about this job opportunity
Explore similar opportunities that match your background