Bash/PowerShell Engineer - AI Training

Role Description for Bash/PowerShell Engineer - AI Training

As a remote, hourly paid Bash/PowerShell Engineer, you will play a crucial role in reviewing AI-generated responses and developing high-quality, automation-focused content. Your responsibilities include meticulously evaluating the reasoning quality and step-by-step problem-solving behind scripts and troubleshooting workflows. You will assess solutions for accuracy, clarity, and adherence to prompts, identifying errors in logic, safety, or portability. This role involves fact-checking technical details and crafting expert-level explanations and model solutions that demonstrate correct scripting patterns. Furthermore, you will rate and compare multiple AI responses based on their correctness and reasoning quality. This contract position is with SME Careers, a rapidly expanding AI Data Services company and subsidiary of SuperAnnotate, dedicated to providing AI training data for leading AI companies and foundation model labs, directly contributing to the enhancement of premier AI models worldwide.

Candidate Profile

• Expert-level proficiency in Bash and/or PowerShell scripting is essential.
• Candidates should possess 2–3+ years of hands-on experience in at least one of Bash or PowerShell.
• Strong experience in writing, debugging, and maintaining shell or object-based automation scripts.
• Ability to thoroughly evaluate scripts for correctness, readability, safety, performance, and portability across various environments.
• Professional background in software engineering, DevOps, IT automation, or infrastructure-focused roles.
• Minimum Bachelor’s degree in Computer Science or a closely related technical field.
• Significant experience utilizing large language models (LLMs) for coding, troubleshooting, and script review.
• Excellent English writing skills, with the ability to clearly document and explain complex automation concepts.
• Highly preferred: For Bash, strong comfort with awk, sed, and grep; for PowerShell, experience with PowerShell Core, DSC, and Azure PowerShell modules.
• Preferred: Merged PRs in CLI, DevOps, or infrastructure-related open-source projects; familiarity with CI pipelines, automation workflows, or cloud scripting; previous AI data training or model evaluation work is strongly preferred, along with a minimum C1 English proficiency.

Key Responsibilities

• Develop AI Training Content: Create detailed prompts across various topics and generate responses to guide AI learning, ensuring models comprehensively understand diverse subjects.
• Optimize AI Performance: Evaluate and rank AI responses to significantly enhance the model's accuracy, fluency, and contextual relevance.
• Ensure Model Integrity: Rigorously test AI models for potential inaccuracies or biases, validating their reliability across all use cases.

Key skills/competency

• Bash Scripting
• PowerShell Scripting
• AI Training
• Automation
• Script Debugging
• LLMs
• Technical Documentation
• DevOps
• IT Automation
• Model Evaluation