29 days ago
Senior Software Engineer - Python (LLM Evaluation)
Highbrow Technology Inc
Remote
Part Time
$240,000
Remote
Job Overview
Job TitleSenior Software Engineer - Python (LLM Evaluation)
Job TypePart Time
Offered Salary$240,000
LocationRemote
Who's the hiring manager?
Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.
Job Description
Senior Software Engineer - Python (LLM Evaluation)
Highbrow Technology Inc is seeking a talented Senior Software Engineer with a strong background in Python for LLM evaluation and AI research projects. This is a 3-month contract role, requiring a 40-hour per week commitment with essential PST overlap.
Key Responsibilities
- Analyze GitHub repositories and issues to understand codebase structure and common problems.
- Evaluate code quality, adherence to best practices, and test coverage for various software projects.
- Run and modify real-world codebases to thoroughly assess the performance and capabilities of Large Language Models (LLMs).
- Contribute to AI research by providing actionable insights from LLM evaluations.
Required Experience & Skills
- Proven experience of 3+ years in software engineering.
- Expertise in Python programming.
- Strong proficiency with Git and managing GitHub repositories.
- Experience with Docker for containerization and environment management.
- Demonstrated ability in software testing and comprehensive codebase evaluation.
- Familiarity with open-source contributions and working with diverse repositories.
Key skills/competency
- Python
- LLM Evaluation
- AI Research
- Git
- GitHub
- Docker
- Software Testing
- Code Quality
- Test Coverage
- Codebase Analysis
How to Get Hired at Highbrow Technology Inc
- Research Highbrow Technology Inc's culture: Study their mission, values, recent news, and employee testimonials on LinkedIn and Glassdoor to align your application.
- Tailor your resume for LLM evaluation: Highlight Python, Git, Docker, and experience with AI/ML or language models to match the Senior Software Engineer requirements.
- Showcase open-source contributions: Provide links to relevant GitHub projects demonstrating your code quality evaluation and contribution skills.
- Prepare for technical deep-dives: Expect questions on Python coding, Git workflows, Docker environments, and your approach to evaluating complex codebases and LLMs.
- Emphasize problem-solving: Be ready to discuss specific examples where you've analyzed issues, improved code quality, or assessed system performance in prior roles.
Frequently Asked Questions
Find answers to common questions about this job opportunity
01What kind of LLM evaluation projects will I be working on at Highbrow Technology Inc?
02What is the expected time commitment and duration for this Senior Software Engineer contract role?
03What specific tools and technologies are essential for the Senior Software Engineer - Python (LLM Evaluation) role?
04Will I be expected to contribute to open-source projects in this role at Highbrow Technology Inc?
05How important is my experience with code quality and test coverage for the Senior Software Engineer - Python (LLM Evaluation) position?
Explore similar opportunities that match your background