Software Architect (Remote)
Hired · United States
- Hybrid
- Contract
- $120,000 / year
- United States
Job highlights
- Analyze GitHub issues for software engineering tasks.
- Develop LLM performance test suites.
- Design verifiable software engineering tasks.
- Improve test coverage and quality.
- Contribute to AI software development tools.
About the role
Role Overview
We are hiring for one of our clients, seeking a Senior Software Engineer – Rust (LLM Evaluation & Repository Validation) to work on a Part-time basis. This individual will analyze and triage GitHub issues across trending open-source libraries, contributing to the development of verifiable software engineering tasks based on public repository histories. By working on this project, they will play a critical role in evaluating how Large Language Models (LLMs) interact with real code, driving the advancement and deployment of powerful AI systems. This is a unique opportunity for a skilled software engineer to blend practical engineering with AI research in the technology industry.
Key Responsibilities
- Analyze and triage GitHub issues across trending open-source libraries to identify relevant software engineering tasks.
- Develop and maintain high-quality test suites for evaluating LLM performance on software engineering tasks.
- Collaborate with the development team to design and implement verifiable software engineering tasks based on public repository histories.
- Evaluate and improve the test coverage and quality of software engineering tasks.
- Contribute to the development of AI-assisted software development tools and technologies.
Required Skills & Qualifications
- Proficiency in Rust programming language and experience with large-scale software development projects.
- Strong understanding of software engineering principles, including design patterns, testing, and code review.
- Experience with GitHub and other version control systems, including issue tracking and pull request management.
- Familiarity with AI and machine learning concepts, particularly those related to Large Language Models (LLMs).
- Excellent communication and collaboration skills, with the ability to work effectively in a global team.
More About the Opportunity
This role offers a unique opportunity to work with a global leader in the technology industry, contributing to the development of AI-assisted software development tools and technologies. As a Senior Software Engineer – Rust (LLM Evaluation & Repository Validation), you will have the chance to work with a talented team of engineers and researchers, driving the advancement and deployment of powerful AI systems.
Equal Opportunity Employer
We hire based on skills and expertise. All qualified candidates are welcome regardless of background, experience, or prior employment history. Applications are reviewed solely on demonstrated technical ability and qualifications.
Key skills/competency
- Software Architect
- Rust
- LLM Evaluation
- Repository Validation
- GitHub Issues
- Software Engineering
- AI Research
- Machine Learning
- Test Suites
- Open-source Libraries
Skills & topics
- Software Architect
- Rust
- LLM
- AI
- Machine Learning
- GitHub
- Software Engineering
- Repository Validation
- Test Suites
- Remote
How to get hired
- Research the company: Understand their mission, values, and recent projects.
- Tailor your resume: Highlight relevant Rust, LLM, and GitHub experience.
- Craft a strong cover letter: Showcase your passion for AI and software engineering.
- Prepare for technical interviews: Brush up on Rust, software design, and LLM concepts.
- Emphasize collaboration: Demonstrate your ability to work in a global team.
Technical preparation
Behavioral questions
Frequently asked questions
- What specific experience is required for the Software Architect role at Hired focusing on LLM Evaluation?
- The Software Architect role at Hired, specifically for LLM Evaluation, requires proficiency in Rust, experience with large-scale software development, a strong understanding of software engineering principles, familiarity with GitHub, and knowledge of AI/ML concepts, particularly LLMs. Demonstrating your ability to analyze GitHub issues and develop test suites for LLMs is crucial.
- Is the Software Architect position at Hired fully remote?
- Yes, the Software Architect position at Hired is fully remote, offering the flexibility to work from anywhere. This allows for a global talent pool and supports a flexible work arrangement.
- What kind of projects will a Software Architect work on at Hired related to LLM evaluation?
- A Software Architect at Hired working on LLM evaluation will analyze GitHub issues in open-source libraries, develop test suites to assess LLM performance on code-related tasks, and contribute to the creation of AI-assisted software development tools. The focus is on bridging practical engineering with AI research.
- How does Hired ensure a fair application process for the Software Architect role?
- Hired emphasizes an equal opportunity approach, hiring based on skills and expertise. All applications for the Software Architect role are reviewed solely on demonstrated technical ability and qualifications, regardless of background or prior employment history.
- What are the collaboration expectations for the Software Architect role at Hired?
- The Software Architect role at Hired requires excellent communication and collaboration skills. You will work effectively within a global team, contributing to the design and implementation of verifiable software engineering tasks and AI-assisted tools.