Assessment Specialist
Sourced · NAMER
- Remote
- Full-time
- $72,500 / year
Job highlights
- Design, validate, and improve learning assessments.
- Utilize psychometric rigor and content expertise.
- Analyze data and conduct reliability studies.
- Collaborate with subject matter experts.
- Work remotely with flexible hours.
About the role
Assessment Specialist
We are hiring an Assessment Specialist to design, validate, and improve assessments across our learning programs. The role combines psychometric rigor with strong content sense — building assessments that measure what they claim to measure.
Key Responsibilities
- Design assessment items, rubrics, and scoring guides aligned to learning outcomes
- Conduct item analysis, reliability testing, and validation studies
- Maintain item banks and assessment blueprints
- Partner with subject matter experts on item review and content alignment
- Train scorers and ensure inter-rater reliability for rubric-based assessments
- Document psychometric methodology and assessment design decisions
Required Skills and Qualifications
- 3+ years in assessment design, psychometrics, or educational measurement
- Strong understanding of assessment validity, reliability, and item analysis
- Familiarity with statistical analysis tools (R, SPSS, Excel)
- Excellent writing and editing skills
- Master's degree in measurement, psychometrics, or education preferred
- Experience with assessment platforms and item banking systems
What You'll Bring
- Genuine passion for learner outcomes and continuous improvement of materials
- Clear written communication and the ability to break down complex topics
- Openness to feedback and a willingness to iterate based on learner data
- Comfort working asynchronously across time zones
What We Offer
- Fully remote, flexible work hours
- Performance-based bonus structure
- Annual learning & development stipend
- Health and wellness benefits (varies by location)
- Opportunity to work on high-scale, real-world impact projects
Equal Opportunity Statement
This is an equal opportunity role. Applications are welcomed from all qualified individuals regardless of race, color, ethnicity, nationality, gender, gender identity or expression, sexual orientation, age, religion, disability, marital status, or any other characteristic protected by applicable law. All hiring decisions are based solely on qualifications, skills, and demonstrated ability.
Key skills/competency
- Assessment Design
- Psychometrics
- Educational Measurement
- Item Analysis
- Reliability Testing
- Validation Studies
- Item Banks
- Statistical Analysis
- Subject Matter Experts
- Scorer Training
Skills & topics
- Assessment Specialist
- Psychometrician
- Educational Measurement
- Assessment Design
- Item Analysis
- Reliability
- Validity
- R
- SPSS
- Remote
How to get hired
- Tailor your resume: Highlight your assessment design and psychometric experience.
- Showcase your skills: Emphasize your understanding of validity, reliability, and item analysis.
- Quantify achievements: Use data to demonstrate the impact of your assessment improvements.
- Highlight collaboration: Mention experience working with subject matter experts and training scorers.
- Express passion: Convey your commitment to learner outcomes and continuous improvement.
Technical preparation
Master psychometric principles and assessment theory.,Practice statistical analysis with R or SPSS.,Develop skills in item banking systems.,Create sample assessment items and rubrics.
Behavioral questions
Describe a time you improved an assessment.,How do you handle feedback on your work?,Explain a complex topic simply.,How do you collaborate with subject experts?
Frequently asked questions
- What is the Assessment Specialist role at Sourced focused on?
- The Assessment Specialist at Sourced is responsible for designing, validating, and improving assessments for learning programs, ensuring they accurately measure learning outcomes through psychometric rigor and content expertise.
- What are the key responsibilities for an Assessment Specialist at Sourced?
- Key responsibilities include designing assessment items and rubrics, conducting item analysis and validation studies, maintaining item banks, partnering with subject matter experts, and training scorers.
- What qualifications are required for the Assessment Specialist position at Sourced?
- Required qualifications include 3+ years in assessment design or psychometrics, a strong understanding of assessment validity and reliability, familiarity with statistical tools like R or SPSS, and excellent writing skills. A Master's degree is preferred.
- Is the Assessment Specialist role at Sourced remote?
- Yes, the Assessment Specialist role at Sourced is fully remote, offering flexible work hours and the ability to work across different time zones.
- What is the salary range for the Assessment Specialist role at Sourced?
- The indicative salary range for the Assessment Specialist role is $55,000 – $90,000 USD equivalent, commensurate with experience, qualifications, and location, plus benefits and a performance-based bonus.
- What kind of statistical analysis tools are expected for the Assessment Specialist at Sourced?
- Familiarity with statistical analysis tools such as R, SPSS, and Excel is expected for the Assessment Specialist role at Sourced.
- Does Sourced offer professional development for the Assessment Specialist?
- Yes, Sourced offers an annual learning and development stipend, as well as health and wellness benefits, to support the professional growth of its Assessment Specialists.