Prompt Engineer
@ Checkmate

New York, NY
$150,000
On Site
Full Time
Posted 21 days ago

Your Application Journey

Personalized Resume
Apply
Email Hiring Manager
Interview

Email Hiring Manager

XXXXXXXX XXXXXXXXXXXXX XXXXXXXX***** @checkmate.com
Recommended after applying

Job Details

About the Role

As a Prompt Engineer at Checkmate, you will blend traditional software engineering with natural language processing expertise to develop and maintain systems that leverage LLMs, specifically for the restaurant tech domain. This hybrid role requires collaboration with cross-functional teams to implement AI-driven features that support customer service automation, order management, reporting, and staff training.

Essential Job Functions

  • Prompt Development & Optimization: Design, build, test, and refine prompts for various AI tasks.
  • Evaluation & Testing: Build robust test suites using tools like CoVal, LangFuse, and Galileo to ensure prompt accuracy and compliance.
  • Performance Analysis & Improvement: Analyze outputs using metrics and feedback to enhance system reliability.
  • Collaboration: Work with operations, product, data science, and engineering teams for quality assurance.
  • Model Adaptation: Create effective prompts across different models including GPT, LLaMA, Gemini, and custom LLMs.
  • End-to-End Ownership: Manage prompt projects from concept to deployment and continuous improvement.
  • Team Leadership & Mentorship: Lead a team of analysts and collaborate with operations for seamless integration.

Requirements

Minimum three years of experience in AI, ML, NLP, and prompt engineering. Strong Python programming skills, data and computer science fundamentals, experience with relational databases, and full-stack development abilities. Ability to process data, test systems, and drive ambiguous projects from start to finish with excellent problem solving and communication skills. Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related field required. Flexibility to work US hours until at least 6 pm ET.

Preferred Qualifications

Experience with multiple LLMs and tools like LangFuse and Galileo, knowledge of cloud platforms (AWS, GCP, Azure, OpenStack), expertise with Docker and Kubernetes, focus on scalability and performance, and familiarity with machine learning workflows. Advanced degree is a plus.

Benefits

Health Care (Medical, Dental & Vision), Retirement Plan (401k), Life Insurance, Flexible Paid Time Off, Family Leave, Disability Coverage, Training & Development, Work From Home, and Stock Option Plan.

Key skills/competency

  • Python
  • NLP
  • LLM
  • Testing
  • Collaboration
  • Cloud
  • Data Analysis
  • Full-stack
  • Leadership
  • Problem-solving
Apply without a personalized resume

How to Get Hired at Checkmate

🎯 Tips for Getting Hired

  • Research Checkmate's culture: Study their mission and recent updates.
  • Customize your resume: Highlight NLP and prompt engineering skills.
  • Showcase technical projects: Include AI and cloud experiences.
  • Prepare for hybrid interviews: Focus on both technical and leadership questions.

📝 Interview Preparation Advice

Technical Preparation

Review Python libraries and advanced coding techniques.
Practice prompt development and testing with LLM tools.
Familiarize with cloud platforms and container tools.
Revisit database management and full-stack projects.

Behavioral Questions

Describe teamwork in cross-functional projects.
Explain how you resolve ambiguous issues.
Share examples of leadership in technical teams.
Discuss handling tight deadlines and feedback.

Frequently Asked Questions