Prompt Engineer

About Lensa & ICF

Lensa is a career site that helps job seekers find great jobs in the US. We are not a staffing firm or agency. Lensa does not hire directly for these jobs, but promotes jobs on LinkedIn on behalf of its direct clients, recruitment ad agencies, and marketing partners. Lensa partners with DirectEmployers to promote this job for ICF. Clicking "Apply Now" or "Read more" on Lensa redirects you to the job board/employer site. Any information collected there is subject to their terms and privacy notice.

Job Summary: Prompt Engineer

As a Prompt Engineer at ICF, you will be responsible for designing and implementing the natural language processing (NLP) and machine learning (ML) models that power our web3 documentation chatbot. You will work closely with our product and engineering teams to ensure that our chatbot provides accurate and helpful responses to user inquiries.

Location

This is a remote position within the U.S. Please note that ICF monitors employee work locations, blocks access from foreign locations/foreign IP addresses, and prohibits personal VPN connections. U.S. Citizenship is required and work must be performed in the United States for this federal contract.

Key Responsibilities

• Design, develop, and implement custom generative LLMs (e.g. models similar to GPT) and discriminative LLMs (e.g. models similar to BERT).
• Create wrapper apps based on ChatGPT and other LLMs.
• Design, develop, and implement systems for AI alignment, Reinforcement Learning with Human Feedback (RLHF) instruction models, and AI guardrails.
• Conduct rigorous tests to evaluate LLMs across standardized performance benchmarks and custom evaluations.
• Employ cutting-edge Natural Language Processing (NLP) and Machine Learning (ML) techniques to solve complex natural language problems.
• Translate technical findings into clear, actionable insights for a non-technical audience.
• Develop and maintain documentation and best practices for our NLP and ML models.
• Collaboratively develop distributed training infrastructure to train and fine-tune LLMs.
• Collaborate closely with data science and core development teams to lead efforts in designing and implementing products from scratch.
• Integrate AI technologies into both internal and external tools.
• Provide technical leadership in AI system audits, model accuracy improvements, and tool deployment.
• Fine-tune AI models based on real-world performance data and stakeholder feedback.

Minimum Qualifications

• US Citizenship is required by the federal government for this position.
• Must be able to obtain Public Trust clearance.
• Must reside and perform work in the United States (U.S.) for federal contract compliance.
• Bachelor's degree in computer science or related field.
• 7 years of work experience as a software engineer or relevant experience.
• Strong background in natural language processing, machine learning, and data analysis.

Preferred Qualifications

• 3+ years of experience with Python.
• Experience with Azure.
• Familiarity with popular machine learning (ML) frameworks such as TensorFlow and PyTorch.
• Experience with generative large language model (LLM) fine-tuning and prompt engineering.
• Experience with deep learning frameworks.
• Ability to work with data scientists, business analysts, and machine learning infrastructure to connect business and technology partners.
• Demonstrated passion for developing LLM-powered products (commercial experience or open-source projects).
• Proven track record of shipping software and successfully released apps.
• Experience in cloud technologies and edge computing relevant to AI deployment.
• Familiarity with Databricks (Delta Lake, notebooks, clusters, jobs) for large-scale data processing.
• Familiarity with CI/CD pipelines and DevOps best practices.
• Familiarity with using Virtual Machine environments.

Professional Skills

• Excellent problem-solving skills and the ability to work independently and collaboratively.
• Strong communication and interpersonal skills, capable of explaining complex technical concepts to non-technical stakeholders.
• Capacity for problem solving.
• Comfortable with collaboration and open communication across distributed teams.

Working at ICF

ICF is a global advisory and technology services provider. They combine unmatched expertise with cutting-edge technology to help clients solve complex challenges. ICF is an equal opportunity employer committed to a thriving, inclusive workplace. They consider qualified applicants with arrest and conviction records and provide reasonable accommodations.

ICF Candidate AI Usage Policy

ICF is committed to a fair interview process. The use of artificial intelligence (AI) tools to generate or assist with responses during interviews is not permitted, except where accommodations are needed. Candidates requiring AI-related accommodations should contact candidateaccommodation@icf.com in advance.

Pay Range

The pay range for this full-time position is $131,256.00 - $223,134.00, with final pay determined by experience, skills, location, and contract provisions.

Key skills/competency

• Natural Language Processing (NLP)
• Machine Learning (ML)
• Large Language Models (LLMs)
• Prompt Engineering
• Python
• Azure
• TensorFlow
• PyTorch
• AI Alignment
• Data Analysis
• Deep Learning