AI Response Evaluator for Cyber Security Threat Intelligence

AI Response Evaluator for Cyber Security Threat Intelligence

We are seeking a highly skilled and motivated individual to join our team as an AI Response Evaluator with a focus on Cyber Security Threat Intelligence. This remote position is at the forefront of integrating Artificial Intelligence with Cyber Security to enhance threat intelligence and incident response capabilities. The successful candidate will be involved in evaluating AI-generated prompts using reinforcement learning with human feedback to grade and improve AI quality. This role is an exceptional opportunity to work at the cutting edge nexus of AI and Cyber Security, contributing to the development of smarter, more efficient systems capable of defending against the ever-evolving cyber threat landscape.

Responsibilities

• Evaluate AI-generated prompt responses for accuracy, relevance, and effectiveness in the context of Cyber Security Threat Intelligence.
• Use reinforcement learning with human feedback to grade AI prompt responses and guide the AI's learning process for improved performance.
• Collaborate with cybersecurity professionals and data scientists to refine AI models based on real-world cyber threat intelligence and incident data.
• Participate in the continuous improvement of AI training processes, including the selection of training data and feedback mechanisms.
• Stay abreast of the latest developments in cyber security threats, tactics, techniques, and procedures (TTPs) to ensure the AI's outputs are relevant and up-to-date.
• Provide insights and feedback on the AI's performance and potential areas for enhancement in detecting and responding to cyber threats.

Preferred Certifications

• SANS GCIH (GIAC Certified Incident Handler)
• SANS GCTI (GIAC Cyber Threat Intelligence)
• Other relevant certifications in information security incident handling, vulnerability management, and threat intelligence are highly desirable (e.g., CISSP, CEH, OSCP).

Required Experience

Candidates should have significant (multiple years) of experience in at least one of the following areas:

• Analyzing, triaging, and responding to cyber security incidents and investigations, particularly in response to recent vulnerabilities. This includes knowledge of threat actor group tactics, techniques, and procedures (TTPs) and how to detect and defend against them.
• Assessing Cyber Threat Intelligence and determining applicable risk for an organization via threat modeling. This involves understanding threat actor group TTPs and how to detect and defend against them.
• Identifying, managing, and remediating vulnerabilities, especially in response to well-known vulnerabilities exploited by threat actor groups.

Key skills/competency

• Cyber Security
• Threat Intelligence
• AI Evaluation
• Reinforcement Learning
• Human Feedback
• Incident Response
• Vulnerability Management
• TTPs Analysis
• Risk Assessment
• Data Science Collaboration