Skip to main content
U.S. flag
 

COMPUTER SCIENTIST (AI TEST AND EVALUATION)

Department of Defense
Defense Threat Reduction Agency
Command, Control, Communications, and Computers (C4) Systems (J6)

Summary

This position may be filled using Direct Hire Authority: Z5CAV/Direct-Hire Authority (Certain DoD Personnel) PL 118-31, Sec 125OB (i)(2), 12/22/2023.This position is being filled under the memorandum from the Under Secretary of Defense for Personnel and Readiness (USD(P&R)) "Expansion of Direct Hire Authority for Certain Personnel of the Department of Defense," dated August 12,2024.

This position is part of the Defense Threat Reduction Agency,

Overview

Help
Accepting applications
Location
1 vacancy in the following location:
Work site options
Telework eligible
Yes—In-person position at Fort Belvoir, VA. This position may be eligible for limited, situational telework subject to supervisory approval and not to exceed current Agency guidelines. This position is not eligible for remote telework.
Remote job
No
Relocation expenses reimbursed
No
Salary
$121,785 - $158,322 per year
Pay scale & grade
GS 13
Promotion potential
13
Pay scale and grade determines the salary of the job.
Work schedule
Full-time
Travel Required
Occasional travel - You may be expected to travel for this position.
Appointment type
Permanent
Occupations and job series
Supervisory status
No
Federal service type
This job is in the Competitive Service
Represented by a union
No
Drug test
Yes
Security clearance
Sensitive Compartmented Information
Position sensitivity and risk
Special-Sensitive (SS)/High Risk
Jobs require a background check and some require a security clearance. The type depends on the job.
Background check type
Financial disclosure required
No
Some jobs require financial disclosure to identify conflicts of interests.
Announcement number
DTRA-26-13020331-DH
Control number
878826000

This job is open to

Help

Clarification from the agency

This announcement is open to All U.S. Citizens, and is being filled under the Direct Hire Authority (DHA) for Certain Personnel of the Department of Defense. Appointment of Military Spouses (5 CFR 315.612)(NonComp Mil Sp), and NonComp Civilian Sp, PPP DoD Retained Grade Preference, PPP DoD Military Reserve (MR) and National Guard (NG) Technician Eligible and PPP DoD MR and NG Preference Eligible Tech Receiving Disability Retirement may also apply.

Duties

Help

As a COMPUTER SCIENTIST (AI TEST AND EVALUATION) at the GS-1550-13 some of your typical work assignments may include:

  • Plans and executes comprehensive test and evaluation (T&E) of AI/ML systems by developing test plans, defining quantitative and qualitative metrics (e.g., sensitivity, specificity, confidence levels, generalizability), conducting hypothesis testing, and performing verification and validation activities to ensure AI solutions meet performance specifications and requirements.
  • Tests AI/ML systems for security, robustness, trustworthiness, and reliability by conducting adversarial testing in operationally realistic environments, performing risk assessments, evaluating functionality and compatibility across diverse scenarios, and building assurance cases that demonstrate the level of confidence in AI system capabilities.
  • Develops and executes code-level testing and validation procedures for machine learning models, including automating testing processes, evaluating user experience and human-computer interaction factors, and recording and managing all test data with accuracy and integrity throughout the testing life-cycle.
  • Prepares detailed T&E reports and communicates findings, risks, and recommendations to technical and non-technical audiences, including senior leadership, by translating complex test data and evaluative conclusions into clear, actionable courses of action that inform decision-making across the organization.
  • Assesses AI systems for bias, security vulnerabilities, and high-impact risks by reviewing AI architectures, analyzing training data sets and system outputs for unintended bias, identifying failure modes and low-probability risks, and developing risk management plans and corrective actions to ensure ethical and trustworthy AI deployment.
  • Collaborates with cross-functional teams - including developers, data scientists, cybersecurity professionals, and operational users- to integrate AI T&E frameworks into project test strategies and ensure seamless coordination across DataOps, MLOps, and DevSecOps pipelines, including AI deployment within cloud and IT infrastructure environments.
  • Represents the organization in working groups, interagency forums, and professional eventsrelated to AI T&E and responsible AI, while monitoring evolving test and safety standards (e.g., MIL-STD 882E, DO-178C, ISO 26262) to ensure AI evaluation activities remain current, rigorous, and aligned with mission requirements and AI ethical principles.

Requirements

Help

Conditions of employment

  • Must be a U.S. Citizen
  • Occasional Travel: Travel in the performance of temporary assignments may be required up to 20% CONUS/OCONUS.
  • Work Schedule: Full-time
  • Males born after 12-31-59 must be registered for Selective Service
  • Suitable for Federal employment, determined by a background investigation
  • May be required to successfully complete a probationary period
  • Overtime/Compensatory time may be required to accommodate operational needs of the organization
  • Tour of Duty: Flexible
  • Recruitment Incentives: May be authorized based on funding availability
  • Fair Labor Standards Act (FLSA): Exempt
  • Financial Disclosure: Not Required
  • Telework Eligibility: This position is in-person located at Fort Belvoir, VA. and may be eligible for limited, situational telework subject to supervisory approval and not to exceed current Agency guidelines.
  • Must be able to obtain and maintain a TOP SECRET/SCI security clearance.
  • Subject to pre-employment drug testing and periodic drug testing thereafter.
  • The employee must be willing to comply with each Combatant Command (COCOM) travel medical requirement to include vaccinations.
  • Valid Passport required.
  • Upon entering this position, you must maintain 8140 compliance by qualifying foundationally within 9 months, and residentially within 12 months, as referenced in DoDM 8140.03.

Qualifications

You may qualify at the GS 13 , if you fulfill the following qualifications:

A. One year of specialized experience equivalent to the 12 grade level in the Federal service as listed below:

  • Planning and executing test and evaluation (T&E) of artificial intelligence and machine learning (AI/ML) systems, including developing test plans, defining performance metrics, and conducting verification and validation activities to assess whether AI/ML models and applications meet defined requirements and performance standards.
  • Assessing AI/ML systems for risks related to security, robustness, bias, and trustworthiness and recommending risk mitigation strategies to ensure reliable system performance.
  • Writing and maintaining code in programming languages commonly used in AI/ML development.
  • Preparing technical reports and communicating complex AI/ML test findings, risks, and recommendations to both technical and non-technical stakeholders, including translating test data and evaluative conclusions into actionable recommendations for leadership and cross-functional teams.

Experience refers to paid and unpaid experience, including volunteer work done through National Service programs (e.g., Peace Corps, AmeriCorps) and other organizations (e.g., professional; philanthropic; religious; spiritual; community, student, social). Volunteer work helps build critical competencies, knowledge, and skills and can provide valuable training and experience that translates directly to paid employment. You will receive credit for all qualifying experience, including volunteer experience.


In addition to meeting qualifications, your application package must reflect the applicable experience to meet the Individual Occupational Requirements for the 1550, series as listed below:

Bachelor's degree in computer science or bachelor's degree with 30 semester hours in a combination of mathematics, statistics, and computer science. At least 15 of the 30 semester hours must have included any combination of statistics and mathematics that included differential and integral calculus. All academic degrees and course work must be from accredited or pre-accredited institutions. Applicants should have sufficient knowledge to understand the fundamental concepts and techniques of computer science. Courses designed to provide an introduction to computer science techniques and methodologies, to problems of system design, and to other specialized fields are acceptable. Courses or experience in teaching elementary, business, or shop mathematics are not acceptable.
https://www.opm.gov/policy-data-oversight/classification-qualifications/general-schedule-qualification-standards/1500/computer-science-series-1550/

Education

You MUST provide transcripts or other documentation to support your educational claims.

All materials must be submitted by the closing date of the announcement.

GRADUATE EDUCATION: One academic year of graduate education is considered to be the number of credits hours that your graduate school has determined to represent one academic year of full-time study. Such study may have been performed on a full-time or part-time basis. If you cannot obtain your graduate school's definition of one year of graduate study, 18 semester hours (or 27 quarter hours) should be considered as satisfying the requirement for one year of full-time graduate study.

FOREIGN EDUCATION: If you are using education completed in foreign colleges or universities to meet the qualification requirements, you must show that the education credentials have been evaluated by a private organization that specializes in interpretation of foreign education programs and such education has been deemed equivalent to that gained in an accredited U.S. education program; or full credit has been given for the courses at a U.S. accredited college or university. For further information, visit: https://www2.ed.gov/about/offices/list/ous/international/usnei/us/edlite-visitus-forrecog.html

Additional information

Other Notes:

Noncompetitive Appointment Authorities
: For more information on noncompetitive appointment authority eligibility requirements: Special Hiring Authority for Certain Military Spouses

RE-EMPLOYED ANNUITANT: This position DOES NOT meet criteria for re-employed annuitant. The DoD criteria for hiring Re-employed Annuitants can be found at: https://www.esd.whs.mil/Portals/54/Documents/DD/issuances/140025/140025_vol300.PDF?ver=LQ7feWw-8-5DI2tceUpmgA%3d%3d

All applicants must meet qualifications and eligibility criteria by the closing date of the announcement.

This position is subject to an initial drug screening, and random testing thereafter. A negative drug test result must be received by HR within 30 calendar days after the EOD (i.e., start date). The selectee's inability successfully pass; or refusal to conduct the test may result in: 1) the tentative or FJO being withdrawn during the recruitment process; or 2) subsequently being removed from Federal service for failure to meet a condition of employment.

You may be required to sign a "Drug Test Statement of Understanding" if you are selected for this position.

Males born after 12-31-59 must be registered or exempt from Selective Service (see Who Needs to Register | Selective Service System : Selective Service System (sss.gov))

Candidates should be committed to improving the efficiency of the Federal government, passionate about the ideals of our American republic, and committed to upholding the rule of law and the United States Constitution.

How you will be evaluated

You will be evaluated for this job based on how well you meet the qualifications above.

We will review your resume and supporting documents, to ensure you meet the basic qualification requirements. We will evaluate each applicant who meets the basic qualifications on the information provided and evaluate your relevant work experiences as it relates to fundamental competencies, identified below, required for this position.

Traditional rating and ranking of applications does not apply to this vacancy. Your application (resume and supporting documentation) will be evaluated to determine if you meet the minimum qualifications required as listed on the announcement under qualification requirements.

Veterans Preference: If you are entitled to veterans preference, you should indicate the type of veterans' preference you are claiming on your resume. Your veterans' preference entitlement will be verified by the employing agency.

For information on entitlement see http://www.fedshirevets.gov/job/vetpref/index.aspx

Appointment of Military Spouses (5 CFR 315.612) (NonComp Mil Sp): To receive this preference, you must choose to apply using the " Appointment of Military Spouses (5 CFR 315.612) (NonComp Mil Sp)" eligibility. If you are claiming Military Spouse eligibility and are determined to be Well Qualified (score of 85 or above) for the position, you will be referred to the hiring manager. Information and required documentation for claiming Military Spouse eligibility may be found at the General Applicant Information and Definitions link below.

Priority Placement Program (PPP) DoD Retained Grade Preference (RGP): In order to receive this preference, you must choose to apply using the "Priority Placement Program, DoD Retained Grade Preference (RGP)" eligibility. If you are claiming RGP and are determined to be Well Qualified for the position, you will be referred to the hiring manager as a priority applicant. Information and required documentation for claiming MSP may be found at the General Applicant Information and Definitions link below. To be eligible as a RGP, you must submit the following supporting documents with your application package: a signed Retained Grade PPP Self-Certification Checklist (DD3145-1 (whs.mil)); a copy of your Notification of Personnel Action (SF-50) effecting the placement in retained grade status; or a copy of the notification letter you received regarding the RIF or classification downgrade.

DoD Military Reserve (MR) and National Guard (NG) Technician (PPP DoD MRNG):
In order to receive this preference, you must choose the Military Reserve and National Guard Technician eligibility, and fill out and submit the Military Reserve and National Guard Technician PPP Self-Certification Checklist and copies of the appropriate documentation.

DoD Military Reserve (MR) and National Guard (NG) Technician Preference Eligible Technician Receiving Disability Retirement:
In order to receive this preference, you must choose the Military Reserve and National Guard Technician Receiving Disability Retirement eligibility, and fill out and submit the Military Reserve and National Guard Technician Disability PPP Self-Certification Checklist and copies of the appropriate documentation.

Defense Threat Reduction Agency

The Defense Threat Reduction Agency provides cross-cutting solutions to enable the DoD, the United States Government, and international partners to DETER strategic attack against the United States and it's allies; PREVENT, reduce, and counter Weapons of Mass Destruction (WMD) and emerging threats; and PREVAIL against WMD-armed adversaries in crisis and conflict.

Agency contact information

DTRA Servicing Team
Phone
614-693-0259
Fax
(215) 516-6068
Email
DHRC-DDTRAHR@dla.mil
Address
Defense Threat Reduction Agency
8725 JOHN J KINGMAN ROAD
MSC 6201
FT BELVOIR, VA 22060-6201
US

Visit our careers page

Learn more about what it's like to work at Defense Threat Reduction Agency, what the agency does, and about the types of careers this agency offers.

http://www.dtra.mil

Your session is about to expire!

Your USAJOBS session will expire due to inactivity in 8 minutes. Any unsaved data will be lost if you allow the session to expire. Click the button below to continue your session.