Mitigating Proliferation Risks Posed by Artificial Intelligence Enabled Molecular Models and Leveraging Nonproliferation Opportunities

The U.S. Department of State’s Bureau of International Security and Nonproliferation, through the Office of the Nonproliferation and Disarmament Fund (ISN/NDF), has announced a funding opportunity to address proliferation risks associated with AI-enabled molecular modeling. With a total funding pool of $4 million, the program seeks proposals that develop safeguards and countermeasures to prevent the misuse of AI in chemical and biological contexts, specifically for weaponizable applications. Eligible entities include U.S.-based nonprofits, higher education institutions, for-profit organizations, and federal agencies. Proposals are due by November 12, 2024, and will be considered even more favorably if they incorporate cost-sharing, though it is not mandatory. The program is aimed at mitigating the risks that AI-enabled molecular models might be used to design chemical or biological weapons, given recent studies indicating AI’s dual-use potential. This funding opportunity supports research to assess the vulnerabilities of AI molecular models, secure data sets, and develop mitigation measures. Projects should generate concrete outcomes such as ethical guidelines, data security tools, international codes of conduct, and methodologies that ensure AI applications in chemistry and biology are safe from exploitation. ISN/NDF is particularly interested in proposals that foster international collaboration, enhance global awareness, and involve key stakeholders in academia, government, and industry. Proposals should target specific objectives, such as identifying foreign stakeholders in AI-enabled molecular modeling, conducting risk assessments on existing AI systems, developing and testing safeguards for sensitive data, and piloting methods to counter AI misuse at various stages of the AI model lifecycle. Additional objectives include creating resources to detect and counter illicit activities involving chemical and biological materials, as well as organizing international exercises and training programs. Proposals must demonstrate a sustainable approach, with anticipated follow-up activities and outcomes that reinforce long-term nonproliferation efforts. Applications must be submitted through the MyGrants platform and include five main components: a completed SF-424 form, a detailed project proposal, a budget, a budget narrative, and resumes for up to five key personnel. ISN/NDF will assess proposals based on factors including the alignment of proposed activities with nonproliferation goals, the applicant’s technical understanding of the proliferation risk posed by AI, organizational capacity, budget feasibility, and prior performance on similar projects. Awards may go to multiple applicants if meritorious, with individual funding levels below the total $4 million cap. The awarded cooperative agreements will involve substantial involvement from ISN/NDF, which will provide ongoing guidance, conduct quarterly reviews, and facilitate connections with relevant stakeholders. The recipient will need to submit a project work plan within 30 days of the award, aligning with project milestones and performance indicators. Quarterly progress and financial reports are required, detailing accomplishments, challenges, and financial updates. Recipients must also submit a final report within 120 days of the project’s completion, documenting overall outcomes and project impact. Awardees should be prepared for a project implementation meeting with ISN/NDF shortly after the award and will need to follow U.S. federal cost principles. ISN/NDF’s involvement may include ongoing advice, partner identification, and assistance with event planning and deliverables to ensure alignment with the U.S. Government’s nonproliferation objectives.