The understanding of radiation-induced non-cancer effects on the central nervous system (CNS) is essential for the medical setting (e.g., radiotherapy), and occupational exposures, such as nuclear workers or astronauts. Herein, the adverse outcome pathway (AOP) approach was used to consolidate relevant studies in the area of cognitive decline for identification of research gaps, countermeasure development, and for eventual use in risk assessments. AOPs are an analytical construct describing critical events to an adverse outcome (AO) in a simplified form beginning with a molecular initiating event (MIE). An AOP was constructed utilizing mechanistic information to build empirical support for the key event relationships (KERs) between the MIE of deposition of energy to the AO of learning and memory impairment through multiple key events (KEs). The evidence for the AOP was developed through a scoping review of the literature. In this AOP, the MIE is connected to the AO via six KEs of increased oxidative stress, increased deoxyribonucleic acid (DNA) strand breaks, altered signaling pathways, tissue resident cell activation, increased pro-inflammatory mediators and neural remodeling. Deposition of energy directly leads to oxidative stress, increased DNA strand breaks, an increase of pro-inflammatory mediators and tissue resident cell activation. These KEs, which are themselves interconnected, converge through increased DNA strand breaks, altered signaling pathways and pro-inflammatory routes and directly lead to neural remodeling. Broadly, it is envisioned that the outcome of these efforts could be applied to other cognitive disorders and support ongoing work by international authorities to review the system of radiological protection.