Stronger Together Banner

NGB Banner with White Knockout Text & Divider

In crisis? Seeking support is a sign of strength.
24/7 support is available:


988 Suicide & Crisis Lifeline: Call 988 or click here for live chat.

Veterans Crisis Line: Call 988 and press 1; text 838255; or click here for live chat.


NGB Warrior Resilience and Fitness (WRF) Division facilitates the Joint Suicide Prevention Program. The program
enhances suicide prevention-related policies and training, advances data collection and analysis, expands access to
community resources, and conducts strategic communication outreach aimed at reducing suicidal behavior across the
Army and Air National Guard. To learn more about WRF resources, click here.

Time and Distance logo Signs of distress graphic

 

What is Go SLO?

Go SLO stands for Safes, Locks, or Outside the home.

  • Safes: Store firearms in a gun safe or locked cabinet.
  • Locks: Use trigger locks or cable locks.
  • Outside the home: Temporarily store firearms with a trusted person or at a recommended installation.

Go SLO helps create time and distance between distress and lethal means.

Choose GO SLO: take small steps now to save lives later.

Common Misconceptions


DoD/VA RESOURCES

  • Menu Item


NATIONAL PROGRAMS


GOVERNANCE

NON-CRISIS COUNSELING AND SUPPORT

Video by Kenneth M McNulty, Kevin D Schmidt
Download
Michael Robinson - Topological Features in Large Language Models (and beyond?)
Air Force Research Laboratory
Oct. 11, 2024 | 01:00:53
In this edition of QuEST, Michael Robinson will discuss topological features in large language models

Key Moments and Questions in the video include:
Acknowledgement of colleagues from DARPA and Galois
Manifolds in machine learning
LLM token space is higher dimensional
Manifold spaces tend to be negatively curved
LLM turn text into vectors
Transformers turn vectors into new text
How do we turn the text into vectors?
We think of LLM as being trained on all human language, but they have not
GPT2 Open source LLM as the source for model
ChatGPT2 used as the example
Tokens have topology and geometry
Words are a categorical variable
Vectors are a numerical variable
Mixing data types can lead to some problems
Why care about the token space?
Not all tokens correspond to a valid vector
Estimating dimensions
Volume of a sphere
Log of Volume vs log of radius curves
Ricci scalar curvature
Stratifications are visible
GPT2 uses a state space that is not a manifold
Dollar sign shown different in GPT2 because the $ is used in code where other currency symbols are not
GPT2’s 768 dimensions unwrapped using tSNE
Tokens with leading spaces
Beginnings of words show up in separate piece of low dimension
Visual similarity to hyperbolic plane
LLEMMA7B dimensions
Plotting dimension
Dark space are non-printing characters
Thinking about how neural activation patterns work
We have been thinking about manifold learning out of mathematical convenience
State spaces are not manifolds
Open presentation to conversation
More
 
 
Contact us logoAir Force Suicide logoMilitary Crisis Line logo


LTC Elizabeth Cordon

LTC Elizabeth Cordon,
WRF Resiliency Branch Chief

MAJ Giovanni Siaca

MAJ Giovanni Siaca,
Joint Suicide Prevention
Program Manager

CPT Shannon Bush-Smith

CPT Shannon Bush-Smith,
Army National Guard Suicide Prevention Program Coordinator

Capt. Ashley Hollingsworth

Capt. Ashley Hollingsworth,
Air National Guard Suicide Prevention Program Coordinator