14 results found Sort:

stanfordnlp
pyvene stanfordnlp
69
671
apache-2.0
9
Stanford NLP Python Library for Understanding and Improving PyTorch Models via Interventions
intervention interpretability activation-patching activation-intervention mechanistic-interpretability
Created 2023-02-06
638 commits to main branch, last one 2 days ago
ruizheliUOA
Awesome-Interpretability-in-Large-Language-Models ruizheliUOA
19
298
cc0-1.0
5
This repository collects all relevant resources about interpretability in LLMs
sparse-autoencoder dictionary-learning mechanistic-interpretability interpretability-and-explainability
Created 2024-06-30
56 commits to main branch, last one about a month ago
MadryLab
modelcomponents MadryLab
7
128
mit
3
Decomposing and Editing Predictions by Modeling Model Computation
pytorch attribution model-editing interpretability mechanistic-interpretability
Created 2024-04-17
12 commits to main branch, last one 6 months ago
pauljblazek
deepdistilling pauljblazek
7
82
other
4
Mechanistically interpretable neurosymbolic AI (Nature Comput Sci 2024): losslessly compressing NNs to computer code and discovering new algorithms which generalize out-of-distribution and outperform ...
distilling interpretable neurosymbolic explainable-ai domain-adaptation program-synthesis model-distillation knowledge-distillation inductive-logic-programming mechanistic-interpretability out-of-distribution-generalization
Created 2024-01-13
5 commits to main branch, last one 10 months ago
jbloomAus
DecisionTransformerInterpretability jbloomAus
18
77
mit
4
Interpreting how transformers simulate agents performing RL tasks
reinforcement-learning mechanistic-interpretability
Created 2022-12-17
725 commits to main branch, last one about a year ago
OpenMOSS
Language-Model-SAEs OpenMOSS
8
73
unknown
4
For OpenMOSS Mechanistic Interpretability Team's Sparse Autoencoder (SAE) research.
interpretability sparse-dictionary sparse-autoencoders mechanistic-interpretability
Created 2024-03-19
410 commits to main branch, last one 5 days ago
steering-vectors
steering-vectors steering-vectors
6
72
mit
2
Steering vectors for transformer language models in Pytorch / Huggingface
ai gpt nlp pytorch huggingface representation-engineering mechanistic-interpretability
Created 2024-01-18
65 commits to main branch, last one about a month ago
apartresearch
interpretability-starter apartresearch
1
64
unknown
0
🧠 Starter templates for doing interpretability research
alignment-jam interpretability interpretability-jam mechanistic-interpretability
Created 2022-10-31
17 commits to main branch, last one about a year ago
epfl-dlab
llm-latent-language epfl-dlab
11
62
unknown
3
Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".
llm llama2 multilingual-nlp mechanistic-interpretability
Created 2024-02-16
24 commits to main branch, last one 9 months ago
taufeeque9
codebook-features taufeeque9
3
57
mit
3
Sparse and discrete interpretability tool for neural networks
codebook features transformers language-model interpretability mechanistic-interpretability
Created 2022-12-13
20 commits to main branch, last one 10 months ago
wesg52
sparse-probing-paper wesg52
10
52
mit
2
Sparse probing paper full code.
ai-safety ai-alignment interpretability mechanistic-interpretability
Created 2023-05-02
5 commits to main branch, last one about a year ago
microsoft
automated-explanations microsoft
6
46
mit
7
Generating and validating natural-language explanations.
gpt xai fmri gpt4 explanation huggingface data-science neuroscience language-model interpretability machine-learning fmri-data-analysis large-language-models artificial-intelligence automated-interpretability mechanistic-interpretability
Created 2023-01-30
385 commits to main branch, last one 8 days ago
aryamanarora
causalgym aryamanarora
4
34
unknown
1
CausalGym: Benchmarking causal interpretability methods on linguistic tasks
benchmark causality syntaxgym interpretability mechanistic-interpretability
Created 2023-10-10
309 commits to main branch, last one about a month ago
wesg52
universal-neurons wesg52
6
27
mit
3
Universal Neurons in GPT2 Language Models
llm ai-safety interpretability mechanistic-interpretability
Created 2023-12-26
5 commits to main branch, last one 7 months ago