GitHub - weinatalie/icl-architecture: Investigating architectural requirements for in-context learning across different sequence models.

Repository navigation

icl-architecture

Public

Investigating architectural requirements for in-context learning across different sequence models.

0 stars

0 watching

Name		Name	Last commit message	Last commit date
.ipynb_checkpoints		.ipynb_checkpoints
.gitignore		.gitignore
amazon_review.csv		amazon_review.csv
amazon_reviews.model		amazon_reviews.model
amazon_reviews.txt		amazon_reviews.txt
amazon_reviews.vocab		amazon_reviews.vocab
data_parse.py		data_parse.py
processed_noisy_fibonacci_letters_1M.csv		processed_noisy_fibonacci_letters_1M.csv
processed_noisy_fibonacci_mixed_5to8_1M_seed_-100_100.csv		processed_noisy_fibonacci_mixed_5to8_1M_seed_-100_100.csv
rnn_gpu.py		rnn_gpu.py
rnn_lm.ipynb		rnn_lm.ipynb
rnn_lm.py		rnn_lm.py
rnn_lm_2.ipynb		rnn_lm_2.ipynb
rnn_reg_gpu.py		rnn_reg_gpu.py
transformer.ipynb		transformer.ipynb
transformer_gpu.py		transformer_gpu.py
transformer_lm-Copy1.ipynb		transformer_lm-Copy1.ipynb
transformer_lm.ipynb		transformer_lm.ipynb
transformer_lm_cipher.ipynb		transformer_lm_cipher.ipynb
typo_lstm_weights.pth		typo_lstm_weights.pth
typo_mamba_weights.pth		typo_mamba_weights.pth
typo_transformer_weights.pth		typo_transformer_weights.pth

Investigating architectural requirements for in-context learning across different sequence models.

0 stars

0 watching