cellularflow is a small PyTorch language model which replaces the transformer FFN with addressable key-value memory banks for continual learning

github.com

cross-posted to:
artificial_intel@lemmy.ml

cellularflow is a small PyTorch language model which replaces the transformer FFN with addressable key-value memory banks for continual learning

github.com

cm0002@infosec.pub to

AI - Artificial intelligence@programming.devEnglish · 12 days ago

cross-posted to:
artificial_intel@lemmy.ml

GitHub - celcilin/cellularflow: Memory-Augmented Continual Learning LLM architecture decoupling knowledge storage from sequence reasoning to eliminate catastrophic forgetting.

github.com

Memory-Augmented Continual Learning LLM architecture decoupling knowledge storage from sequence reasoning to eliminate catastrophic forgetting. - celcilin/cellularflow

You must log in or # to comment.

Chat

AI - Artificial intelligence@programming.dev

Aii@programming.dev

Create a post

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !Aii@programming.dev

AI related news and articles.

Rules:

No Videos.
No self promotion: Don’t post links to your articles.

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

13 users / day
72 users / week
263 users / month
1.11K users / 6 months
1 local subscriber
368 subscribers
447 Posts
457 Comments
Modlog