Commit
·
52aab73
1
Parent(s):
5160645
Update README.md
Browse filesfix activation function
README.md
CHANGED
|
@@ -22,7 +22,9 @@ ANKH2-Large is based on the `ANKH-Large` model and was pretrained on a large cor
|
|
| 22 |
This means it was pretrained on the raw protein sequences only, with no humans labelling them in any way (which is why it can use lots of
|
| 23 |
publicly available data) with an automatic process to generate inputs and labels from those protein sequences.
|
| 24 |
|
| 25 |
-
|
|
|
|
|
|
|
| 26 |
|
| 27 |
It has been shown that the features extracted from this self-supervised model (LM-embeddings) captured important biophysical properties governing protein shape.
|
| 28 |
shape.
|
|
|
|
| 22 |
This means it was pretrained on the raw protein sequences only, with no humans labelling them in any way (which is why it can use lots of
|
| 23 |
publicly available data) with an automatic process to generate inputs and labels from those protein sequences.
|
| 24 |
|
| 25 |
+
Two important differences between this ANKH2-Large model and the original ANKH-Large version are:
|
| 26 |
+
1. The model was trained with more number of epochs.
|
| 27 |
+
2. The activation function changed to silu.
|
| 28 |
|
| 29 |
It has been shown that the features extracted from this self-supervised model (LM-embeddings) captured important biophysical properties governing protein shape.
|
| 30 |
shape.
|