Matan Tsipory

7 posts

Matan Tsipory

Matan Tsipory

@tsipory

Katılım Mayıs 2020
26 Takip Edilen6 Takipçiler
Matan Tsipory
Matan Tsipory@tsipory·
@itayevron @ranlevinstein [5/6] However, these failure modes disappear when we allow task repetition or use greedy-then-random orderings. In conclusion, we now understand that dissimilarity-guided orderings typically converge faster, and that a bit of randomness can prevent pathological failures.
Matan Tsipory tweet media
English
1
0
5
105
Matan Tsipory
Matan Tsipory@tsipory·
[1/6] Tomorrow (Thursday) at #NeurIPS: Are Greedy Task Orderings Better Than Random in Continual Linear Regression? Q: Do models learn better when consecutive tasks are similar or dissimilar? A: Our analysis suggests that they should be dissimilar! openreview.net/forum?id=8JdPq…
Matan Tsipory tweet media
English
1
2
7
821
Matan Tsipory retweetledi
Itay Evron
Itay Evron@itayevron·
[1/5] Next week at #NeurIPS *Optimal Rates in Continual Linear Regression via Increasing Regularization* In the brain, ageing naturally reduces synaptic plasticity. Our theory suggests continual learning models may benefit from a similar mechanism! openreview.net/forum?id=lDh78…
Itay Evron tweet media
English
2
11
115
5K