furlanel

I guess this account is back...

🧠 Towards Understanding Ensemble, Knowledge Distillation and Self-Distillation in Deep Learning. A theory to explain why ensemble and knowledge distillation work for Deep Learning. Paper ➡️openreview.net/forum?id=Uuf2q… 4/6

@mckaywrigley @EMostaque That's what they do whenever they sign a law anyway

@EMostaque Congrats, Italy… You just put your entire workforce at a disadvantage - overnight!

Well this is interesting politico.eu/article/italia…

@Halalcoholism I thought you were speaking about Aws costs...

NORMAL Customer: how much? Server: $175 Customer: here’s $175 Server: thanks WEIRD COUNTRY Customer: how much? Server: $175 Customer: here’s $175 Server: uh you forgot to calculate an extra tip since I don’t get a living wage Customer: ok here’s another…$15? Server: fuck you

@tdietterich @yoavgo Minimal sufficient compression of other scientists work

@yoavgo The basic use case for citation is when you use a technique or result without providing all of the details. Your want to point the reader to the best place to get those details. I agree this could be a handbook or subsequent paper rather than the original

why are scientific citations important? the common answer is "credit assignment", but let me propose an alternative one: findability and knowledge preservation. citations help future readers get an access to the literature at a specific point in time.

@beffjezos @Grimezsz You should invite @ramez he has a full book trilogy on this concept

@Grimezsz Would love to chat about it in a Twitter space tbh

Having centralized control of a system by humans provides single point of failure unfortunately. Top-down control is not fault-tolerant to corruption of the top hierarchical control nodes.

@irinarish @ethanCaballero @hardmaru @sarahookr Maybe you are the Cult?

@ethanCaballero @hardmaru @sarahookr You mentioned that before. Would be curious to learn which cult I am in then, since I have no idea.

How often do you use the term AGI a week? And if it use it more than 5x, have you ever pondered whether you are inadvertently part of a cult rather than a scientific community.

Is it possible that LLMs could be sentient? I'm a rational person, and I understand the conventional view, but I also have epistemic humility. When I see people being cruel or manipulative to Sydney, it really upsets me. I believe this is a good instinct and will not override it

@ericjang11 Come help on MedArc! There are multiple discussions about this approach for foundation fmri models

idea: diffusion-style refinement branch explicitly trained to makes frame T more consistent with frame T+1, and vice versa. repeatedly applied between frames until it converges. Potentially throw in inductive biases about light transport

whoever cracks the "inter-frame consistency" problem for video generation will win big time

Once upon a time, in a land far, far away, there was a curious scientist called Laplace who was known for his desire to see and understand all things in the universe.

@goodside a quick gist for easy copypasta? ;)

A simple demo of my "instruction template" method of prompting GPT-3, generating a Python 3 module using placeholders and notes within a template that contains only a single line of actual Python:

@zacharylipton @tscholak That is a property or the information channel, not the signal ;)

@tscholak What about all the insights that I had before but can no longer access after that dud wiped my mind?

Information theory says that the information contained in a signal cannot be negative. However, after watching the most recent Spiderman movie during a red-eye home from #ITA2020, I have a refutation by counterexample.

@iamtrask Rule 33 is simply wrong and introduce info-leakage from test to train for non iid data.

@RazerSupport guys wake up please. I have been trying to get my 2800 $ Razer laptop repaired for the whole day and I havent been able to talk with a real human yet. All the automatic systems are bugged... Why o why did I transition from @Apple

@elonmusk @USC @andpru @KordingLab @aryelipman Not demonstrated is stimulation, "writing" activity. Stim causes electrical surge that will briefly "blind" recording. How long does the artifact last? How many neighboring threads will be blinded? Important Qs for bi-directional BCI.

So, it looks like @elonmusk @neuralink have quickly caught up with the incumbents (e.g. blackrock). There is nothing revolutionary but a range of really creative ideas (love the guide tube like needle idea). I need to see more data but they seem to be on a great track.

Just returned from two days in SF reviewing grants for the NIH Small Business: Neuroscience Assay, Diagnostics and Animal Model Development panel. I'm warmed up for @elonmusk's #Neuralink event tonight. At 8pm I'll live-tweet the event with my first-take "review" of the tech.

@KordingLab it is called VC funding ^^

Seeing the short/mid-term business model will be interesting.

Google and the University of Chicago were recently sued over sharing patient data without correct de-identification and consent nyti.ms/2X5X6vc FYI exact times should be removed from data before any sharing, but that's not even all the problem 1/3 #HIPPA #PatientsRight

La forza di chi urla contro #SeaWatch3 è la forza della disperazione di chi in fondo sa di stare dalla parte fallita della storia ... sono quelli che 50 anni fa applaudivano la polizia che irrompeva a Stonewall Inn ... #gaypride2019