Ben London retweetledi
Ben London
187 posts

Ben London
@BenjoLondon
Machine learning researcher; scientist at Amazon Music. Don’t tweet much. https://t.co/HFgx4qsjVI
Seattle, WA Katılım Eylül 2012
255 Takip Edilen201 Takipçiler
Ben London retweetledi
Ben London retweetledi

Offline RecSys evaluation is notoriously hard to get right. Unobserved confounders are often overlooked, but make it even harder.
Check out the teaser for my @CONSEQUENCES_ws talk at #RecSys2023 w/ @BenjoLondon!
@ACMRecSys @sharechatapp @AmazonScience
youtu.be/kbxhZE6Gwto?si…

YouTube
English

@haldaume3 Similar thoughts re: LLMs for recommendation. For instance, they can generate reasonable looking playlists based on a generic theme (eg “alt rock”)—which is incredible!—but may struggle with niche queries, and the playlists are usually kind of boring.
English
Ben London retweetledi

@DimitrisPapail Would an example f be SGD? Like, you’re trying to learn the SGD update?
English

@roydanroy @DimitrisPapail Or Rademacher complexity. With that, if each f_t is Lipschitz, you can recursively apply the contraction lemma, for which there’s a vector-valued version. But all the Lipschitz coeffs would multiply, so you’d hope they’re <1 so you don’t get O(C^T).
English

@DimitrisPapail There are algebraic ways of bounding VC dimension (good for binary valued functions) for compositional classes. I suspect the same is true for functions take multiple values.
English

Fri, 9/23 @ 12:05 PDT: @AlexanderBuchh3 will present our work on a new estimator for offline evaluation of ranking policies.
amazon.science/publications/o…
English

Presenting 2 papers on new work at CONSEQUENCES+REVEAL Workshop @ RecSys ‘22
sites.google.com/view/consequen…
Details 👇
English











