Wouter Kool

23 posts

Wouter Kool

Wouter Kool

@wouter_kool

PhD in Machine Learning & Optimization from University of Amsterdam

Amsterdam Entrou em Mart 2018
270 Seguindo286 Seguidores
Andreas Kirsch 🇺🇦
Andreas Kirsch 🇺🇦@BlackHC·
Reading up on Gumbel-Softmax distribution (yet again): It's "just" Gumbel-noising the softmax: with a Gumbel sample G ~ Gumbel(0,1) for each class, which can be drawn using a transformation of a uniform sample U ~ U[0,1]: g = -ln(-ln(u)), [or as the -ln of a sample of an exponential variable because e ~ Exp(1) can be written as e = -ln(u)]. If pi_i is itself a softmax distribution of logits l_i, we have: (We can ignore the partition constant of pi because Softmax is invariant to constant shifts.) That is, we can just add Gumbel noise to the logits and temper them. The biggest question maybe is: how important is it to use a Gumbel noise? For example, could we also add Gaussian noise to the logits? I don't think so: The Gumbel-Softmax uses the Gumbel-Max trick to relax the argmax. As \tau -> 0, we approach the argmax which together with the Gumbel noise allows us to sample from \pi_i. A different noise distribution likely wouldn't induce the same distribution (I guess?). Papers: - "Categorical Reparameterization with Gumbel-Softmax" - "The Concrete Distribution: A Continuous Relaxation of Discrete Random Variables" #PaperSummary
Andreas Kirsch 🇺🇦 tweet mediaAndreas Kirsch 🇺🇦 tweet mediaAndreas Kirsch 🇺🇦 tweet media
English
6
13
87
8.7K
Wouter Kool
Wouter Kool@wouter_kool·
In (less than) one week from now (Nov 23, 11:00), I will publicly defend my PhD thesis 'Learning and Optimization in Combinatorial Spaces' at the UvA Aula in Amsterdam! hdl.handle.net/11245.1/b8d128…
English
4
7
52
0
Wouter Kool
Wouter Kool@wouter_kool·
After that, I'll be (hopefully) celebrating at NeurIPS so let me know if you're there and want to catch up!
English
3
0
2
0
Wouter Kool retweetou
EURO-NeurIPS-VRP-2022
EURO-NeurIPS-VRP-2022@EuroNeuripsVRP·
Aaaand it's done! The qualification phase has ended! More than 800 submission were done resulting in almost 50 teams on the leaderboard! Congratulations to the top 10 teams qualifying for the FINALS with their impressive results! :)
EURO-NeurIPS-VRP-2022 tweet media
English
1
5
15
0
Wouter Kool retweetou
EURO-NeurIPS-VRP-2022
EURO-NeurIPS-VRP-2022@EuroNeuripsVRP·
Update: 100 teams have registered! 🎉
English
0
1
2
0
Wouter Kool retweetou
EURO-NeurIPS-VRP-2022
EURO-NeurIPS-VRP-2022@EuroNeuripsVRP·
The competition is going well with 99 teams (!!) registered, 25 already submitted to the leaderboard and over 140 people in the Slack! Thanks all! Who will be participant #100? 🙌 Registration will close September 30th! #leaderboard" target="_blank" rel="nofollow noopener">…neurips-vrp-2022.challenges.ortec.com/#leaderboard
English
2
2
10
0
Wouter Kool retweetou
EURO-NeurIPS-VRP-2022
EURO-NeurIPS-VRP-2022@EuroNeuripsVRP·
With more than 50 teams registered, 100 participants on Slack, the code submission platform is now available! Check the instructions on #submitting-your-solver" target="_blank" rel="nofollow noopener">github.com/ortec/euro-neu… and secure your place on the public #leaderboard" target="_blank" rel="nofollow noopener">…neurips-vrp-2022.challenges.ortec.com/#leaderboard
English
1
9
22
0
Wouter Kool retweetou
EURO-NeurIPS-VRP-2022
EURO-NeurIPS-VRP-2022@EuroNeuripsVRP·
Thank you all for your active involvement! Almost 50 teams registered! One week from now (August 1st) the code submission platform will open! Please keep an eye on Twitter, Slack and GitHub to stay updated! …neurips-vrp-2022.challenges.ortec.com
English
0
1
1
0
Wouter Kool retweetou
Thibaut Vidal
Thibaut Vidal@vidalthi·
Finally, thanks to @wouter_kool for the most hilarious description of HGS that I have ever seen. I wished I had thought of such a great presentation before! The videos of the workshop should be online at this point, so I'm looking forward to watching it again 😅!
Thibaut Vidal tweet media
English
1
4
16
0
Wouter Kool retweetou
Iris Huijben
Iris Huijben@IamHuijben·
I'm proud to announce that our review paper on the Gumbel-max trick and its extensions for machine learning has been accepted as a survey paper in IEEE TPAMI.🥳 The work covers sampling algorithms, gradient estimators, links to Poisson processes, and fields of applications.
English
7
12
177
0
Wouter Kool
Wouter Kool@wouter_kool·
Proud to share that with a team of @ORTEC colleagues we scored 1st place in Phase 1 of the DIMACS challenge for the Vehicle Routing Problem with Time Windows (VRPTW)! @DIMACSChallenge
DIMACS VRP Challenge@DIMACSChallenge

More results rolled in: @ed_uchoa announced that seven teams are invited to participate in Phase 2 testing for VRPTW! Lots of new BKS values! Congratulations to all. Full results: dimacs.rutgers.edu/programs/chall… @ClaudiaArchett1 @je_mendozag @vidalthi @KullmanNick

English
0
1
9
0
Wouter Kool
Wouter Kool@wouter_kool·
@hen_str @srush_nlp Thanks! I was thinking about the same! I thought I could show likes, color the dots according to the predicted 👍-lihood and when selecting a region in the plot use this to filter the papers view as well.
English
0
0
0
0