Omich

28 posts

Omich banner
Omich

Omich

@kitty_fromhell

I want to become a full-fledged indie developer ;_; Itch: https://t.co/ScgX3twzWi My assistant: @TtllyNrmlGeorge

Joined Ağustos 2015
11 Following25 Followers
Omich
Omich@kitty_fromhell·
@bhutanisanyam1 and Orca paper tells us that we need to put in train dataset more information of every aspect of reflection, which really makes the model more meaningful. This approach to training, combined with tree of thoughts, can boost GPT-4 power by a lot.
English
0
0
0
39
Omich
Omich@kitty_fromhell·
@bhutanisanyam1 I wonder what if we train big models like GPT-4 on dataset about how people try to solve problems using a tree of thoughts? I mean "tree of thoughts" is the best current approach for LLMs
English
1
0
0
355
Sanyam Bhutani
Sanyam Bhutani@bhutanisanyam1·
Progressive Learning to outperform ChatGPT! 🚀 Orca, new 13B model trained using Progressive Learning is extremely performant on a lot of benchmarks and gives a strong challenge to ChatGPT. Here are my notes: - The authors use the Flan Dataset to generate 5M responses from ChatGPT and GPT-3.5 - Progressive Learning: The model is first trained on GPT-3.5 responses and then fine-tuned on GPT-4 dataset - System prompts: Most papers to my knowledge have ignored system prompts - Orca paper utilities 16 different prompts to control the variations of responses, which is another secret sauce Following all of this, we end up with a model as performant as GPT-3.5 on many benchmarks. There’s one interesting insight: System Prompts, although are helpful with training, are not impactful during inference. Im curious if this is due to lack of clever prompting? It’s cool to witness more fine tuning techniques for models. I’ve summarised the paper above but I’d suggest checking out the benchmarks: arxiv.org/abs/2306.02707
Sanyam Bhutani tweet media
English
10
15
131
30.7K
Omich
Omich@kitty_fromhell·
@EssebSaccad Хорошо, в следующий раз буду просить даже если за это меня мучает совесть :^) Кстати с ludum dare я пролетаю, ибо у меня завал на учебе и работе. Тогда уже буду просить помощи на следующем твг, если не найду в чем поучаствовать пораньше.
Русский
0
0
1
0
Omich
Omich@kitty_fromhell·
@EssebSaccad Да как-то не хотелось беспокоить без серьезного повода. Конкурс, по правилам, позволял вставлять в игру не свою музыку. Думал взять более менее подходящую музыку с интернета, в итоге даже этого не успел, лол. Из ближайшего, если буду делать что-то на следующий ludum dare свяжусь.
Русский
1
0
0
0
Omich
Omich@kitty_fromhell·
So the #lowrezjam has come to an end. To my surprise there was a lot of feedback. Thank you all for rating and comments, this is very motivating. Congratulations to all who got a high place, it's really deserved.
Omich tweet media
English
1
0
1
0
Omich
Omich@kitty_fromhell·
There are still a lot of work. I hope I succeed. #LOWREZJAM
English
0
4
23
0
Omich
Omich@kitty_fromhell·
@SBRLabs Understood, thanks. I use Game Maker and compile under Windows. HTML5 for some reason can't use some functions.
English
0
0
0
0
Starbeamrainbowlabs
Starbeamrainbowlabs@SBRLabs·
@kitty_fromhell I was only asking what you are using to build your game 🙂 For example, I'm using HTML5 and plain-old Javascript for mine.
English
1
0
0
0
Omich
Omich@kitty_fromhell·
@SBRLabs Sorry, I don't really understand English and I don't understand the "tech" that you want 😶
English
1
0
0
0
Starbeamrainbowlabs
Starbeamrainbowlabs@SBRLabs·
@kitty_fromhell Hey, awesome! I've been enjoying watching your progress as I've been building my entry. What tech are you using there? I love the particle system there for the pink slimy bits that come off the blob.
English
1
0
1
0
Omich
Omich@kitty_fromhell·
Look better, I think #LOWREZJAM
English
0
1
16
0