

Yannick Stephan
738 posts

@YannickSteph
Machine Learning | Generative AI | MSc in Data Sciences












Claude-ception: Teaching Claude3 to prompt engineer itself Claude3 Opus is excellent at prompt engineering. @alexalbert__ recently laid out a nice workflow: write an prompt, run it on test cases, grade responses, let Claude3 Opus use grades to improve prompt, & repeat. @WHinthorn and @rlancemartin show how to use LangSmith to simplify this process: + Create a dataset of test cases + Annotate generations with feedback + Pass feedback to Claude3 Opus to prompt re-write + Run as an iterative improvement loop We apply this approach to paper summarization, asking Claude3 to summarize papers in the excellent communication style of @omarsar0. With feedback, Claude3 tunes its own summarization prompt and produces increasingly engaging paper summaries. This shows a general strategy for automated prompt engineering. Reference thread: x.com/alexalbert__/s… Video w/ code in Description: youtu.be/Vn8A3BxfplE
