ShadowTraffic retweetet

🔥 It's alive! @ShadowTrafficIO can now connect directly to Kafka or Postgres and generate matching synthetic streams—without you having to learn anything.
Over the last week, I've been hacking with Meta's CodeLlama-instruct models.
I put together a set of prompts teaching Llama the ShadowTraffic JSON DSL. First, I taught it the DSL structure. Then, I taught it the available configuration options. Finally, I fed it a bunch of examples.
When you run it, ShadowTraffic fetches your schemas+data and combines them with the base prompt.
In the screenshots, you can see:
1. The head of one of the prompts
2. ShadowTraffic running `predict` mode, inferring the configuration file
3. ShadowTraffic running with that config, spitting out matching data
This is obviously highly experimental with room for improvement, but so far ShadowTraffic is consistently able to generate data with the right shape and minimal tweaking to the suggested configuration.
✌️ I haven't yet publicly released this since it needs a lot of testing. If you want to try it early, send me a DM.
I am *SO* excited for what's coming next.



English



