.@GreatWolfLodge is the worst. Not recommended. Spend your money elsewhere.
English
Andrew Baker
1.8K posts
Andrew Baker
@AndrewMBaker
Provider of Tweets related to quantified law, natural language processing, legal tech, legal process, service design, and dad-stuff. All views my own.
Chicago, IL Joined Aralık 2008
1.5K Following2.2K Followers
@BretBielema @Nike @JakeRosch Please don’t shelve these! They need to come back periodically — maybe a Homecoming tradition? Too good to only flash once.
English
#famILLy
Special thanks to @Nike and @JakeRosch for a special memory around a very special game #ILL
Illinois Football@IlliniFootball
100 years of tradition threaded within.
English
Andrew Baker retweeted
Devon Witherspoon #ProBowlVote
1RT= Vote
This season not might be going well but let’s get someone who deserves the pro bowl in it.
English
@jackwshepherd Also, many applications fit within an ecosystem / aren’t on an island. Understanding data ingress and egress isn’t easy and requires a lot of context, isn’t just a coding gap.
English
Lots of sessions citing GPT-4 bar exam results. Worth considering this other analysis too. #ILTACON2023
Markus Anderljung@Manderljung
The claim that GPT-4 performed at the 90th percentile on the Uniform Bar Exam appears misleading according to this new preprint. It seems more accurate to say it performs in the 63rd or 68th percentile.
English
Some light discussion of model performance & evaluation in an AI session. Honestly, market needs a whole dedicated session on that topic. Not easy when dealing w/Generative, unfortunately. Isn’t the fun stuff, but thinking needs to evolve on that in Legal. #ILTACON2023
English
Speaker in the data science session just covered context windows and document segmentation in a session. Really good to see. Need more of the sharp edges in GenAI pointed out to the industry, not just hocus pocus. #ILTACON2023
English
Retrieval Augmented Generation (RAG) isn’t a “domain specific LLM.” It’s a usage pattern around an LLM, injecting content into the prompts. The difference here matters a bit. Legal industry needs to unpack RAG a bit more. #ILTACON23
English
Really solid analysis evaluating performance of Generative AI in our industry. We need more of this in Legal. Requires cross-discip. perspective, as displayed here. Can't rely on product companies and those selling services; need a more objective lens.👏
arxiv.org/ftp/arxiv/pape…
GIF
English
Where would we be if 20% of the time spent thinking about what the future could look like because of Generative AI was spent rigorously testing use cases and validating approaches? Collective "Legal Science Fiction" skills are fairly refined, "Legal Science" interest fairly low.
GIF
English
@LeanLawStrategy Line of thinking here is right. Not dealing in magic; treat as science. Research / validation of the application of Gen AI to specific NLP tasks is hugely important. Fit will vary, and we need to ground that in better ways. Big knowledge gaps to close.
English
be (to use an extreme case) 10% accurate, but it gives you that 10% in 1 second and that "efficiency" in getting started matters more than high accuracy?
English
Question I raised to @inspiredcat and will raise here: Where is the independent research showing the AI-augmented tools are "better" than human only tools? Yes, vendors are adding AI, but that doesn't mean the result is better. Some may be (again, where's the independent ...
Daniel W. Linna Jr.@DanLinna
Lawyer version of this 20 years ago was: use the books, don’t use computer research tools. Agreed, @steve_vladeck that this lawyer improperly used ChatGPT. Saying “do not use ChatGPT OR ANY OTHER AI” is misguided. Every research tool uses AI and they are all integrating large language models into legal research and drafting. We need to encourage students and lawyers to use these tools, and use them responsibly.
English
@inspiredcat That particular example is beyond the pale. But our industry is way behind in formal evaluation of information retrieval (and other language tasks) via Generative AI. “Use correctly” is a tougher challenge than most acknowledge, given nature of tech (e.g., content window limits).
English
The problem is the lawyer.
Not Chat GPT.
It’s a tool. That we are ethically obligated to know how to use correctly.
“AI is bad for legal research” as a blanket statement isn’t a logical conclusion. And possibly fuels an anti-tech mindset that does not serve us well.
English
Andrew Baker retweeted
Regardless, this highlights the need for a healthy ecosystem of researchers checking each others' work and rerunning evaluations. Tests need to be run and/or checked by multiple different teams.
English
Andrew Baker retweeted
The claim that GPT-4 performed at the 90th percentile on the Uniform Bar Exam appears misleading according to this new preprint.
It seems more accurate to say it performs in the 63rd or 68th percentile.
English
@marclauritsen @Nicola_Shaver And sitting on calls with you and Ron Staudt while I was in law school reshaped my world. And that of others. The through-lines are pretty cool when you zoom out.
English
@Nicola_Shaver It was thanks to those professors that I got my start in legal practice systems. Fond memories of sitting at the feet of Professor Larry Farmer in a snowy Provo in February 1986 ...
English
Did you know that document automation in the legal industry started way back in the 1970s?
Two professors at Brigham Young University Law School became focused on the highly structured and rules-based nature of many legal document…lnkd.in/eTcGeJhE lnkd.in/epf78r-9
English
Anyone up for some data architecture content at SKILLS on the 9th? Maybe? Maybe not? Painless, I promise.
#skillslaw
linkedin.com/posts/andrewmi…
English
I read these “law firms are sitting on so much data” threads & wonder: Have you been in a law firm? Have you run queries against common data sources directly? Ever try mining the text sources you portray as easy pickings? Know what that even entails? “No” is too often the answer.
English
Andrew Baker retweeted
Andrew Baker retweeted
The hardest people for founders to hire are so called C-level executives, because these people are the best fakers in the world.
English
Andrew Baker retweeted
Hey @DoNotPay - How about offering a service for political campaign donors to get refunds of money solicited under false pretenses?
English