Yonathan Arbel

3.8K posts

Yonathan Arbel banner
Yonathan Arbel

Yonathan Arbel

@ProfArbel

Let's build safe AI! Law prof @ Alabama Contracts, Defamation, Legal NLP, & AI Safety

Tuscaloosa, AL Katılım Temmuz 2014
1.5K Takip Edilen1.6K Takipçiler
Sabitlenmiş Tweet
Yonathan Arbel
Yonathan Arbel@ProfArbel·
Why do workers have to wait for 2-4 weeks to be paid, in the same economy where online transactions go quickly and securely? A new draft 𝑃𝑎𝑦𝑑𝑎𝑦-forthcoming @WashULaw-proposes that they shouldn't. Daily, or at least weekly, pay can be a reality. papers.ssrn.com/sol3/papers.cf…
English
4
10
57
0
Yonathan Arbel
Yonathan Arbel@ProfArbel·
I think it's an exciting point. Some of us like to build stuff, and then others can adopt these tools without much know-how. To give a concrete example: a platform that takes your past exam memos, and then let students get feedback when they take practice exams. One person can build it, and then others can easily&freely reuse it. (solving the willingness-to-try-new-methods problem is much harder)
English
1
0
0
20
Kevin Werbach
Kevin Werbach@kwerb·
@ProfArbel I'm on your side of this. The part I don't see is how we get to good AI-native pedagogy at scale. Working toward it individually as a faculty member requires a lot of investment, which most can't or won't make. The speed of AI change makes it really hard to get right.
English
2
0
1
95
Yonathan Arbel
Yonathan Arbel@ProfArbel·
This is a bad policy. Lots of people are calling it unenforceable. They're almost right, but that's not the real issue. It's a bad policy because it's bad pedagogy. First, a prediction: Berkeley walks this back within three years. If you disagree, be brave enough to stake your position now. On enforceability. Technically it's enforceable, in the same way prohibitions on apostasy are enforceable: you collect testimony and you punish people. Detection here hinges on the professor's gut. Too many em dashes? F. You don't have the occasional typo? Sus! The pro-enforcement camp implicitly assumes professors possess some innate AI-detection power. They don't. The result is a regime saturated with Type 1 and Type 2 errors. oh, and if you mess up your bluebooking? a citation to a non-existent source automatically "raise[s] a presumption of prohibited AI use." But I care more about the pedagogy. Tucked into the rule is a prohibition on uploading "course materials, including assignments, readings, slides, class recordings, or other class content" into generative AI systems. That means a Berkeley student can't ask ChatGPT to quiz them before an exam. Can't ask it to explain voir dire at a tractable level. Can't use it as a patient, infinite, on-demand tutor on the vagaries of the rule against perpetuities These are extraordinary tools, and we're building more of them (wait for it). Students at competing schools will have them. Berkeley students won't. Beyond the competitive disadvantage, the harder question is this: how do faculty explain that this isn't about protecting professorial IP, real or imagined, but about serving students? The motte defenders retreat to is this: we need to build Core Competencies(TM), and you can't do that by letting students reach for AI on day one. The motte's true. But it is vastly narrower than the bailey that the policy creates. The policy rests on the assumption that the core competencies of a 1990 lawyer will remain the core competencies of a 2029 lawyer, that the AI revolution will be no bigger than the move from print reporters to Boolean searching on Westlaw. That's wild! Practice is already changing. If you don't have an agentic swarm running in the background right now, you're behind. Push defenders on which competencies, exactly, and the answers fall into three buckets. First, skills heading for obsolescence: manual bluebooking, drafting boilerplate from scratch, first-pass document review, summarizing depositions by hand. Second, skills that are real but almost certainly better trained with AI than against it: issue spotting drilled against an infinite supply of hypotheticals, brief feedback in seconds rather than weeks, writing improved through structured iteration with a tireless reader. Third, skills so vague they can't be measured. "Thinking like a lawyer." "Professional judgment." For these we have no way to know whether AI helps or hurts, yet the policy assumes it must hurt. But it's only a default, right? Well defaults matter, and this one's sticky. Professors have to opt out in writing. Even when they do, students *must* disclose every instance of AI use, which today already implicates using Google. Any ambiguity resolves against the student. The structural message is legible and loud: AI use is presumptively cheating. That message is wrong about almost everything. It's wrong about the technology, which isn't a shortcut but a new kind of cognitive partner. It's wrong about practice, where AI is already pervasive in the firms students are about to enter. It's wrong about teaching, by suggesting pedagogy needs no innovation in the face of the most powerful educational tool in a generation. And it's wrong about students, by casting those who use AI thoughtfully as people who lack fundamental skills, rather than as the lawyers Berkeley should be proudest to graduate. The best legal careers of the next decade will belong to lawyers who know when to use AI, when not to, how to verify it, how to weave it into legal reasoning, and how to supervise it in client matters. Policies like this one belong to those who resigned themselves to sit out this future.
Chris Hoofnagle@hoofnagle

Berkeley law has introduced a new, much stricter AI policy law.berkeley.edu/wp-content/upl…

English
21
17
75
15.8K
Yonathan Arbel
Yonathan Arbel@ProfArbel·
The judicial economy problem of AI is making the headlines. This was anticipated, as well as the bitter pill many lawyers and legal scholars need to swallow: the solution will have to come via integration of AI into adjudication. Read more in the link below
Martin Chorzempa 马永哲@ChorzempaMartin

AI is already breaking social systems where effort (time/cost) of preparing documents is needed as friction to avoid overwhelming manual review. True for cover letters, apps to college/fellowships/grants, and now court cases. Needs rapid response bloomberg.com/news/articles/…

English
2
2
8
4.1K
Martin Chorzempa 马永哲
Martin Chorzempa 马永哲@ChorzempaMartin·
AI is already breaking social systems where effort (time/cost) of preparing documents is needed as friction to avoid overwhelming manual review. True for cover letters, apps to college/fellowships/grants, and now court cases. Needs rapid response bloomberg.com/news/articles/…
English
5
7
27
22.8K
Yonathan Arbel
Yonathan Arbel@ProfArbel·
@LittleMikeyMcD @donaldcclarke You are a Berkeley law student. You worked hard on your paper for the consumer law seminar. The journal abbreviations are new to you, and you mix up the one for footnote 41 and 45. You are now facing the honor council, under suspicion of Illicit Invocation of AI. Defend thyself.
English
1
0
0
41
Yonathan Arbel
Yonathan Arbel@ProfArbel·
@donaldcclarke A common mode of hallucination is for the AI to get the author and even title correct, but not the journal or volume. This is a mistake that's also easy for students, without the benefit of half a century of experience like yours, to make unwittingly.
English
1
0
0
32
Donald Clarke
Donald Clarke@donaldcclarke·
@ProfArbel I have been doing legal writing since 1983. I am sure I have messed up Bluebooking on many occasions. Those mess-ups have never involved citing to a non-existent source.
Donald Clarke tweet media
English
2
0
1
87
Yonathan Arbel
Yonathan Arbel@ProfArbel·
@JacksonKernion It's easier to think about it in steps. Can you see how a corporation with exclusive control over an advanced model can direct it to gain strategic advantage over competitors and regulators?
English
0
0
5
551
Jackson Kernion
Jackson Kernion@JacksonKernion·
I simply don't understand what people have in mind when they say stuff like this. What we have is extremely capable computer use agents. They will continue to get better at computer use. But how does a capable computer use agent 'take over' and why haven't they done that today?
Elizabeth Barnes@BethMayBarnes

(1) We are likely on track to develop AI systems capable of causing human extinction/permanent disempowerment, quite possibly within the next few years

English
117
29
468
138.6K
Yonathan Arbel
Yonathan Arbel@ProfArbel·
@skyestarfyre Good, so let's have one policy for the law school with all those gifted and well trained teachers, Babel-like libraries, and sagacious librarians; and then an AI policy for all the other law schools.
English
1
0
0
49
Skye Starfyre
Skye Starfyre@skyestarfyre·
Teachers should be gifted or at least well trained; why allow the mediocre to perpetuate mediocrity? And the point is that, even if a credible source is not “on hand” to answer a question immediately, good teachers train their students how to seek those sources out, or—where none exist—to pursue original, rigorous inquiry in order to produce such a source.
English
1
0
0
43
Yonathan Arbel
Yonathan Arbel@ProfArbel·
@hockeygoth @MisterSuricata Of course, in the same way that you can read all the privacy policies you are signing on the internet. As with many things in teaching, you want to be deliberate and purposeful and think what you are trying to achieve
English
0
0
0
23
Yonathan Arbel
Yonathan Arbel@ProfArbel·
@skyestarfyre Maybe you were only exposed to gifted teachers, and maybe you had a Credible Source on hand for every query you ever had, but many others would benefit from learning from & with AI
English
2
0
0
84
Skye Starfyre
Skye Starfyre@skyestarfyre·
@ProfArbel “Bad pedagogy” is not training your students to be able to think without AI. If they can’t understand a concept, maybe you could try explaining it better or teaching them to consult credible sources independently to sort out their confusion.
English
1
0
1
101
Helen Reynolds MBE
Helen Reynolds MBE@helenrey·
@ProfArbel Really? How do you know? We increasingly don't get to decide... your insurance? Your health care? Those algorithms are opaque. Selection for interview? Various issues coming to light about that. To your answer: I think we're defining 'pedagogy' differently.
English
1
0
0
22
Yonathan Arbel
Yonathan Arbel@ProfArbel·
@helenrey Not everything is a plot by Big AI. We have agency. We get to decide. What's your decision? Never? Rarely? Mondays? When, and why? And to your question: yes
English
1
0
0
81
Helen Reynolds MBE
Helen Reynolds MBE@helenrey·
@ProfArbel From your profile you've skipped the step of making a decision about AI. There are wide ranging implications for society; AI developers would really like us all to skip to the 'let's use AI safely'. Then, the lack of being able to upload things to ChatGPT is bad pedagogy?
English
1
0
0
118
Yonathan Arbel
Yonathan Arbel@ProfArbel·
@Jabaluck I'm so surprised to see the skeptical responses. This is clearly true, in the same way that Stockfish outplays all humans
English
0
0
1
83
Jason Abaluck
Jason Abaluck@Jabaluck·
Math won't be exhausted, but we'll get to a point where the contribution of human mathematicians is less than what the average person today contributes to Terry Tao's thinking about number theory. The levels of abstraction will exceed what any human brain can grasp.
English
16
4
59
5.1K
Yonathan Arbel
Yonathan Arbel@ProfArbel·
@LuisRAgostini Yeah, I guess we can spend our time investigating our students/suspects for violating policies that "criminalize" basically everything they do. And you may be a wiser judge than most, but we will end up with a many unfair sanctions and under-enforcement
English
0
0
0
46
Luis Agostini
Luis Agostini@LuisRAgostini·
@ProfArbel Initiate a conversation to determine if any policies were violated rather than issuing a blind judgment, which is what I do with my current students.
English
1
0
0
37
Yonathan Arbel
Yonathan Arbel@ProfArbel·
@MisterSuricata All the good answers require effort and imagination (on the teachers' side). But people are coming up with ideas. One example: In my seminar, I let them read papers with AI -- but then assign x3-5 the number of papers.
English
1
0
0
75
Kalahari
Kalahari@MisterSuricata·
@ProfArbel I've seen many similar responses to this policy. They definitely make some good points. What is lacking is any specifics about what law schools are to do if LLM use is allowed. How should they train students to the unknown core competencies of 2029? How should they test for them?
English
1
0
0
81
Yonathan Arbel retweetledi
Anita
Anita@precognita·
I’ve had this debate with students and faculty alike and this is the side I end up on every time. You just don’t get good at anything without putting in reps. And if you srsly believe the core skillset of a legal practitioner is the same as it was 10 years ago, you’re behind. Either way, I would not choose to go to Berkeley today based on this AI policy alone.
Yonathan Arbel@ProfArbel

This is a bad policy. Lots of people are calling it unenforceable. They're almost right, but that's not the real issue. It's a bad policy because it's bad pedagogy. First, a prediction: Berkeley walks this back within three years. If you disagree, be brave enough to stake your position now. On enforceability. Technically it's enforceable, in the same way prohibitions on apostasy are enforceable: you collect testimony and you punish people. Detection here hinges on the professor's gut. Too many em dashes? F. You don't have the occasional typo? Sus! The pro-enforcement camp implicitly assumes professors possess some innate AI-detection power. They don't. The result is a regime saturated with Type 1 and Type 2 errors. oh, and if you mess up your bluebooking? a citation to a non-existent source automatically "raise[s] a presumption of prohibited AI use." But I care more about the pedagogy. Tucked into the rule is a prohibition on uploading "course materials, including assignments, readings, slides, class recordings, or other class content" into generative AI systems. That means a Berkeley student can't ask ChatGPT to quiz them before an exam. Can't ask it to explain voir dire at a tractable level. Can't use it as a patient, infinite, on-demand tutor on the vagaries of the rule against perpetuities These are extraordinary tools, and we're building more of them (wait for it). Students at competing schools will have them. Berkeley students won't. Beyond the competitive disadvantage, the harder question is this: how do faculty explain that this isn't about protecting professorial IP, real or imagined, but about serving students? The motte defenders retreat to is this: we need to build Core Competencies(TM), and you can't do that by letting students reach for AI on day one. The motte's true. But it is vastly narrower than the bailey that the policy creates. The policy rests on the assumption that the core competencies of a 1990 lawyer will remain the core competencies of a 2029 lawyer, that the AI revolution will be no bigger than the move from print reporters to Boolean searching on Westlaw. That's wild! Practice is already changing. If you don't have an agentic swarm running in the background right now, you're behind. Push defenders on which competencies, exactly, and the answers fall into three buckets. First, skills heading for obsolescence: manual bluebooking, drafting boilerplate from scratch, first-pass document review, summarizing depositions by hand. Second, skills that are real but almost certainly better trained with AI than against it: issue spotting drilled against an infinite supply of hypotheticals, brief feedback in seconds rather than weeks, writing improved through structured iteration with a tireless reader. Third, skills so vague they can't be measured. "Thinking like a lawyer." "Professional judgment." For these we have no way to know whether AI helps or hurts, yet the policy assumes it must hurt. But it's only a default, right? Well defaults matter, and this one's sticky. Professors have to opt out in writing. Even when they do, students *must* disclose every instance of AI use, which today already implicates using Google. Any ambiguity resolves against the student. The structural message is legible and loud: AI use is presumptively cheating. That message is wrong about almost everything. It's wrong about the technology, which isn't a shortcut but a new kind of cognitive partner. It's wrong about practice, where AI is already pervasive in the firms students are about to enter. It's wrong about teaching, by suggesting pedagogy needs no innovation in the face of the most powerful educational tool in a generation. And it's wrong about students, by casting those who use AI thoughtfully as people who lack fundamental skills, rather than as the lawyers Berkeley should be proudest to graduate. The best legal careers of the next decade will belong to lawyers who know when to use AI, when not to, how to verify it, how to weave it into legal reasoning, and how to supervise it in client matters. Policies like this one belong to those who resigned themselves to sit out this future.

English
1
1
3
541
Yonathan Arbel
Yonathan Arbel@ProfArbel·
@LuisRAgostini That's the point! you suspect, but you aren't confident. If I were your student, what would you do?
English
1
0
0
97
Yonathan Arbel
Yonathan Arbel@ProfArbel·
@eduleadership Would you be amenable to testing your hypothesis, or do you think it's not testable?
English
0
0
1
135
Justin Baeder, PhD
Justin Baeder, PhD@eduleadership·
@ProfArbel Doesn’t seem like you’ve really thought about what makes it bad pedagogy, and the direction of the influence AI might have on pedagogy. I’d contend it’s always worse. If you’re struggling to understand a concept from the book, read more closely. Read more books. Ask a human.
English
1
0
5
280
Yonathan Arbel
Yonathan Arbel@ProfArbel·
@jawillick The language is overbroad, and that's not the only issue. x.com/ProfArbel/stat…
Yonathan Arbel@ProfArbel

This is a bad policy. Lots of people are calling it unenforceable. They're almost right, but that's not the real issue. It's a bad policy because it's bad pedagogy. First, a prediction: Berkeley walks this back within three years. If you disagree, be brave enough to stake your position now. On enforceability. Technically it's enforceable, in the same way prohibitions on apostasy are enforceable: you collect testimony and you punish people. Detection here hinges on the professor's gut. Too many em dashes? F. You don't have the occasional typo? Sus! The pro-enforcement camp implicitly assumes professors possess some innate AI-detection power. They don't. The result is a regime saturated with Type 1 and Type 2 errors. oh, and if you mess up your bluebooking? a citation to a non-existent source automatically "raise[s] a presumption of prohibited AI use." But I care more about the pedagogy. Tucked into the rule is a prohibition on uploading "course materials, including assignments, readings, slides, class recordings, or other class content" into generative AI systems. That means a Berkeley student can't ask ChatGPT to quiz them before an exam. Can't ask it to explain voir dire at a tractable level. Can't use it as a patient, infinite, on-demand tutor on the vagaries of the rule against perpetuities These are extraordinary tools, and we're building more of them (wait for it). Students at competing schools will have them. Berkeley students won't. Beyond the competitive disadvantage, the harder question is this: how do faculty explain that this isn't about protecting professorial IP, real or imagined, but about serving students? The motte defenders retreat to is this: we need to build Core Competencies(TM), and you can't do that by letting students reach for AI on day one. The motte's true. But it is vastly narrower than the bailey that the policy creates. The policy rests on the assumption that the core competencies of a 1990 lawyer will remain the core competencies of a 2029 lawyer, that the AI revolution will be no bigger than the move from print reporters to Boolean searching on Westlaw. That's wild! Practice is already changing. If you don't have an agentic swarm running in the background right now, you're behind. Push defenders on which competencies, exactly, and the answers fall into three buckets. First, skills heading for obsolescence: manual bluebooking, drafting boilerplate from scratch, first-pass document review, summarizing depositions by hand. Second, skills that are real but almost certainly better trained with AI than against it: issue spotting drilled against an infinite supply of hypotheticals, brief feedback in seconds rather than weeks, writing improved through structured iteration with a tireless reader. Third, skills so vague they can't be measured. "Thinking like a lawyer." "Professional judgment." For these we have no way to know whether AI helps or hurts, yet the policy assumes it must hurt. But it's only a default, right? Well defaults matter, and this one's sticky. Professors have to opt out in writing. Even when they do, students *must* disclose every instance of AI use, which today already implicates using Google. Any ambiguity resolves against the student. The structural message is legible and loud: AI use is presumptively cheating. That message is wrong about almost everything. It's wrong about the technology, which isn't a shortcut but a new kind of cognitive partner. It's wrong about practice, where AI is already pervasive in the firms students are about to enter. It's wrong about teaching, by suggesting pedagogy needs no innovation in the face of the most powerful educational tool in a generation. And it's wrong about students, by casting those who use AI thoughtfully as people who lack fundamental skills, rather than as the lawyers Berkeley should be proudest to graduate. The best legal careers of the next decade will belong to lawyers who know when to use AI, when not to, how to verify it, how to weave it into legal reasoning, and how to supervise it in client matters. Policies like this one belong to those who resigned themselves to sit out this future.

English
0
0
0
63
bkpark
bkpark@bkpark·
@ProfArbel psst. it was detecting *my* writing as 100% human. because it was.
English
1
0
1
43