Arb

206 posts

Arb

Arb

@ArbResearch

Unfocused Research Organization. A consultancy by @gleech & @CharlesD353 & @mishayagudin

Katılım Şubat 2022
42 Takip Edilen1.5K Takipçiler
Arb
Arb@ArbResearch·
This is the most technical project we've ever done. In general, we highly recommend designating some of your coauthors to be explicitly red-teamers, not responsible for fixing the claimed problems. Babble then prune.
English
0
1
45
3.7K
Arb
Arb@ArbResearch·
Clearly this paper is a response to @gwern's classic anti-tool post. It's also an attempt to make Bayesian ML happen a la Josh Tenenbaum And in a funny way this paper is a long argument for @elonmusk's (facially absurd) claim that, for safety, all you need is a really honest AI
English
1
0
18
601
Arb
Arb@ArbResearch·
The current training process (just optimise outcomes bro) blatantly applies selection pressure toward outputs (lying, sycophancy, cheating, etc). If this pressure continues to increase (with RL) we might be in trouble. "Implicit agency" thus replaces instrumental convergence.
Arb tweet media
English
2
1
15
1K
Arb
Arb@ArbResearch·
We recently helped Yoshua Bengio and his LawZero colleagues write up their mathematical argument for Scientist AI. Our role was to be an internal red-team. The core notion is "consequence-invariance": training that never selects predictors for what their outputs would cause
Arb tweet mediaArb tweet mediaArb tweet mediaArb tweet media
English
1
11
60
10.1K
Arb retweetledi
gavin leech (Non-Reasoning)
I'm helping out with a new funder! Short applications, deadline in two weeks, decisions hopefully in four weeks. $50k cap because we're covering stuff other people cba with
gavin leech (Non-Reasoning) tweet mediagavin leech (Non-Reasoning) tweet media
English
4
9
60
4.5K
Arb retweetledi
niplav is
niplav is@niplav_site·
@Trotztd Right, there's people with the "ecology" frame, the "markets/economics" frame, the "tool/normal technology" frame, and the Yudkowskian frame.
English
1
1
6
840
Arb retweetledi
gavin leech (Non-Reasoning)
In the last 5 months, 18 Erdős Problems were solved, for the first time, by AI systems working alone. How should mathematics respond? Prof Václav Rozhoň & I are building a journal to filter this flood of AI maths at scale. We have a plan, funding, & credits; now we need a board
gavin leech (Non-Reasoning) tweet mediagavin leech (Non-Reasoning) tweet mediagavin leech (Non-Reasoning) tweet media
English
6
42
250
27.7K
Natália 🔍
Natália 🔍@natalia__coelho·
@ArbResearch @nc_znc Using this methodology, I found 204 CVEs for AISLE, avg 6.7 CVSS. The top ~51 have an avg of 8.3. They use much smaller models than Mythos Preview. Idk the degree of human involvement, but this does illustrate that CVEs are not an apples-to-apples comparison of model capabilities
English
1
0
3
326
Arb
Arb@ArbResearch·
@nc_znc took a look at the purported Ant-OAI cyber gap. [The confounders are severe enough that this could be totally misleading] but the naive view is: Mythos has a decent lead, but OAI isn't far behind. x.com/peterwildeford…
Arb tweet media
Peter Wildeford🇺🇸🚀@peterwildeford

My two questions: if GPT-5.5 and Mythos were roughly equal... 1.) where is OpenAI's large pile of vulnerabilities they discovered? 2.) why is the White House kinda ignoring it and letting it be open widely, while meanwhile micromanaging Anthropic's release plans?

English
2
6
37
8.5K