statusfailed

1.2K posts

statusfailed

statusfailed

@statusfailed

founder @ https://t.co/DuFsvLW8Ps

Entrou em Mayıs 2012
676 Seguindo576 Seguidores
Tweet fixado
statusfailed
statusfailed@statusfailed·
we're at neurips! DM me if you wanna chat about: - array languages and compilers - determinism and verifiability for training AND inference - training models with NO FLOATS ANYWHERE (come see our poster on sat!) ... or anything else!
statusfailed tweet media
English
1
2
8
801
statusfailed
statusfailed@statusfailed·
@zcbenz any resources you'd recommend for picking it up?
English
0
0
0
196
Cheng
Cheng@zcbenz·
Spent a month learning CUTLASS/CuTe and shipped a simple mixed dtype GEMM kernel, some thoughts on it: Programming for modern NVIDIA hardware is a lot easier with CuTe, for which you have to deal with various memory layouts of different instructions,
English
6
2
106
5.7K
Towaki Takikawa / 瀧川永遠希
Design Conductor: an AI agent that can build a RISC-V CPU core from design specs. The agent is given access to a RISC-V ISA simulator and manuals... to enable an end-to-end verification-driven generation. The most important thing for design intelligence is a verifier 😎
Towaki Takikawa / 瀧川永遠希 tweet media
English
25
160
1K
121.8K
statusfailed
statusfailed@statusfailed·
@ptrschmdtnlsn I often wonder what life was like with the textiles of ~200 years ago. It's so hard to imagine
English
0
0
1
52
statusfailed
statusfailed@statusfailed·
@undebeha no, dont know this one, but i'd be interested to read it! you might also like 'relational programming' by MacLennan - found this after reading "Can programming be liberated from the von Neumann style?" a long while ago upload.wikimedia.org/wikipedia/comm…
English
1
0
2
15
undefined behavior
undefined behavior@undebeha·
@statusfailed there has probably been more than one tbh but there was one in particular that stuck with me and I can't remember how I found it
English
1
0
2
22
undefined behavior
undefined behavior@undebeha·
denote a function f from A to B with `f : A -> B`. likewise denote a partial function with `f : A -| B`. write `f : A -< B` for a nondeterministic function and `f : A -[ B` for a total nondeterministic function. by exploiting mirror symmetry, we may instead choose to write the type of a function as `B <- A : f`. this is just notation and is no different from writing `f : A -> B`. we may mirror the other sorts of functions too. `B |- A : f` for the partial function, `B >- A : f` for the nondeterministic, and `B ]- A : f` for the total nondeterministic. by superimposing the forward and reverse notations atop each other, we can describe a pair of functions that exist in a relationship with one another. for example, the total function `f : A -> B` fuses with the partial function `A |- B : g` to get `f : A |-> B : g` in this case, due to the relationship between f and g, we can deduce that f is an injection. this notation describes many useful sorts of relationships. `f : A >-< B : g` is a general relation between A and B. `f : A >-> B : g` describes a normal function f, as the word "function" is commonly understood. `f : A |-> B : g` is an injection and `f : A ]-> B : g` is a surjection. `f : A <-> B : g` is an isomorphism, and `f : A |-| B : g` is a partial isomorphism this notation ALSO describes exotic relationships like `f : A |-[ B : g` whose standard interpretations are not immediately clear to me
English
5
2
32
2.1K
statusfailed retweetou
Stocko 👊🤖
Stocko 👊🤖@_Stocko_·
it's kind of crazy how we're all just dealing with the nondeterminism of AI models instead of making them deterministic. the invention of digital electronics was solving the nondeterminism in analog signals. this is a step backwards tbh
English
8
1
17
940
statusfailed
statusfailed@statusfailed·
okay i got fully nerd sniped by @undebeha's cool notation so thread time on special frobenius structure 🧵 special surprise: this structure lets you do AoT autodiff in categorical neural networks
statusfailed tweet media
undefined behavior@undebeha

denote a function f from A to B with `f : A -> B`. likewise denote a partial function with `f : A -| B`. write `f : A -< B` for a nondeterministic function and `f : A -[ B` for a total nondeterministic function. by exploiting mirror symmetry, we may instead choose to write the type of a function as `B <- A : f`. this is just notation and is no different from writing `f : A -> B`. we may mirror the other sorts of functions too. `B |- A : f` for the partial function, `B >- A : f` for the nondeterministic, and `B ]- A : f` for the total nondeterministic. by superimposing the forward and reverse notations atop each other, we can describe a pair of functions that exist in a relationship with one another. for example, the total function `f : A -> B` fuses with the partial function `A |- B : g` to get `f : A |-> B : g` in this case, due to the relationship between f and g, we can deduce that f is an injection. this notation describes many useful sorts of relationships. `f : A >-< B : g` is a general relation between A and B. `f : A >-> B : g` describes a normal function f, as the word "function" is commonly understood. `f : A |-> B : g` is an injection and `f : A ]-> B : g` is a surjection. `f : A <-> B : g` is an isomorphism, and `f : A |-| B : g` is a partial isomorphism this notation ALSO describes exotic relationships like `f : A |-[ B : g` whose standard interpretations are not immediately clear to me

English
2
1
9
619
statusfailed
statusfailed@statusfailed·
@undebeha relations are for sure the right way to think about it, there's so much symmetry that you lose in the "functions are just special relations" exposition
English
1
0
2
28
undefined behavior
undefined behavior@undebeha·
haha I must have been subconsciously thinking of string diagrams when I decided on -| for partiality and yea you nailed it, the mirror is the converse of a relation. tbqh i have been thinking of this in sort of a relation-first approach, where all the different >-| whatever are subtypes of relations. a more elaborate taxonomy than the standard "there are relations, and functions which are a special kind of relations" that is everywhere in the textbooks, but kind of the same in spirit
English
1
0
2
100
statusfailed
statusfailed@statusfailed·
WELL, once you start thinking about syntax as "relations between operations", you can use it to make wires "flow backwards. Here is the general scheme for "differentiating diagrams" using special frobenius structure - notice the split/joins/unit/counit maps used to bend wires around!
statusfailed tweet media
English
1
0
4
85
statusfailed
statusfailed@statusfailed·
The dual of "non-injective" functions are "nondeterministic". The dual of "non-surjective" functions are "partial functions". and once you add ALL of these "capabilities" into your language, you just have relations! so what does this have to do with autodiff?
English
1
0
3
62