Daniel Walsh

7.8K posts

Daniel Walsh banner
Daniel Walsh

Daniel Walsh

@rhatdan

Mr SELinux, Red Hat Senior Distinguished Engineer, works on RamaLama AI Tools, OCI Containers, Podman, Buildah & OpenShift. Author "Podman in Action".

Maine, USA Katılım Eylül 2009
214 Takip Edilen9.7K Takipçiler
Daniel Walsh
Daniel Walsh@rhatdan·
@ggerganov People should try RamaLama, for pure llama.cpp experience with similar CLI to Ollama. We are a pure Open Source project with over 100 contributors. ramalama.ai
English
0
2
17
1K
Georgi Gerganov
Georgi Gerganov@ggerganov·
LMStudio are using the upstream ggml implementation which is significantly better and well optimized. Looking at ollama's modifications in ggml, they have too much branching in their MXFP4 kernels and the attention sinks implementation is really inefficient. Along with other inefficiencies, I expect the performance is going to be quite bad in ollama.
Emi@SrEdm00

Why @ollama gpt-oss:20b version is too slow compared to the LM Studio version? Any issue?

English
41
101
1.4K
303.5K
Daniel Walsh
Daniel Walsh@rhatdan·
Joining the Podman Desktop community meeting. Demonstrate and discuss the cool features of this TOTALLY Free tool. From ability to launch containers, pods, locally and directly into Kubernetes. Now with AI Plugins to help developers get into AI. github.com/podman-desktop…
English
1
6
14
983
Daniel Walsh retweetledi
ggml
ggml@ggml_org·
ggml tweet media
ZXX
4
23
94
68.5K
Daniel Walsh
Daniel Walsh@rhatdan·
@catafest SELinux is used heavily with containers, I believe it is the number 1 protection of your host environment from container processes. Containers and SELinux are like peanut butter and jelly. They enhance each other.
GIF
English
0
0
1
41
catafest
catafest@catafest·
@rhatdan ... hey what's happend with SELinux ?
English
1
0
0
34
Daniel Walsh
Daniel Walsh@rhatdan·
Developers are tired of hearing about AI as a panacea. The backlash may be just what organizations need to effectively implement the technology. infoworld.com/article/362653…
English
1
6
19
923