Cartyisme

975 posts

Cartyisme banner
Cartyisme

Cartyisme

@cartyisme

artist, idiot, shillosopher · @OpenSea employee · @ART101NFT founder · @w0wn3r0 progenitor · all my views are my own

California, USA Katılım Kasım 2017
1.3K Takip Edilen3.2K Takipçiler
Cartyisme
Cartyisme@cartyisme·
@sudoingX tok/s after a few months has become my benchmark, 20tk/s might as well have my agent chiseling in stone.
English
0
0
0
178
Sudo su
Sudo su@sudoingX·
you have a GPU. you want to run a local model. what's the first thing you search for?
English
28
1
51
7.5K
Cartyisme
Cartyisme@cartyisme·
@TheAhmadOsman tbf I was having issues with tool calls, as it seems they were being wrapped w/ vLLM. And llama.cpp solved the issues. 5090 user here.
English
0
0
0
37
Ahmad
Ahmad@TheAhmadOsman·
DGX Spark uses unified memory > 273 GB/s RTX PRO 6000 delivers > 1.8 TB/s (1792 GB/s) If someone told you they’re comparable, they’re wrong And this is exactly why llama.cpp isn’t the right tool here Try vLLM or SGLang on a GPU and you’ll see very different results
Max Weinbach@mweinbach

@TheAhmadOsman I have on DGX Spark and then was having insane tool calling issues and was told by Nvidia to use llama cpp

English
40
13
314
33.6K
Cartyisme
Cartyisme@cartyisme·
@stevibe Qwen3.5 turned it up a notch for sure, with a lot of exciting models coming down the pipe. Very exciting.
English
0
0
1
31
stevibe
stevibe@stevibe·
@cartyisme 100%. Luckily we still have time to fill the gap and learn how to set them up. Open-source progress is wild right now!
English
1
0
1
64
0age
0age@z0age·
so @NadavAHollander and I have been cooking on a new project if you’re regularly trawling your feed on the hunt for fresh information but are drowning in a firehose of unrelated slop… then you should reach out! we still have room for a few more curious minds in the first wave
English
51
1
148
14.1K
Cartyisme
Cartyisme@cartyisme·
@sudoingX @mamboussa this guy is awesome, love the insight, having gone through all of this myself, ollama is not the way. even gave u q4 quantization command for ur kvcache. tho 132k context seems ambitious, but im not running a 3090.... try Q3_K_M from @UnslothAI good trade off here
English
0
0
0
216
Sudo su
Sudo su@sudoingX·
llama.cpp is the way. grab the Qwen3.5-9B Q4_K_M.gguf from huggingface, compile llama.cpp with CUDA, and launch with: ./llama-server -m model.gguf -ngl 99 -c 131072 -np 1 -fa on --cache-type-k q4_0 --cache-type-v q4_0 --host 0.0.0.0 then install hermes agent and point it at localhost:8080. dm me if you get stuck.
English
24
4
209
6.4K
(っ ͡❛ ͜ʖ ͡❛)っ𖤐
Hi @sudoingX im going to install Agent Hermes on my desktop with a 3060 12gb, can you help me to configure it with Llama.cpp or Ollama ?
English
2
1
22
5K
Zack Brenner
Zack Brenner@zjbrenner·
Spending my Friday night watching Dinosaurs. You?
Zack Brenner tweet media
English
38
2
74
2.3K
Cartyisme
Cartyisme@cartyisme·
@peekcell i just meant to say, most AI pixel art or pixel art made in illustrator will break when scaled to nearest neighbor, making it clearly not "real" pixel art
English
1
0
1
21
Peekcell
Peekcell@peekcell·
@cartyisme Haha this works if you want to preserve the details with up and downscaling the pixels yeah!
English
1
0
0
23
Jav
Jav@javpixel_art·
gm✨ Hi @opensea , you guys are showing the same collections since 1 month on Base Homepage. The module says "This Week curated collections" , however, the same collections are there week after week, some of them even without real volume in months! Is someone even paying attention?
Jav tweet media
English
9
2
17
3.3K
Autism Capital 🧩
Autism Capital 🧩@AutismCapital·
We've said this before but it bears repeating. Establish your tribes NOW. The world is going to become INCREASINGLY tribal moving forward. It will also become exceedingly violent as systems fail. The world will unfortunately adopt an us vs them mentality. Establish your tribes.
English
56
17
343
21.9K
Autism Capital 🧩
Autism Capital 🧩@AutismCapital·
The world is unrecognizable these days. Humans have become different. Everyone is being driven by different spirits than they previously were. It's only going to become even more unrecognizable. The idea of what it means to be a human, a citizen, an identity, is being challenged.
English
65
37
638
35.6K
Maning 💀🫡
Maning 💀🫡@Maniinng·
A few days have passed since this fake collection showed up. I shared it in the @opensea server and nothing, asked people to report it, and still nothing. How do you even get this kind of stuff taken down 🥲
Maning 💀🫡 tweet media
English
10
0
11
573
Maning 💀🫡
Maning 💀🫡@Maniinng·
Thank you so much!!! Its being hard to contact, I have an open thread about a token that was sold, but on OpenSea it’s still listed and I still appear as the owner. I know you’re extremely busy, but it was amazing back when there was a support channel and things got fixed as we reported bugs.
English
1
0
2
34
Aspyn 🟩
Aspyn 🟩@AspynPalatnick·
A group chat I’m in was talking about how NFTs and memecoins are no longer punk Makes me think @netprotocolapp may be the most punk thing in crypto today Apps with centralized servers/DBs? Mainstream Censorship-resistant decentralized apps with all data stored onchain? Punk
English
5
8
44
1.7K