jason

77 posts

jason

@frenjason

Sharing https://t.co/4oigowko5j Joining @Livekit Building https://t.co/cWZMnKmmo8

Brooklyn, NY Katılım Eylül 2013

629 Takip Edilen138 Takipçiler

jason@frenjason·16 Nis

@perplexity_ai Beautiful. Curious if you’ve through about bringing cursor awareness into the context. I’ve been playing with it, and I’m telling ya it feels really magical to point-and-speak to launch a task. Uses accessibility tree to know what i’m pointing at.

jason@frenjason

Clicky inspired me to share This. This is a new way to interact with Claude Code. Just point and speak. I use it all the time. It’s also open source.

English

2.7K

Perplexity@perplexity_ai·16 Nis

Today we're releasing Personal Computer. Personal Computer integrates with the Perplexity Mac App for secure orchestration across your local files, native apps, and browser. We’re rolling this out to all Perplexity Max subscribers and everyone on the waitlist starting today.

English

766

1.3K

13.8K

13.4M

jason@frenjason·14 Nis

@milindlabs @FarzaTV @Microsoft Have you tried using the accessibility api to do object detection?

jason@frenjason

Clicky inspired me to share This. This is a new way to interact with Claude Code. Just point and speak. I use it all the time. It’s also open source.

English

Milind S@milindlabs·14 Nis

I took Clicky and I made it 5x Faster So I saw that @FarzaTV was using uses Claude's vision to find UI elements on screen, send a screenshot, wait for coordinates back. It works, but it's slow. I replaced that with OmniParser V2 by @Microsoft which is a local Object detection model trained specifically on UI elements. It runs on-device, detects every button, menu, and icon in 400ms, and gives me pixel-precise coordinates. No API call, no latency, no cost. The green highlights you see around the UI elements is the detection overlay and you can see as I am switching the screen it takes no time to detect and highlight which is pretty neat! With Local models improving by the day, Its the right direction for applications like these. Next up: video-synced tutorials where a YouTube tutorial pauses and waits for you to perform each action in the real app. I am not stopping!

English

1.5K

71.2K

jason@frenjason·8 Nis

github.com/jasPreMar/this

ZXX

157

jason@frenjason·8 Nis

Clicky inspired me to share This. This is a new way to interact with Claude Code. Just point and speak. I use it all the time. It’s also open source.

Farza 🇵🇰🇺🇸@FarzaTV

I built this thing called Clicky. It's an AI teacher that lives as a buddy next to your cursor. It can see your screen, talk to you, and even point at stuff, kinda like having a real teacher next to you. I've been using it the past few days to learn Davinci Resolve, 10/10.

English

4.2K

jason@frenjason·8 Nis

this.do

ZXX

165

jason@frenjason·27 Haz

@TodePond omg absolute legends

English

Lu Wilson@TodePond·26 Haz

can't believe this works

tldraw@tldraw

make real but backwards

English

3.3K

jason@frenjason·30 Nis

@OrionReedOne @tldraw imagine this as “time machine” on shape selection, click it and scrub through versions

English

Orion Reed@OrionReedOne·29 Nis

projecting time into the third dimension in @tldraw Repo: github.com/OrionReed/tldr… Play with it: orionreed.github.io/tldraw-3d/

English

11.7K

jason@frenjason·13 Nis

@hobdaydesign object modeling

English

Anthony Hobday@hobdaydesign·12 Nis

If a new designer asked you to suggest ONE thing they could do to quickly improve their interface design skills, what would your answer be?

English

32.8K

jason@frenjason·5 Nis

@EmyLascan Inter for body. Feels like it’s faster to read, maybe denser

English

Emy@EmyLascan·4 Nis

Recently I replaced Inter with Geist ← Inter | Geist → Which one?

English

458

68.9K

jason@frenjason·4 Nis

@alpennec imagine you go swipe to dismiss and it scrolls up instead

English

106

Axel Le Pennec@alpennec·4 Nis

In #SwiftUI, is there a way to present a sheet whose height is based on the content size, using detents? And if the content doesn't fit, it would be placed in a scroll view (not enough space/dynamic type size). I want to replicate rounded sheets used by iOS. Any idea?

English

259

87.8K

jason@frenjason·4 Nis

@kylegawley I'm a designer not a dev but I think it's: 1. Tokens - Define primitives, not styles 2. Visible - Style is in-line with content. no need to reference another file) 3. Transferable - New to the team? No need to learn bespoke classes. 4. Works well with AI code completion

English

Kyle Gawley@kylegawley·4 Nis

I've never understood the appeal of Tailwind The power of CSS is reusable classes Style once → apply anywhere Modifying a Tailwind style means doing a find and replace on 100s of instances of an HTML object What am I missing?

English

616

1.6K

706.3K

jason@frenjason·13 Mar

@rahulchhabra07 there’s another situation where you don’t need scale, clean code; or maintenance, and that’s when you make apps for yourself. the more ppl make apps for themselves, the less they need people to do it for them

English

Rahul Chhabra@rahulchhabra07·12 Mar

Devin is alright for quick demos that don’t need to be maintained or scaled but all serious projects require lot lot more. Writing code is a trivial part of software engineering. The meat of the job is working w all the constraints that comes around building things w technology w people and for people. The optimal software dev via ai assistance is still a chatgpt interface of chat and ai generated code snippets along with explanation and details. Most people who are flooding twitter feeds by calling it software dev killer are actually telling on themselves and should write more code and build more stuff. Software dev isn’t akin to either self driving or making art in the sense that driving doesn’t involve creativity, just path finding and art doesn’t need to be absolutely precise to be meaningful. It’s wayy harder to automate software developers and extrapolating on one isolated dimension is honestly a common fallacy for most of twitter posters.

English

122

1.3K

303.7K

jason@frenjason·7 Mar

@alanlaidlaw Did a prompt experiment recently where one llm was a compressor and other was decompressor. Fed in recently written story, got compact gibberish out (<30% original length). The interpreter was good at retrieving conflict, narrative, characters, and even reconstruct the story.

English

Alan Laidlaw@alanlaidlaw·6 Mar

What if sci-fi got it backwards. LLMs lead to universal translators which leads an explosion of new natural languages. Not universal or planned languages. Not interface two-steps or code words. Natural, but weird, pidgin dialects.

English

1.1K

jason@frenjason·2 Mar

@soren_iverson Wait don’t/didn’t Facetime group video do exactly that?

English

1.9K

Soren Iverson@soren_iverson·2 Mar

Google Meet dynamically increase the size of your video based on how much you talk during a meeting

English

481

17.3K

783.5K

jason@frenjason·26 Kas

@tylerangert @RobertHaisfield In the same universe as this

yoshiki@yoshikischmitz

An idea I've been toying with to make file-based notes(aka "a folder full of text files") nicer: A hybrid file browser/window manager. Point it to a folder, and for each file in there it will open a window w/ a program appropriate to the file's extension, laid out in a column.

English

Tyler Angert@tylerangert·12 Tem

what if you could open *any* folder as your desktop? your desktop should just be a folder visualizer, not tied to one arbitrary folder called "desktop"

English

301

jason@frenjason·26 Kas

@RobertHaisfield This work is brilliant, I’m crushed.

English

388

Rob Haisfield@RobertHaisfield·25 Kas

Just learned that Yoshiki has passed away and so many people seem to love his ideas, I’m gonna thread a few here. An app builder on the iPhone where you start by describing the data structures you want in JSON and then nudge it towards a GUI

yoshiki@yoshikischmitz

I've been jamming on this concept for making data-driven designs. Given some JSON, this app will provide you with an interface to describe how you want each entry styled, allowing you to gradually create a more complicated design. Here I create an airbnb-ish app.

English

274

59.8K

jason@frenjason·26 Kas

@brijanp Same reason devs hate “it’s not working”, bc you can’t debug that

English

192

jason@frenjason·24 Kas

@tldraw @steveruizok 💸

QME

166

tldraw@tldraw·24 Kas

oh no

GIF

English

156

18.4K

tldraw@tldraw·24 Kas

arrows

GIF

English

574

105.4K

jason@frenjason·24 Kas

@ylecun @DrJimFan @RichardSSutton Team active inference?

English

Yann LeCun@ylecun·23 Kas

Animals and humans get very smart very quickly with vastly smaller amounts of training data. My money is on new architectures that would learn as efficiently as animals and humans. Using more data (synthetic or not) is a temporary stopgap made necessary by the limitations of our current approaches.

English

311

566

5.4K

Jim Fan@DrJimFan·23 Kas

It’s pretty obvious that synthetic data will provide the next trillion high-quality training tokens. I bet most serious LLM groups know this. The key question is how to SUSTAIN the quality and avoid plateauing too soon. The Bitter Lesson by @RichardSSutton continues to guide AI development: there’re only 2 paradigms that scale indefinitely with compute: Learning & Search. It’s true in 2019 at the time of writing, true today, and I bet will hold true till the day we solve AGI. incompleteideas.net/IncIdeas/Bitte…

English

138

287

2.5K

1.6M

Keşfet

@perplexity_ai @milindlabs @FarzaTV @Microsoft @TodePond @OrionReedOne @tldraw @hobdaydesign