Sabitlenmiş Tweet
gradually filling in the back catalogue on the personal site — hturan.com
English
harley turan
1.4K posts
harley turan
@hturan
exploring dimensionality 🎛️ ex principal eng @ cloudflare
London, UK Katılım Temmuz 2007
627 Takip Edilen13.1K Takipçiler
@DoninoTrading @GoogleDeepMind love this! will probably write something up about learnings r.e. embedding media vs text vs media & text together.
English
generated multi-modal embeddings of my bookmarks using @GoogleDeepMind’s new Gemini Embedding 2, allowing low-dim spatialisation using UMAP and high-dim similarity querying via different media types.
English
@patcon_ @poetengineer__ @DefenderOfBasic totally! there’s space here for a component library with inputs outputting a normalised 0 → 1 mapping which can then be adapted as needed. general feeling is that interactions like this benefit exploratory gestures rather than precision input, but i haven’t gone too deep.
English
@hturan @poetengineer__ @DefenderOfBasic Thanks Harley! Yeah, would def need to be extensible, like custom vs factory presets. Basic might be "dial logarithmically from 0 to 100 between bottom and middle of screen". But also could be more complex like "when I pinch and grab an imaginary knob and twist, x = 5*radians" 🤔
English
Anyone know of any FOSS kits that turn gestural motion into midi signals? Or anyone want to work on this, so we don't have to reinvent?
cc @poetengineer__ @hturan @DefenderOfBasic
x.com/hturan/status/… (harley also did an unpublished exploration of latent space of flowers)
Kat ⊷ the Poet Engineer@poetengineer__
imagining new interfaces for hand ✨
English
ok jarvis, let's make some shaders
AA@measure_plan
messing around with shaders hardly understand this math, but i'm so happy with how it turned out ahhhh it just keeps going
English
@jxnlco @dylan522p the ep-02's are great! wear them daily. i think these are the zodiac-02's though, thinner profile 🤓 gentlemonster.com/int/en/item/XP…
English
harley turan retweetledi
@lukasgjetting you're absolutely right! :) here's an example interpolating between all points in a polygon — x.com/hturan/status/…
harley turan@hturan
interpolating image embeddings across arbitrary numbers of vertices. using polygons as lenses through n-dimensional latent space.
English
@hturan are the interpolated images really embedded in the full latent space, though? if so, shouldn't the flower<>sunset images at 0:28 be turning more green as they approach the park pic?
otherwise it feels more like just a series of 1d interpolations
English
exploring paths through latent space by interpolating between known embeddings
English
@jxmnop ah totally! would love to experiment with this, i think output modality is what i'll play with next. especially for interpolating across multiple embeddings like this, creating a field of words.
x.com/hturan/status/…
harley turan@hturan
interpolating image embeddings across arbitrary numbers of vertices. using polygons as lenses through n-dimensional latent space.
English
@hturan no like paragraphs instead of images
u can use this: github.com/vec2text/vec2t…
English
interpolating image embeddings across arbitrary numbers of vertices. using polygons as lenses through n-dimensional latent space.
English
@trudypainter i've been in awe of your work over at @MakeGizmos! such a great concept, and beautifully executed.
English
@bee_human_ yeah, i’d love this! video too. time-based media is hard from an interaction perspective (would you place images at certain points on a timeline to steer the mood of a song?).
harley turan@hturan
@DanielleFong i’ve got it working across text and image modalities! end goal is really just high dimensional media as a way to pierce the curse of dimensionality. give me some solid ground to stand on in the latent space.
English
@DanielleFong i’ve got it working across text and image modalities! end goal is really just high dimensional media as a way to pierce the curse of dimensionality. give me some solid ground to stand on in the latent space.
English
AI imagining a continuously harmonious aesthetic space
can you generalize this to anything? i'm sure we will try
harley turan@hturan
exploring paths through latent space by interpolating between known embeddings
English
@MatthewWSiu yeah! i’ve got it working multiple times-dimensionally (interpolating across n points) and multimodally too. i haven’t tried it, but part of me thinks mixing too many sources would be like mixing too many pigments and you’d end up with nothing. curious to see!
English
@hturan this would be a fun way to explore your photo library as well, it'd prob be less continuous but still curious how it would feel
English
@prathyvsh to your original point (and on this theme!), @graycrawford's interaction design here is a good example of exploring unknown but related possibility space x.com/graycrawford/s…
gray ❄️🫧@graycrawford
🪸 image variation UI 🪸 pull out descendants, evolution via artful selection
English
@prathyvsh i've been toying with multimodal interpolation as a method of constraining a path within image diffusion models, and it's feeling like it's striking the balance well. blending between (semi) known points in visual possibility space.
English
Thinking of making a catalog of possibility space explorations soon. Are there any such examples of seeking through the adjacent possible in a latent space like this that has come across your attention?
tetsuo@tetsuoai
English