Stephen Macke

62 posts

Stephen Macke

@stephen_macke

Large-scale ML infra and tools for interactive data analytics | Maintaining https://t.co/wn77fzXje4 and https://t.co/jgkeoFwq3C | Previously @IllinoisCS, @ucbrise

Bellevue, WA Katılım Mayıs 2012

278 Takip Edilen155 Takipçiler

Stephen Macke retweetledi

Databricks@databricks·27 Mar

#DBRX, a new general-purpose LLM, is now available on Databricks Marketplace! Enterprises can use DBRX in RAG apps or to build a DBRX-style MoE model with their own data. Check it out to advance your AI initiatives. dbricks.co/43yPx3Q

English

8.7K

Stephen Macke retweetledi

Chris Holdgraf@choldgraf·22 Mar

Wow, @ProjectJupyter is the winner of the White House OSTP "Technical Advancement to Enable Open Science" category. Amazing to see recognition of the project at a national level! Makes me proud of the ecosystem of interconnected tools we've built. whitehouse.gov/ostp/news-upda…

English

257

29.4K

Stephen Macke@stephen_macke·25 Oca

@akshaykagrawal This is a pretty old issue, I believe stemming from changes to support top-level await (every module level statement now runs in it's own function). Also ran into it when trying to improve support for pdb in ipyflow. It doesn't manifest for breakpoints inside of functions.

English

Akshay Agrawal@akshaykagrawal·25 Oca

I just noticed that pdb no longer works for me in Jupyter, JupyterLab, or Colab. Looks like the linecache is messed up, pointing to ipykernel internals instead of the cell's code. Anyone else seeing this?

English

704

Stephen Macke@stephen_macke·24 Oca

@sh_reya You should do it. Totally valid as long as it's defined somewhere (e.g. Definition 1.2).

English

188

Shreya Shankar@sh_reya·24 Oca

writing as an academic is so annoying sometimes. i want to use the phrase "a ``galaxy brain'' approach" because it succinctly describes what i'm trying to say, and i know reviewers read memes, but instead i have to say something like "Moreover, an arbitrarily complex approach"

English

5.5K

Stephen Macke@stephen_macke·10 Oca

Excited that interactive dataflow and reactivity continue to gain traction with interfaces for data and scientific computing! Amazing how fast the folks at @marimo_io have made their tool one of the best out there for Python; lots of lessons to bring to github.com/ipyflow/ipyflow

Akshay Agrawal@akshaykagrawal

We've added an inspiration section to our README: #inspiration-" target="_blank" rel="nofollow noopener">github.com/marimo-team/ma… @marimo_io was inspired by @PlutoJL, which in turn was inspired by @observablehq. We've also remixed ideas from other reactive programming tools like @stephen_macke's ipyflow and @streamlit.

English

250

Stephen Macke@stephen_macke·5 Kas

@davidbrochart I like the black background and incorporating brackets and/or an execution counter somewhere, but I think filling the space at the top and bottom adds too much noise. What do you think about [jp]term?

English

David Brochart@davidbrochart·4 Kas

Small variation

English

273

David Brochart@davidbrochart·4 Kas

jpterm bootstrapping its own logo

GIF

English

1.6K

Stephen Macke retweetledi

Aditya Parameswaran@adityagp·29 Ağu

Also in the same session at 10:30, @sh_reya and @stephen_macke will present their work on making computational notebooks more production-ready, by applying program slicing techniques. Now you don’t need to compromise between experimentation and rigor. Take note, notebook cos.!

Aditya Parameswaran@adityagp

Slice away all the junk in your comp notebook! @sh_reya and @stephen_macke introduce nbslicer, a tool for better reproducibility of artifacts in notebooks (via reactive exec/backward slicing). Builds on @stephen_macke’s work on nbsafety (now called ipyflow) To appear at VLDB’23!

English

6.1K

Stephen Macke@stephen_macke·16 May

@thorstenball I have spent a long time trying to address this with github.com/ipyflow/ipyflow

English

970

Thorsten Ball@thorstenball·15 May

So, Jupyter notebooks... as a newbie, am I correct in assuming that the implicit global state has lead to one or two tears in the past?

English

24K

Stephen Macke retweetledi

Will McGugan@willmcgugan·11 Şub

I have a feeling these three sentences are not enough to prevent some nasty bugs. If you don't save a reference to an asyncio Task it could disappear at any time. Your code would stop running, but likely only when your app is under real load. Good luck figuring that out.

English

249

66.1K

Stephen Macke retweetledi

Ponder@ponderdata·23 Oca

📣 Introducing Ponder: Run #pandas on 1TB+ DIRECTLY in your data warehouse 🚀 Learn more below! 🧵[1/N] ponder.io/run-pandas-on-… #python #datascience #AI #database

English

165

85.7K

Stephen Macke@stephen_macke·23 Oca

@sh_reya @drewmikehead @sarahchasins @adityagp @sh_reya I still remember when you noticed the opportunity to improve notebook slicing by leveraging the runtime session information and how mind blown I was by the initial results. A simple idea with fantastic execution, and I couldn't be prouder to have been part of it.

English

102

Shreya Shankar@sh_reya·23 Oca

Finally I could not have asked for a better first DB research experience. Thanks to my collaborators: @stephen_macke for being an incredible mentor, @drewmikehead and @sarahchasins for their wisdom and guidance, and @adityagp as always for setting me up for success. Until VLDB!

English

1.8K

Stephen Macke retweetledi

Shreya Shankar@sh_reya·23 Oca

Notebook ML workflows have a lot of exploration & data wrangling, mixed w/modeling. Relevant artifacts (dataframe, model) are only a sliver of the workflow. So @stephen_macke & I developed nbslicer, a dynamic slicer for Python notebooks, built on ipyflow (github.com/ipyflow/ipyflow)

English

127

24.9K

Stephen Macke@stephen_macke·18 Oca

ipyflow 💖 ipywidgets Just put the finishing touches on the integration and really happy about how it turned out. Always felt like ipywidgets should be able to trigger cell execution in response to, e.g., slider adjustments -- with github.com/ipyflow/ipyflow, it's finally here!

GIF

English

1.9K

Stephen Macke retweetledi

Hamel Husain@HamelHusain·11 Oca

This demo youtu.be/SHs9PxiCdxM blows my mind: It stores the entire execution/dependency graph of variables in a notebook and snapshots it according to your specifications. It think that this could be used to build a better notebook that allows for instant time travel etc.

YouTube

Sean J. Taylor@seanjtaylor

@HamelHusain Have you checked out @lineapy_oss yet? It does a really extreme version of this, including linking all objects in the session to the code that produced them.

English

3.6K

Stephen Macke@stephen_macke·6 Oca

Probably will have to try running this again with a larger sample :)

English

105

Stephen Macke@stephen_macke·5 Oca

For computational notebooks with reactivity, the ordering of reactively executed cells should proceed

English

131

Stephen Macke@stephen_macke·3 Oca

@untitled01ipynb Can confirm, am going to hell for perpetuating with github.com/ipyflow/ipyflow

English

165

Rambam the grey@meowbooksj·3 Oca

HellFlow

English

2.8K

Stephen Macke@stephen_macke·3 Oca

@benjamin_bolte Nope but definitely agree that we're long overdue for a copilot-like experience for open source Jupyter notebooks / lab. A direction I'm really interested is to include the runtime dataflow state in the LM prompt to see if it improves code suggestions...

English

106