Ibis

1.1K posts

Ibis banner
Ibis

Ibis

@IbisData

Expressive analytics in Python at any scale. Questions? Join the discussion at https://t.co/gSgMkpaBEm

Katılım Temmuz 2009
27 Takip Edilen4.9K Takipçiler
Sabitlenmiş Tweet
Ibis
Ibis@IbisData·
Ibis offers an API similar to @pandas_dev to connect to SQL databases and big data systems. More info: ibis-project.org
English
3
21
87
0
Ibis
Ibis@IbisData·
Ibis 10.0.0 is out! pip install ibis-framework==10.0.0 Lots of new features, bug fixes and two new backends: Amazon Athena and Databricks! Check out the release notes here: #10.0.0" target="_blank" rel="nofollow noopener">ibis-project.org/release_notes#…
English
0
7
18
1.2K
Ibis
Ibis@IbisData·
With the latest version of @pyodide (0.27.1), you can run %pip install ibis-framework[duckdb] to get an expressive, lightning-fast, and *entirely-in-browser* dataframe API! Give it a try at ibis-project.org/tutorials/brow…
English
0
1
12
500
Ibis retweetledi
Dewey Dunnington
Dewey Dunnington@paleolimbot·
First blog post in a long time! I started writing a post ~2 years ago on adventures counting 130M U.S. buildings by zipcode and finally circled back to write it up. Everybody is a winner really, but @duckdb @IbisData , @ApacheArrow, and @GeoParquet were essential throughout!
Dewey Dunnington tweet mediaDewey Dunnington tweet media
English
2
11
53
3.7K
Ibis retweetledi
Naty Clementi
Naty Clementi@ncclementi·
Hi y'all, I'll be talking at #DuckCon on January 2025. I'll be sharing how to leverage the power of @duckdb's geospatial capabilities while staying within the Python ecosystem using @IbisData . I’ll show you how to work with GeoParquet data and create nice maps in your laptop.
Naty Clementi tweet media
English
1
5
28
2.2K
Ibis retweetledi
marimo
marimo@marimo_io·
no code transformations using marimo's mo.ui.dataframe and @IbisData! Pass in any Ibis dataframe to mo.ui.dataframe to display a UI for different filters/transformations and get the filtered result back in Python. Plus, you can see the SQL statement generated by Ibis!
English
0
3
16
1.4K
Ibis retweetledi
ABC
ABC@Ubunta·
The "Tools don't matter" argument falls flat in Data Engineering and ML. - Working with large datasets on a Spark cluster can quickly shift your focus from business problems to infrastructure challenges. - Using Pandas for 10GB+ data demands huge RAM, but switching to @duckdb or Polars can handle it with much less. - Orchestrating 50+ jobs with Airflow is great, but for a few offline tasks, cron can do the job without the overhead. - Assuming all SQL is the same was a major mistake for me: different databases aren't always interchangeable, and I now appreciate @IbisData . Don't underestimate the learning curve of new technologies. Choosing the right tools requires careful consideration of your team's stack and needs. Let the team explore before deciding, but never assume switching tools is easy—it’s not.
English
3
3
74
6.4K
Ibis
Ibis@IbisData·
Want to work with Python dataframes on a trillion rows of data in someone else's high-performane OLAP database? Check out our latest blog using Ibis, @ClickHouseDB , and Shiny for Python to build an interactive dashboard on the PyPI downloads dataset: ibis-project.org/posts/better-p…
English
0
3
35
4.1K
Ibis
Ibis@IbisData·
@mim_djo We'd be happy to collaborate on better support for Fabric!
English
0
0
4
80
Ibis retweetledi
Mim
Mim@mim_djo·
@IbisData support is very rudimentary but you can connect to #microsoftfabric DWH, list catalog, run sql etc
Mim tweet media
English
1
3
6
1K
Ibis retweetledi
Mim
Mim@mim_djo·
end of an era, for new project think seriously of using a new Dataframe Engine, there are plenty of choices, ibis will drop support for Pandas ibis-project.org/posts/farewell…
English
7
14
105
12.6K
Ibis retweetledi
ABC
ABC@Ubunta·
Here are a few reasons why I prefer using Ibis over Pandas/@DataPolars ( bdw I still use Polars or Data Fusion as the engine ) - @IbisData is lightweight and directly executes queries on the underlying databases, functioning more as a result transporter than a heavy framework. - While Ibis may be relatively new, the code it generates is notably cleaner compared to SQLAlchemy. - If you've ever encountered debates about switching databases or complaints about database costs, Ibis renders these discussions irrelevant. You can switch databases without needing to change your code, everything stays exactly the same. - As for concerns about Ibis falling behind or its open-source model changing, I'm focused on the present. Right now, Ibis offers a fantastic, lightweight interface. And who knows? In the future, AI might take over everything anyway! 😁
English
1
3
14
1.4K
Ibis retweetledi
Evgeny Ivanov
Evgeny Ivanov@e10v_me·
The other popular choices are Confidence and Ambrosia. They slightly differ in features: tea-tasting covers some methods not covered in these packages, and vice versa. Ultimately, tea-tasting aims to cover all the essential methods. But the biggest difference is the support for a wide range of data backends, including BigQuery, ClickHouse, PostgreSQL/GreenPlum, Snowflake, Spark, and Pandas—all thanks to @IbisData. tea-tasting optimizes computational efficiency by calculating aggregated statistics in the user's data backend.
Evgeny Ivanov tweet media
English
1
1
2
452
Ibis retweetledi
Ethan
Ethan@ethanf_17·
I’ve been really impressed with @IbisData so far. Modern data stacks need to be flexible passing data between @PostgreSQL, dataframes, and analytics dbs like @duckdb or @ClickHouseDB. Super helpful to have one common query language connecting these data sources
English
1
3
13
1.1K