StreamingFast ⏫ retweetledi
StreamingFast ⏫
1.3K posts
StreamingFast ⏫
@streamingfastio
Accelerating The @Graphprotocol. Firehose and Substreams core devs.
Canada Katılım Ocak 2021
594 Takip Edilen13.8K Takipçiler
StreamingFast ⏫ retweetledi
StreamingFast ⏫ retweetledi
Kudos to the @streamingfastio team for continuing to make Substreams faster and faster.
The team is doing great work to support the @graphprotocol
StreamingFast ⏫@streamingfastio
Substreams on @graphprotocol is getting even faster! The SQL sink (substreams-sink-sql) and core substreams-sink have been refactored to use the new V4 Blocks Streams protocol + S2 compression (replacing GZIP). What’s new? V4 protocol: Switches to repeated BlockScopedDatas → enables batching of blocks from server to client (only during catch-up/backfill). S2 compression: Up to 30% better ratios than GZIP + 7–10× faster CPU-wise. Real gains Batching + S2 → up to 30% extra compression (vs. old 2–4% without batching). Result: Much faster sink times — especially historical reprocessing & initial syncs! Update now to take advantage: Substreams CLI & libs → latest substreams-sink-sql → latest These are live on StreamingFast endpoints — clients auto-negotiate. Faster indexing awaits! Check the changelog: github.com/streamingfast/…
English
Substreams on @graphprotocol is getting even faster!
The SQL sink (substreams-sink-sql) and core substreams-sink have been refactored to use the new V4 Blocks Streams protocol + S2 compression (replacing GZIP).
What’s new?
V4 protocol: Switches to repeated BlockScopedDatas → enables batching of blocks from server to client (only during catch-up/backfill).
S2 compression: Up to 30% better ratios than GZIP + 7–10× faster CPU-wise.
Real gains
Batching + S2 → up to 30% extra compression (vs. old 2–4% without batching).
Result: Much faster sink times — especially historical reprocessing & initial syncs!
Update now to take advantage:
Substreams CLI & libs → latest
substreams-sink-sql → latest
These are live on StreamingFast endpoints — clients auto-negotiate.
Faster indexing awaits! Check the changelog: github.com/streamingfast/…
English
QME
@LefterisJP @ngotchac @base @etherscan @RouteScan What kind of indexing are you doing? Have you looked into Substreams/Firehose?
English
I hate @base with a passion. It's the chain that does not care about its ecosystem, its community and the tools used to interact and process it.
That means that tools like rotki end up getting bad data, or data ends up being unavailable.
Fix your shit.
English
StreamingFast ⏫ retweetledi
Want to try Substreams?
➡️Get an API key (no personal info required)
➡️Find a package in the Registry or write your own
➡️Choose your sink: Subgraph, SQL, PubSub, or direct streaming
The Graph@graphprotocol
Substreams lets you write Rust functions that transform blockchain data, then stream the output wherever you need it: To a SQL database. To aPubSub. Directly to your app or trading terminal. One pipeline, multiple destinations.
English
StreamingFast ⏫ retweetledi
BK (@brandonlkramer) rep’n The Graph at @solana mini-summit today… Solanaland loves Substreams 👀
English
The Graph Network 💪
Messari@MessariCrypto
State of @graphprotocol Key Update: The rollout of Graph Horizon positions The Graph as a modular, multi-service data protocol, laying the foundation for broader data services. QoQ Metrics -Active Subgraphs reached an ATH of 15.5k, ⬆️ 3% QoQ -Substream revenue hit a record high of 6.08 million GRT 💰 -Staked GRT increased for the first time in three quarters Check out the full report by @DrxlEth
English
Flashblocks are now available through the @graphprotocol's Substreams as a beta feature on @Base Mainnet! 🏁
And we’ve sped it up by 300 ms since the Alpha release! ⏭️
What does this unlock?
→ Access transaction data as soon as it’s sequenced (every 200ms)
→ Build more responsive applications and accurate predictions
→ Process transactions incrementally prior to block finalization
Your Substreams modules execute multiple times on the same block as new transactions arrive. The engine tracks what’s been processed and only sends new data and end-of-block notices.
Getting started:
✅Update to Substreams CLI v1.17.9+
✅Use --partial-blocks flag
✅Endpoint: base-mainnet.streamingfast.io
Note: Avoid block-level aggregations in your modules—work only with transactionTraces for deterministic output.
Try it out and share your feedback! We’re excited to hear how you use this.
Docs with example: docs.substreams.dev/reference-mate…
English
StreamingFast ⏫ retweetledi
Core Dev @graphprotocol
StreamingFast (@streamingfastio) Jan '26 Highlights 🔥
• Flashblocks now in beta on Base, early access for high-speed data
• Besu integration moved into third-party validation
• Monad extended blocks cleared internal testing
• Local-first Substreams dev setup now fully documented
• Open-sourced Substreams Skills for AI coding agents
• Postgres sinks upgraded with efficient delta updates
🔜 Next up: deeper latency cuts, compression boosts, Monad final validation, and polishing Flashblocks for full release.
Performance up. Friction down. Let’s keep building. 🚀
Full details 👇
forum.thegraph.com/t/streamingfas…
English
StreamingFast ⏫ retweetledi
5/ Want even more speed? Let your agent build Substreams. @streamingfastio
Substreams Skills = structured, plug-in tools for your coding agent → faster builds, way fewer bugs.
Grab it here: github.com/streamingfast/…
Efficiency on steroids.
English
StreamingFast ⏫ retweetledi
@streamingfastio is shipping Folks!
Introducing Substreams Sink SQL: Delta Updates (Postgres)
Delta update support to Substreams Sink SQL, making it much easier to build incremental aggregations directly in your database. github.com/streamingfast/… Why this matters:
Write aggregations like volume, counts, sums, min/max without reprocessing full tables
Apply atomic, incremental updates as new blockchain data arrives
Keep aggregation logic simple and SQL-native
Designed for Postgres workloads
This removes a lot of complexity around maintaining rolling or time-bucketed metrics on chain data.
If you want a concrete example, the repo includes a small Uniswap v4 candle demo showing what delta updates look like in practice. A practical reference for anyone building DEX analytics, dashboards, or trading infrastructure using Substreams on The Graph Network.
English
💻 Introducing Substreams Sink SQL: Delta Updates (Postgres)
We’ve added delta update support to Substreams Sink SQL, making it much easier to build incremental aggregations directly in your database.
👉 github.com/streamingfast/…
Why this matters:
✅ Write aggregations like volume, counts, sums, min/max without reprocessing full tables
✅Apply atomic, incremental updates as new blockchain data arrives
✅Keep aggregation logic simple and SQL-native
✅Designed for Postgres workloads
This removes a lot of complexity around maintaining rolling or time-bucketed metrics on chain data.
If you want a concrete example, the repo includes a small Uniswap v4 candle demo showing what delta updates look like in practice. A practical reference for anyone building DEX analytics, dashboards, or trading infrastructure using Substreams on the @graphprotocol.
Thanks to community contributor agg8829 in Discord for submitting a PR for this!
English
StreamingFast ⏫ retweetledi
Just shipped my @Polymarket orderbook Substreams using @streamingfastio's new AI Skills 🤖
Their Substreams-Skills feed context to AI coding agents, making development way faster.
Real-time order fills, market analytics & trader stats from Polygon.
substreams.dev/packages/polym…
English
Check out how to use our new Substreams Skill with your coding agent. Have an expert working alongside you, every step of the way.
GraphDevs@GraphDevs
Substreams Skills: Installation & Usage x.com/i/broadcasts/1…
English
🚀 Substreams Skills for Coding Agents
We just open-sourced Substreams Skills — a set of structured skills you can plug into your coding agent to build Substreams faster and with fewer mistakes.
👉 github.com/streamingfast/…
Which skills your agent gets:
✅ Opinionated guidance on Substreams manifests, Rust modules, and Protobuf
✅ Proven patterns for Substreams Sinks (Postgres & ClickHouse, key-value stores, files-based outputs, etc)
✅ Clear testing workflows (unit → integration)
✅ Real Substreams domain knowledge, not generic codegen
If you’re using an AI coding agent to speed up Substreams development, this gives it the context it’s been missing. ⚡
Building on the @graphprotocol has never been easier
English
StreamingFast ⏫ retweetledi
ICYMI: The Graph's Substreams supports @worldnetwork chain, providing fast access to historical and real-time data without relying on brittle infrastructure.
Blockchain developers can stream and process World Chain data with Substreams' parallelized, deterministic data pipelines.
The Graph@graphprotocol
The @graphprotocol’s Substreams now supports @worldcoin chain. Blockchain developers can stream and process World Chain data with Substreams’ parallelized, deterministic data pipelines. Substreams enables fast access to historical and real-time data without relying on brittle RPC workflows. This integration makes it easier to power DeFi, analytics, AI systems, and even mini-apps with World Chain data. If you’re interested, access the Docs below to get started now.
English
StreamingFast ⏫ retweetledi
