Mattias Wadman
495 posts

Mattias Wadman
@mwader
Likes animals, documentaries, bits and bytes. Also at @[email protected] (https://t.co/shxcvUNeFf)
Sweden Katılım Şubat 2009
242 Takip Edilen221 Takipçiler

Vous connaissez l'utilitaire jq pour manipuler des documents JSON ? Et bien voici fq, un utilitaire proposant des fonctionnalités analogues mais pour des fichiers binaires de formats très différents (mp3, gif, etc ...). A avoir dans sa toolbox ⬇️
github.com/wader/fq
Français

@manic_pixie_agi @morphillogical Strange, have an example? jq should not require new line between values, any whitespace or even no separator is needed in some cases
English

@DomWitczak @__femb0t there is a game of life video filter so yes i guess :)
English

@MuskratElno @FFmpeg @type They might be doing new and nobel things but i would guess open source is what makes that even possible
English

@FFmpeg @type $ yt-dlp -qf hls-636 rumble.com/v5mw93e-jhank-… --output - | ffmpeg -v quiet -i pipe:0 -c copy -f h264 - | fq -Vrd avc_annexb 'grep_by(.nal_unit_type=="sei").sei.data'
x264 - core 164 - H.264/MPEG-4 AVC codec - Copyleft 2003-2023 - videolan.org/x264.html - options: cabac=1 ref=5...

@FFmpeg $ yt-dlp -qf hls-636 rumble.com/v5mw93e-jhank-… --output - | mediainfo --Output=JSON - | jq -r '.media.track[] | select(."@type"=="Menu").ServiceProvider'
FFmpeg
🤔
English

@TheYasinSpace Hey, you can probably do all of it in jq if you want:
jq -Rs 'split(".")[1] | @base64d | fromjson'
English

fq seems like an interesting tool - inspired by jq for exploring files and binary formats github.com/wader/fq
English

@HSVSphere @sasuke___420 Mostly shell but it’s used as a query/transform language is a bunch of services
English

@sasuke___420 Not exactly. Where else is jq used outside of POSIX shells?
English


@Jeffinatorator @lemire The decnum one? Could try build jq without decnum support and i think it will use something from libc but not sure. Maybe also try gojq or jaq, might be faster.
English

Redis is a popular in-memory data structure store that can be used as a database, cache, and message broker.
A few hours ago, Redis has adopted the fast_float C++ library for faster number parsing. It lead to performance gains of up to 25% in some instances.
Number parsing comes up ridiculously often as a bottleneck.
The fast_float C++ library is used by WebKit/Safari, GCC (glibc++), Chromium (Chrome and other browses). Other systems have adopted the same algorithm with an independent implementation: LLVM, Rust, C# (.NET), Go and many other systems.
Reference: Number Parsing at a Gigabyte per Second, Software: Practice and Experience 51 (8), 2021

English

@sasuke___420 @haskuya jaq has some jq benchmark stuff, might be interesting also #performance" target="_blank" rel="nofollow noopener">github.com/01mf02/jaq?tab…
English

@sasuke___420 @haskuya someone should! there is github.com/jdroob/cjq but it's not very practical (yet)
English

@haskuya great, you can compile the jq language and i'll make the internal representation for the json documents
English

@JammUtkarsh ☺️ is nice if you spend a lot of time debugging and transforming binary and text formats!
English












