Elastic

10.4K posts

Elastic banner
Elastic

Elastic

@elastic

Where developers learn, build, and share. Your source for hands-on demos, cheat sheets, explainers and more.

Global Katılım Ekim 2009
183 Takip Edilen65.6K Takipçiler
Elastic
Elastic@elastic·
Binary quantization sounds like it should tank recall. BBQ in Elasticsearch doesn't due to its asymmetric nature. Vectors compress to single-bit values. Queries stay at int4 precision, so distance calculations keep the detail that matters. You trade a bit of oversampling and reranking for an approximately 95% storage reduction. Trade-off: queries cost slightly more to compute per comparison. Storage costs don't move at all.
Elastic tweet media
English
3
4
15
1.5K
Elastic retweetledi
Elastic Security Labs
Elastic Security Labs@elasticseclabs·
7 trojanized repos targeting developers. Zero detections across every AV vendor. Elastic Security Labs is tracking a new Contagious Interview campaign (REF9403) where DPRK-aligned actors distribute fake coding challenges through Slack job postings. The repos masquerade as real Next.js e-commerce projects. The code was copied from a legitimate template called GoCart. The difference is steganography. Base64 payload fragments are hidden inside HTML comments in SVG flag images. A script reassembles them alphabetically, decodes with a custom function, and runs on server start. What deploys: - Credential stealer targeting 25 crypto wallet extensions plus browser login data - File stealer scanning for .env, .pem, .ssh, .aws, documents, images, shell history, and source code - Socket. IO RAT providing real-time interactive shell access - Clipboard stealer polling every 500ms, plus a Windows dropper downloading 3 disguised executables from the C2 Full analysis from Elastic Security Labs by @danielstepanic : go.es.io/4fqEhgp
Elastic Security Labs tweet media
English
1
23
60
2.8K
Elastic retweetledi
JP Hwang
JP Hwang@_jphwang·
I just wrote and recorded a video about how to perform vector search --- on 🎞️ video clips, by how they *look*! It means you can find scenes by what's *on the screen*, without expensive tagging. (Because, actually, a lot of video search is actually metadata-driven text search!)
JP Hwang tweet media
English
2
2
7
787
Elastic
Elastic@elastic·
Storing full 1024-dim vectors for every modality wastes storage. Matryoshka representation learning ranks signal into the first dimensions, so truncating a vector doesn't mean losing everything. jina-embeddings-v5-omni inherits this from v5-text. Truncate to 32, 64, 128, up to 1024 dims, same embedding, no retraining or re-embedding required. Text, image and audio hold up well even at the smallest sizes. Video is the one modality that wants the higher end of the range.
Elastic tweet media
English
1
5
15
1.4K
Elastic
Elastic@elastic·
15-minute live demos, Q+A. Every week. Starting tomorrow. Relevance Please is a new weekly livestream: demos across Search, Observability, and Security with rotating hosts and rotating topics. First up: @_jphwang on Making Video Search Easy. Join us tomorrow, 11AM ET / 8AM PT / 4PM BST. Links in the reply below.
English
1
2
18
459.4K
Elastic
Elastic@elastic·
Let's put it all together. What happens when I search for "the best wood fired neapolitin pie"? - “the best wood fired neapolitan pie” (original query) - “(t̶h̶e̶) best wood fired neapolitan pie” (stop word removal) - “(t̶h̶e̶) best wood fire(d̶) neapolitan pie” (stemming) - “(t̶h̶e̶) best wood fire(d̶) neapolitan (p̶i̶e̶)pizza” (synonym expansion)
English
0
0
3
450
Elastic
Elastic@elastic·
5. An inverted index is the main data structure for search, working like a hash map. It creates a 1-to-many mapping between a term, and the documents where that term appears. This is why text analysis is performed on your documents at index time AND on your search query at query time to ensure a match on analyzed terms. When the analyzed query terms [wood, fire, pizza] are sent to the inverted index, the index returns a list of document IDs (the postings list) for each individual term. These lists are then combined to retrieve the documents that match the query.
English
1
0
3
466
Elastic
Elastic@elastic·
🧵 Your search query gets rewritten before it ever matches a document. Tokenization, stop words, stemming, synonyms: 4 steps sit between what you type and what gets looked up. Here's what each one does
Elastic tweet media
English
6
7
80
1.5M
Elastic
Elastic@elastic·
We went back to the full Elasticsearch vs Qdrant benchmark exchange. Traced every number to a cause. Same hardware. 21M vectors. The disk sat at 0 IOPS the entire run. io_uring and prefetch got the headline. Neither moved the number. You can't be bottlenecked on a device you never read from. Matched on setup, both engines land around 56 QPS at 0.96 recall. The setup choices explained the multipliers, not the engines. Here's what we found: go.es.io/3SY0dbb
Elastic tweet media
English
2
5
16
2K
Elastic
Elastic@elastic·
Search feels simple until you start getting back irrelevant results. Know which of these 3 retrieval strategies to reach for a furniture store site: - BM25 matches exact terms. Finds an ottoman from "Product ID 43926". - Vector matches meaning. Figures out what "padded stool for my feet" actually refers to. - Hybrid runs both. Exact SKUs and vague descriptions in the same query. BM25 for known items. Vector for descriptions. Hybrid when you can't predict which. There is no one-size-fits-all solution.
Elastic tweet media
English
2
3
11
2K