Andrea Soria Jimenez retweetet
Dataset Viewer for PDFs just landed on @huggingface 🤗
check all the document datasets on Hub🤝
English
Andrea Soria Jimenez
218 posts
Andrea Soria Jimenez
@andrejanysa
Software Engineer @huggingface 🤗
Bolivia Beigetreten Eylül 2013
755 Folgt157 Follower
📄 New on Hugging Face Hub: native PDF dataset support!
You can now render PDFs directly in the Dataset Viewer — with thumbnails, in-browser previews, and full integration with datasets + pdfplumber.
Perfect for document-based ML workflows →
huggingface.co/blog/asoria/pd…
English
@huggingface Link to the library: github.com/datadreamer-de…
English
🚀 Synthetic data is revolutionizing AI & ML!
DataDreamer, an open-source Python library, makes generating synthetic data seamless & integrates effortlessly with @huggingface . Easily push datasets to the Hub and share them with the community
🔍 Learn how: #6790671e20a7d3ca6f72b6cb" target="_blank" rel="nofollow noopener">huggingface.co/blog/asoria/da…
English
Andrea Soria Jimenez retweetet
You only need a few extra lines to write generated datasets directly to the @huggingface Hub.
Mahesh Sathiamoorthy@madiator
We are happy to announce Curator, an open-source library designed to streamline synthetic data generation! High-quality synthetic data generation is essential in training and evaluating LLMs/agents/RAG pipelines these days, but tooling around this is still entirely lacking! So we built Curator, and I think it has easily 10x'ed our productivity in creating post-training datasets! We are cooking a lot of good features and examples to be released in the future, so you don't want to miss this! 🧵More info below!
English
Andrea Soria Jimenez retweetet
Hugging Face is now officially in the pandas Ecosystem page 🎉
Let me know what you'd like to see next for HF + pandas
English
@huggingface 📚 Quick Tutorial: huggingface.co/blog/asoria/fa…
Italiano
Synthetic data generation has never been easier! 🎉
Generate structured output effortlessly with #fastdata and @huggingface 🚀
Steps:
1️⃣ Define your schema 📝
2️⃣ Add a generation prompt 💡
3️⃣ Input your data 🔄
4️⃣ Share it freely on Hugging Face 🌍
English
Andrea Soria Jimenez retweetet
Damn this is cool
Semantic operations for pandas dataframes using open models from @huggingface. Brought to you by @lianapatel_ and the LOTUS team at Stanford and Berkeley
Semantic search, Group by topic, Top K semantic sorting etc. with LLama 3.3 70B
English
Andrea Soria Jimenez retweetet
🤗 Datasets 3.2 is out !
With faster Parquet streaming (up to +100% speed) and faster filtering via predicate pushdown ⚡
Example: fast streaming of recent FineWeb-2 data from @huggingface
English
Andrea Soria Jimenez retweetet
@huggingface has released a new feature that makes interacting with datasets even easier. 🌟
Introducing the #Text2SQL feature for the SQL Console – now you can talk to your dataset like never before! 🗣️💻
English
Andrea Soria Jimenez retweetet
✨ How it works:
1️⃣ Define your output schema 📜
2️⃣ Craft your data generation prompt 🛠️
3️⃣ Prepare your inputs 🎯
4️⃣ Generate and push to Hugging Face Hub directly 🚀
English
🚀 Fastdata (by @answerdotai) + @huggingface: Synthetic Data Made Simple! 🤖📊
Generate data for deep learning 📜🛠️🎯 and push it directly to Hugging Face Hub 🌐. With Incremental Uploads, fastdata handles large-scale projects effortlessly!
English
💡 Pro Tip: With Incremental Uploads, fastdata can automatically push updates to the Hub every N minutes, making it perfect for large-scale synthetic data projects.
English
Andrea Soria Jimenez retweetet
My new app is out !!
✨The Common Crawl Pipeline Creator ✨
Create your pipeline easily:
✔Run Text Extraction✂️
✔Define Language Filters🌐
✔Customize text quality💯
✔See Live Results👀
✔Get Python code 🐍
Based on famous LLM research like Gopher, C4 or FineWeb
English
Andrea Soria Jimenez retweetet
🔥 Presentamos #LaLeadeboard, la primera leaderboard open-source para evaluar automáticamente #LLM en las variedades del español y lenguas oficiales de España y LATAM.
huggingface.co/spaces/la-lead…
Español
Andrea Soria Jimenez retweetet
There is now an LLM Leaderboard for one of the most spoken language worldwide: Spanish! 🚀
(+ Catalan, Basque and Galician)
Congrats to @mariagrandury for setting it up, and to @SomosNLP_ for gathering super high quality datasets from many partners!
huggingface.co/spaces/la-lead…
English