Port3 Network
3.9K posts

Port3 Network
@Port3Network
AI Agents. Your Way. Always. Join the community https://t.co/WP5aPm2JhJ

As data volumes and complexity grow, data engineers need scalable ways to build, manage, and optimize pipelines. 📕 The Big Book of Data Engineering covers proven patterns for scaling ETL, orchestrating data and AI workloads, implementing observability, and managing pipelines with Lakeflow. You'll also see how organizations across Healthcare, Financial Services, Retail, and Entertainment are building intelligent batch and streaming data pipelines. databricks.com/resources/eboo…

NVIDIA just open sourced Nemotron 3 Ultra. > 550B parameters (55B active/token) > 1M token context > 47.7 on the AI Intelligence Index > 300+ tokens/sec > Open weights, datasets & training recipes Open source AI just got a serious upgrade.

Introducing Kled-FD 0.1, the world's best fraud detection and dataset cleaning pipeline. The first all in one system capable of detecting AI generated content, near duplicates, stolen and plagiarized media, screenshots, manipulated and spliced content, NSFW and explicit material, minors and age sensitive content, sensitive and harmful content, and coordinated behavioral fraud rings. Kled-FD 0.1 has been battle tested across 1.2 billion uploads on Kled's data marketplace and is actively running quality checks on over 5 million uploads per day across image, video, audio, and text. Public benchmarks will be released soon. This is the first real step toward making data quality enforcement a humanless process.

Blackstone & Google launch $5B TPU cloud venture to bring 500MW of AI data center capacity online by 2027. "This joint venture ...helps meet growing demand for TPUs" - Google Cloud CEO: $CRWV: -5% PM $BX: +1% PM $GOOGL: +1% PM

The big dilemma with teaching an "LLM course" is that it is really easy to get drawn into teaching the various technical things like efficiency tricks, attention variants, PPO vs GRPO, etc etc. But the real "meat" is not there, but in the data: data for pre-training, for mid-training, for SFT, for RL and for "reasoning", synthetic data, curated data, annotated data... cleaning, evaluating, improving, mixing, ... lots of stuff. but "data" is so much harder to teach: it is not "mathematic" or "algorithmic" like the technical things, and it is not clear what is the teachable thing there. it is also a lot less transparent than the technical topics, both because it is semi-secret, and also because it is also not appealing for publishing, for roughly the same reasons it is not appealing for teaching. so, what would you teach about data? what are the key lessons and insights one should know? any good papers or resources? good existing classes? blogs? hit me with what you have











