Jagane Sundar

@Mascobot @a16z Nice, @mascobot - at OXMIQ, we did a similar project. We took it one step further - we overcame the 2 PCIe GPU limitation enforced by NVIDIA NCCL so that you can use all 384 GB to load a single model - oxmiq.ai/blog/4blackwell

🚨 New: We built @a16z's personal GPU AI Workstation Founders Edition - 4x NVIDIA RTX 6000 PRO Blackwell Max-Q (384GB total VRAM) - 8TB of NVMe PCIe 5.0 storage - AMD Threadripper PRO 7975WX (32 cores, 64 threads) - 256GB ECC DDR5 RAM - 1650Watts at peak (runs on a standard 15Amp/120V circuit). For training, AI research, and deploying models locally. A datacenter-class AI rig you can keep under your desk. We are planning to make a limited number of these a16z AI Workstations. Build guide + how you can make your own 👇

Four 96GB RTX6000 Blackwell GPUs in a workstation. 384GB of memory, now this is serious AI horsepower! oxmiq.ai/blog/4blackwell #blackwell #rtx6000 #deepseek32 #opencode #aider #oxmiq #nvidia

Google Vertex AI vs Google Gemini API Building a RAG Chat application using Google’s Gemini model. Two ways - Generative AI on Google Vertex AI (cloud.google.com/vertex-ai/ge...) and Gemini API (ai.google.dev/api?lang=pyt...) Vertex AI API better for production - linkedin.com/posts/jagane-s…

OpenAI O1 Model Token Count Explodes when Reasoning DeepLearning.AI has a free course on Reasoning with o1 presented by Colin Jarvis that is worthwhile. User tokens=15, Reasoning tokens=1152, generated tokens=121!

New Medium Article: Hadoop/HDFS Events to SQS in real time Hello all - I just finished writing a new article on medium. As the title indicates, I show how to send a stream of HDFS events (create, close, append, metadata, etc. to AWS SQS - jagane-sundar.medium.com/hadoop-hdfs-ev…

ChatGPT is super cool, but it can still get facts very wrong, like this example we used in 2021 (hai.stanford.edu/news/moderate-…). It even generates a second wrong fact (not named after governor). LLMs probably need to use tools like retrieval to avoid being BS-as-a-service.

Announcing MLflow Parallels - open source project for running AI compute in Kubernetes Develop and run complex AI workloads in Kubernetes and log in MLflow. Bridge MLflow and K8s! No arcane k8s or docker knowlege required mlflow-parallels.org #mlflow #kubernetes #ai #ml

HIPAA for AI Data with InfinStor MLflow - interested? Sign up for my Wednesday Jul 27 @ 11 Pacific webinar: us06web.zoom.us/webinar/regist… #mlflow #ai #hipaa #databricks #sagemaker #azureml #MLOps

Here's a really good book on MLflow - Practical Deep Learning at Scale with MLflow amazon.com/Practical-Deep… #mlflow #databricks #infinstor #azureml #sagemaker #mlops

MLflow is a terrific ML experiment tracking system, but it does not manage S3 credentials for artifact storage, i.e. you need to distribute S3 access keys separately. Our product InfinStor MLflow solves that problem #mlflow #infinstor #azureml #databricks

Regulatory compliance, e.g. HIPAA, while using data for AI requires sophisticated tools - InfinStor MLflow. If this is interesting to you, attend my Jul 27 webinar 'HIPAA Compliance for AI Data Using InfinStor MLflow' us06web.zoom.us/webinar/regist… #mlflow #HIPAA #TensorFlow #PyTorch

I'm presenting a webinar titled 'HIPAA Compliance for AI Data Using InfinStor MLflow' on Jul 27 @ 11 AM Pacific. If this interests you, please signup at: us06web.zoom.us/j/5632556801?p…

Automatically record jupyterlab runs to MLflow - cool open source project by @jnathp #mlflow #Jupyter #sagemaker #infinstor #databricks #azureml #snowflake

Why choose MLflow over other proprietary ML Experiment tracking systems? Because - a new version of pytorch or tensorflow or any other ML library will not break compatibility with your ML tracking system! #mlflow #infinstor #databricks #sagemaker #azureml

'Data is the new oil' is old news. 'AI models are the new oil'. Try MLflow - it is a terrific open source tool for managing models. #mlflow #mlops

thisa

The Power of Data Journalism harvardpolitics.com/covers/power-d… via @harvardpolitics

GOP Strategy Fails to Draw Youth Approval harvardpolitics.com/united-states/… via @harvardpolitics

@DowJonesSupport - email me at jagane@sundar.org

@DowJonesSupport - Once I uninstalled the wsj app and restarted my iPhone and iPad the apps all updated fine