dataorc

Processing millions of transactions daily? 🚀 Ditched OLTP & Athena for Apache Spark + Hudi—now doing incremental updates instead of scanning 30TB+ daily. ✅ 90% cost savings ✅ Faster queries ✅ Better scaling Full breakdown: dataorc.medium.com/the-40x-soluti… #BigData #Hudi

✨ Our fresh new website is live, and it’s looking gorgeous—built effortlessly using @lovable with just a few prompts! 🚀 Check it out 👉 dataorc.in #AI #DataOrc #LovableDev

New blog: How ONDC secures open commerce network with cryptography! ✍️ By @Ad1tya97 🔑 Ed25519 + Libsodium for auth 📜 Public key discovery via registry 🔒 Asymmetric encryption at scale Exciting to see Open Networks secured strong! 🚀 #ONDC #Cryptography dataorc.medium.com/ondc-signing-a…

We used Postgres as a queue to handle extremely large payloads of data. It worked great for us, and we're seeing some great benefits. Check out our blog post to learn more: medium.com/dataorc/datapl…

What's common to @quickheal @dyte_io @helpshift & many more is a petabyte-scale, a battle-tested data platform. Here is our blog on how to handle petabyte-scale leveraging the industry's best data engineering practices medium.com/dataorc/buildi…

Upcoming blogs: 1. How we migrated our polling based ONDC apps to server side events 2. Signing and authentication in ONDC

We've been fortunate to be associated with @ONDC_Official since beginning. In coming weeks we'll be publishing series of blogs which will cover depths & breaths of ONDC, pls review our latest blog: "ELI5: What is ONDC & developers preview" dataorc.medium.com/eli5-what-is-o… #ondc #ecommerce

TIL: Embed collapsible markdown gist to reduce the size of code snippets used in #medium blogs. e.g. gist.github.com/mj-jadhav/e209…

@firesofmay @bargava Thanks @firesofmay, @bargava we are building dataplatforms for likes of Helpshift, quickheal, dyte.io, and Sql is central to our architecture, can we do short catch up, do checkout our blogs too at dataorc.medium.com

@bargava Talk to @DataOrc guys

I am looking for a data engineering consultant for 2 months. The person should help us create DB schemas (for OLAP) and build EL(T) pipelines. Python and SQL must. Looking for someone in India, Eastern Europe or SE Asia. Any recommendations?

We @DataOrc just published Google Maps Integration (regardless of which CRS it is) link.medium.com/ThM3BfYR2mb

read about massive parallel processing via #awslambda, our learnings, how did we end up with the huge bill, and yet it’s still our most favored mode of computing. #serverless #aws #terraform dataorc.medium.com/massive-parall…

used recently open-sourced cdk8s.io , though still miles to go but no #yaml handling, beautiful abstraction to build complex charts and build it in #Python3. check out one of our charts gist.github.com/navdeep710/6a3… #Kubernetes #byebyeyaml #AWS #k8s

scale of internet 101 blog.cloudflare.com/october-2021-f…

Loadbalancer of loadbalancer, for our across cloud deployment, we found cloudflare loadbalancer to be super quick to set up, intuitive and hassle free, #faulttolerant #cloudflare #cloudnative

I just published Scalable and Cost-effective ML Pipeline on Kubernetes medium.com/p/scalable-and…

Storage is cheap, querying is not! 🙂

Check out our latest blog on our Custom Serverless Data platform medium.com/dataorc/how-ou… architecture is so stable that the client has forgotten about the deployment :) #dataplatform #serverless #awscloud #terraform #clojure #startups

Startups against Covid, we are doing our bit Check out these useful resources from Startups vs COVID for startups in India who are solving challenges caused by COVID-19. startupsvscovid.com #StartupsvsCOVID #91springboard #Startups

If you love #Statistics and #cricket, this will make your day, @just22yards published an article on elo rating first time applied on ODI teams over the complete course of its history medium.com/dataorc/cricke… #cricketforall #analytics #cricketforlife