Kingsley | Data Engineer

#AWS Data Engineers only Take a careful look at this architectural design for a Lakehouse #data #pipeline and tell me if anything is wrong with it. Let’s see your option in the comments session

So the aim is not to build a pipeline that cannot fail. It is to build a pipeline where failure is expected, contained, detected, explainable and recoverable. So my questions to #dataengineers is; How is that data pipeline going?

➡️ A perfect pipeline is not one that never fails. ➡️ A perfect pipeline is one that fails safely, fails visibly, recovers predictably, protects data quality and does not surprise the business #datapipeline #data #engineer #dataanalysis

NO SUCH THING AS PERFECT DATA PIPELINE THAT WILL NEVER FAIL, NEVER BREAK, & NEVER NEED INTERVENTION The language we speak are mature, resilient, observable, self-healing and Low-drama data pipeline. That is the real world version of pipeline utopia For Data Engineers:

@hasyimibhar Interesting. I saw pg2iceberg during my research, only that we are fully #aws native Management likes #msk. Howbeit, I will take a strong look at it Thank you

@RealDekings You can further reduce cost by removing MSK altogether, just use pg2iceberg: pg2iceberg.dev. There is also the cloud version I'm building, which is still in early access: polynya.dev

Two months ago I started designing and implementing our strategy for migrating our data infrastructure from a batch processing pipeline to stream processing pipeline. After fort and back with #AWS we settled for Postgres >> MSK >> S3 Table Bucket #amazonmsk #iceberg #s3 #amazon

Google #bigquery Azure #synapseanalytics and Amazon #redshift These are high performant columned based #datawarehouses but they are not really pocket friendly for #small #businesses Do you think #duckdb hosted in an #ec2 can be a better option & more cost efficient for #sme

Which market is bigger and which has more opportunities for #dataanalyst Googlesheets vs Microsoft Excel

@Eyowhite3 Actually, NO You don’t need all five of them with XLOOKUP, you can comfortably filter out VLOOKUP & HLOOKUP In 2026, if I were to start learning #excel, I wouldn’t pay attention to VLOOKUP & XLOOKUP XLOOKUP has it all

The only Excel LOOKUPS you need.

@IfeyOkoli You portfolio page in GitHub is amazing You have done a great job Can you consider using a more professional picture? I see you are a Pharmacy student, this is a plus for you, now instead of trying to be a Data Analyst(Generalist) can you consider Healthcare Data Analyst?

Finally done with my portfolio Hosted on GitHub What do you think? ifexxx-dat.github.io

@Femiforge Most of #microsoftexcel experts mostly have domain level of function level expertise You basically rate your expertise in #excel based on using it for #dataanalysis #modeling #webapp #scripting and more. #excel is very massive

How would you rate yourself in Microsoft Excel ? A. Master B. Professional C. Intermediate D. Beginner

If Your Dashboard Consumers Need You For Clarity, Then You Didn’t Build a Dashboard. You Just Built a Clutter. #data #dataanalytics #analytics #datanalyst #datanalysis

#awssummit26 fully activated Interesting knowledge sharing, showcasing of products. I can see intentional push towards #agentic #ai in every session, including #dataengineering What is truly the future of work in a world where companies are pivoting towards #ai #agents?

AWS London 2026 Event Loading… #aws #awslondon #awsevents #redshift #athena #s3

Revolution destroys the perfect before they enable they impossible — From the stable of Seth Godin As a #data #engineer, what challenges are you experiencing from that supposed perfect technology? Perhaps it is time to declare revolution on that technology #awssummitlondon

That feeling when it’s Friday and there are no carryover bugs to fix on Monday. Enjoying the beautiful landscape of #Lancaster #aws #amazonMSK #iceberg #s3 #s3tables

@officialladi_T My advice and flow has always been #Excel #PowerBI #SQL That is if you go the Microsoft Stack way

After learning Excel, should a beginner learn Power BI before SQL? What’s your take on this?

#contro #topic, I check their other connectors, all the #dibezium source connectors worked well, but the #iceberg sink connector stopped. I am not sure if anyone had similar experience, I had to recreate the sink connectors before I could get the data to start streaming again

So, #aws support team sent us a mail that they will be patching #mskconnectors last week. And I thought, that’s fine, get on with it. Letter in the day, I noticed all my #iceberg #sinkconnectors stopped gaining access to the group, hence they couldn’t read the data from the

Architecting and developing a #data #streaming #pipeline with general purpose #s3 bucket vs s3 table bucket, I don’t even know which is better? #aws manages lots configuration that comes with #iceberg but it has lots of disjointed docs and plugins when using #msk & #debezium

When you wished that the bug has a physical body so you can discuss how to repay the time it took from you and frustration during debugging #data #dataengineer #dataarchitect