Omni Data Engineer Kai

Data Engineering thread ;

What do you mean "No charm"

Apply for that job even if you think you don't meet the requirements, let them disqualify you, never disqualify yourself from a potential opportunity.

I just published Is Data Engineering Getting Saturated? medium.com/p/is-data-engi…

I always tell newbies that knowledge of the tool is good, but I'd put that as third, understanding the problem statement would come second, and understanding the data would come first, because most times, you guys jump straight to creating a dashboard or solving a problem. Understanding the data could consist of * Understanding the units, if it's a price column, what currency? If it's a unit of measurement, is it feet or meters, is it cm or mm? If it's time, is it minutes or years, temperature, etc * Understanding the data types,  a column can be STRING, INT, or BOOLEAN, e.g zip code or user_id is technically a number, but you would never calculate the average zip code. For boolean sometimes 1 and 0 are used for Yes and No. You need to know which is which before calculating anything like conversion rates. * Understanding expected boundaries, if an age column has a value of 2698 and you're sure you're not working with historic or vampiric-related data, then it should be checked. Knowing this can help spot an outlier or dirty data. * Understanding the data formats, if you're working with dates, is it DD-MM-YYYY or MM-DD-YYYY or  DD-MM-YYYY-HH:mm: ss.S Basically, don't rush to deliver wrong results.

Achieve your goals this new year.

What am I doing wrong in my weight loss journey..

Really?

@Teeniiola You don't eat a fish that died in it's habitat..

Chai!! So big shark dey Lagos and no one is talking about it? If no be this girl, we no go sabi! 👀

@cheftee_lead 6. Telling your Data Engineer how to do their job..

5 mistakes to avoid as a Data Analyst. Who’s one are you guilty of? 👇😊

Python - your error is on line 5 because you can't have a string add an integer SQL - Incorrect syntax near the keyword 'FROM' "There are like 4 FROMs in that query, you just like being vague..."

How would you answer this: Tell me about a time you used SQL to automate a process

@iam_Uchenna If you remove the SQL + , it would still make sense

- SQL + SELECT = Querying Data - SQL + JOIN = Data Integration - SQL + WHERE = Data Filtering - SQL + GROUP BY = Data Aggregation - SQL + ORDER BY = Data Sorting - SQL + UNION = Combining Queries - SQL + INSERT = Data Insertion - SQL + UPDATE = Data Modification - SQL + DELETE = Data Removal - SQL + CREATE TABLE = Database Design - SQL + ALTER TABLE = Schema Modification - SQL + DROP TABLE = Table Removal - SQL + INDEX = Query Optimization - SQL + VIEW = Virtual Tables - SQL + Subqueries = Nested Queries - SQL + Stored Procedures = Task Automation - SQL + Triggers = Automated Responses - SQL + CTE = Recursive Queries - SQL + Window Functions = Advanced Analytics - SQL + Transactions = Data Integrity - SQL + ACID Compliance = Reliable Operations - SQL + Data Warehousing = Large Data Management - SQL + ETL = Data Transformation - SQL + Partitioning = Big Data Management - SQL + Replication = High Availability - SQL + Sharding = Database Scaling - SQL + JSON = Semi-Structured Data - SQL + XML = Structured Data - SQL + Data Security = Data Protection - SQL + Performance Tuning = Query Efficiency - SQL + Data Governance = Data Quality

@moniepoint Why are you guys always hiring Data Engineers?

Moniepoint engineers make sure millions of payments reach the right people every day. Adeolu does this with precision, curiosity, and a love for patterns. When he’s off the clock, he explores the world through shows like The Big Bang Theory and Abbott Elementary where fictional characters power their own dreams. Click the link to see his watchlist. moniepoint.com/blog/behind-th… #moniepoint #career #Engineering

@zazzygfx Most likely its own dedicated server(private cloud) at a physical location. Then they should have data centers with servers for commercial use(public cloud), where sites are hosted.

Bow I’m curious, what’s Cloudflare itself running on?

Extension??

The client knows exactly what they want........

You actually do, your model won't feed itself specific data from the database. If your argument is using Python to get everything then sorting what you need, it becomes a problem when you have petabytes of data, so you need SQL as an MLE.

@AnthoniaUmoke Those months fly so fast...

Proof of life. Camp✅ 11months to give my all to my fatherland 🌚