Oluwafemi💥

20.4K posts

Oluwafemi💥 banner
Oluwafemi💥

Oluwafemi💥

@pascaltoni

Data Engineer (Jesus is the Way, the Truth and the Life)

Quays, Manchester, England 参加日 Mart 2011
3.8K フォロー中841 フォロワー
Oluwafemi💥 がリツイート
Dipo
Dipo@swag_lukarz·
Funniest moments of the pop the balloon or find love compilation 😂😂😂😂 you’ll definitely enjoy this one 😂😂😂😂
English
790
5.8K
74K
476.1K
Oluwafemi💥 がリツイート
Coventry City
Coventry City@Coventry_City·
Frank wetin be dat 😮‍💨
English
1.3K
6K
38.9K
878.9K
Oluwafemi💥 がリツイート
Zach Wilson
Zach Wilson@EcZachly·
Building Data Pipelines has levels to it: - level 0 Understand the basic flow: Extract → Transform → Load (ETL) or ELT This is the foundation. - Extract: Pull data from sources (APIs, DBs, files) - Transform: Clean, filter, join, or enrich the data - Load: Store into a warehouse or lake for analysis You’re not a data engineer until you’ve scheduled a job to pull CSVs off an SFTP server at 3AM! level 1 Master the tools: - Airflow for orchestration - dbt for transformations - Spark or PySpark for big data - Snowflake, BigQuery, Redshift for warehouses - Kafka or Kinesis for streaming Understand when to batch vs stream. Most companies think they need real-time data. They usually don’t. level 2 Handle complexity with modular design: - DAGs should be atomic, idempotent, and parameterized - Use task dependencies and sensors wisely - Break transformations into layers (staging → clean → marts) - Design for failure recovery. If a step fails, how do you re-run it? From scratch or just that part? Learn how to backfill without breaking the world. level 3 Data quality and observability: - Add tests for nulls, duplicates, and business logic - Use tools like Great Expectations, Monte Carlo, or built-in dbt tests - Track lineage so you know what downstream will break if upstream changes Know the difference between: - a late-arriving dimension - a broken SCD2 - and a pipeline silently dropping rows At this level, you understand that reliability > cleverness. level 4 Build for scale and maintainability: - Version control your pipeline configs - Use feature flags to toggle behavior in prod - Push vs pull architecture - Decouple compute and storage (e.g. Iceberg and Delta Lake) - Data mesh, data contracts, streaming joins, and CDC are words you throw around because you know how and when to use them. What else belongs in the journey to mastering data pipelines?
English
9
63
352
15.4K
Oluwafemi💥 がリツイート
The Driven Man
The Driven Man@Thedrivenman·
Caught in 4K 💀
English
332
1.3K
13.1K
94.5K
Oluwafemi💥 がリツイート
Risi Arab Money
Risi Arab Money@OyinLadun0·
This video really made me teary 🥹 There are friends who truly add color to our lives,may God bless them for us. He was dancing on stage when his friend noticed his slippers was worn out, so his friend reached out to their other friend for his own( obviously,his slippers were bad too, that’s why he couldn’t give him his) He was literally smiling until he sighted his friend’s feet💔 Genuine friendships are rare🥺
English
46
243
1.1K
83.5K
Oluwafemi💥 がリツイート
Randomz Musings
Randomz Musings@Naija_PR·
Watch how Mother Cat fought a snake
English
745
5.8K
55.9K
661.3K
Oluwafemi💥 がリツイート
J.A Olaoye
J.A Olaoye@JA_Olaoye·
Data Engineers, You’ll understand this when full load starts hurting. I once inherited a pipeline that did full processing daily. At ~10k users, no problem. Then the business grew to ~500k users in 2 years. AWS analytics cost started raising questions… and I was the one being asked what’s going on. I checked the architecture. We were reprocessing data that would never change… every single day. At that point: ~1M+ cooking session records daily. I redesigned it: • Introduced incremental load • Partitioned data properly on S3 Cost dropped significantly after this update. Big O is not a joke. It’s the economics of systems.
The Tech Prophet (Amospikins)@Amospikins

Big O, The Economics of Performance

English
4
26
195
15.1K
Oluwafemi💥 がリツイート
NaNa🌼✨
NaNa🌼✨@sil_vee_yah·
Sermons I listened to that changed my life forever:
NaNa🌼✨ tweet mediaNaNa🌼✨ tweet mediaNaNa🌼✨ tweet mediaNaNa🌼✨ tweet media
English
38
641
2.9K
52.1K
Oluwafemi💥 がリツイート
Toyyib Adewale Adelodun
Toyyib Adewale Adelodun@taadelodun·
I received a call this morning from Professor Celestine Iwendi. He is a Professor of Artificial Intelligence. He is also the Head of Centre of Internet of Things at the University of Greater Manchester. When I say Nigerians are the smartest in the world, I am not lying 🇳🇬🇳🇬🙌🙌 We will bring everybody back to change Nigeria, mark my words! Bandits will be decimated We will settle herders farmers clash No single terrorist will be spared Kidnappers Orun lala! We will make Nigeria Great Again!
English
74
113
720
58.7K
Officialarole
Officialarole@OfficialArole·
Help comes QUICKLY!!!!!!!!!.
English
143
99
718
12.2K
Oluwafemi💥
Oluwafemi💥@pascaltoni·
@PythonPr B. 5 and 0 evaluates to 0 because ‘and’ returns the first falsy value. Then 0 or 3 evaluates to 3 because or returns the first truthy value. So the output is 3.
English
0
0
3
446
Python Programming
Python Programming@PythonPr·
Python Question / Quiz; What is the output of the following Python code, and why? Comment your answers below!
Python Programming tweet media
English
17
3
66
8.9K
Oluwafemi💥 がリツイート
Kamal Gurjar
Kamal Gurjar@KamalGurjar8·
B is correct. SQL doesn’t execute top-to-bottom — it follows its logical execution order: FROM (get data) WHERE (filter rows) GROUP BY (create groups) HAVING (filter groups) SELECT (pick columns / aggregates) ORDER BY (sort results) LIMIT (restrict output) That’s why aggregates like AVG() work in HAVING but not in WHERE.
English
1
1
9
342
Oluwafemi💥 がリツイート
Microsoft SQL
Microsoft SQL@SQLServer·
Keep the learning 🎓 going after #SQLCON with the new SQL AI Developer Associate certification, now in Beta. Design and develop AI-enabled database solutions across #MicrosoftSQL. Get started today: msft.it/6016QqXxQ
Microsoft SQL tweet media
English
11
94
533
42.1K
Oluwafemi💥 がリツイート
MJ👑
MJ👑@iam__Jezreel·
A woman is emotional but a Man is logical. The difference between a Man and a Woman. This is worth hearing💯💡
English
6
199
1K
9K
Oluwafemi💥 がリツイート
iNspiritextra
iNspiritextra@iNspiritextra·
Are you relying on your own strength, or on God’s strength? There are some levels of God’s power you cannot experience until He becomes your main source - not just a backup plan or someone you turn to only in emergencies, but the foundation you depend on every day.
English
6
97
368
3.5K
Oluwafemi💥 がリツイート
Python Programming
Python Programming@PythonPr·
Build Your First Machine Learning Project [Full Beginner Walkthrough] In this tutorial We'll learn how to build an end-to-end machine learning project. We'll cover the main steps in building a machine learning project, then walk you through writing the Python code to create the project. youtube.com/watch?v=Hr06nS…
YouTube video
YouTube
English
0
31
124
8.5K
Oluwafemi💥 がリツイート
Khushabu
Khushabu@khushabu_27·
Top SQL & Data Science Courses 1. Advanced Databases and SQL Querying http:// udemy.com/course/advance... 2. Microsoft SQL Crash Course for Absolute Beginners http:// udemy.com/course/complet… 3. Oracle SQL - A Complete Introduction http:// udemy.com/course/introdu… 4. Databases and SQL for Data Science with Python http:// imp.i384100.net/WqEdEZ 5. SQL 101: A Beginners Guide to SQL http:// udemy.com/course/sql-101… 6. Learn SQL Basics for Data Science Specialization http:// imp.i384100.net/9g7yx4 7. PostgreSQL for Everybody Specialization http:// imp.i384100.net/eKLkB1 8. Google Data Analytics Professional Certificate http:// imp.i384100.net/0ZOBkL 9. Meta Database Engineer Professional Certificate http:// imp.i384100.net/jrLWKP 10. IBM Data Analyst Professional Certificate http:// imp.i384100.net/DKAjjG 11. Introduction to Relational Database and SQL http:// imp.i384100.net/1rvZOz 12. IBM Data Science Professional Certificate http:// imp.i384100.net/9gxbbY
Khushabu tweet media
English
0
18
86
2.7K