CyberDom

2.6K posts

CyberDom banner
CyberDom

CyberDom

@OzigboChidera

Data Engineer || Analytics Engineer || Introvert || 2X Hackathon Winner

Lagos 参加日 Ocak 2019
617 フォロー中624 フォロワー
固定されたツイート
CyberDom
CyberDom@OzigboChidera·
Over the past month, I've been busy with several projects and recently completed one. In this project, I built a LinkedIn Jobs Data Pipeline. It extracts job listing data from the LinkedIn API and carry out series of tasks with S3, Lambda and Redshift @chideraozigbo/linkedin-jobs-data-etl-pipeline-190e10810fa1" target="_blank" rel="nofollow noopener">medium.com/@chideraozigbo
English
2
2
12
1.6K
CyberDom
CyberDom@OzigboChidera·
@Raynerdtech But I don’t think what he shared are internal endpoints within the application. I think the docs he prepared is a public docs that provides services to users with api keys
English
2
0
2
344
CyberDom がリツイート
Najeeb Sulaiman
Najeeb Sulaiman@najeebsulaiman_·
Honoured to be invited as a guest speaker at the University of Derby — School of Computing. I spoke to undergraduates on:"What the Industry Actually Expects From Computing Graduates" Thanks to the faculty for trusting me with their students. A responsibility do not take lightly
Najeeb Sulaiman tweet mediaNajeeb Sulaiman tweet mediaNajeeb Sulaiman tweet media
English
10
33
469
18.4K
CyberDom がリツイート
Dataknight
Dataknight@DDataknight·
@n8n_io Lagos community event ;) We only just started.
Dataknight tweet mediaDataknight tweet mediaDataknight tweet mediaDataknight tweet media
English
2
3
7
162
CyberDom がリツイート
Tina Okonkwo
Tina Okonkwo@Rita_tyna·
POV: You went to an AI automation event looking like a burst of pink🥰💕 I had a great time today sharing my experience @DDataknight @Lagosn8n
English
3
4
32
730
CyberDom がリツイート
posh the engine.
posh the engine.@poshlovesdata·
Phase 3:🥳 To ensure data is being uploaded to where it can be accessed from any location, once an internet connection comes up at the remote health clinic. What did i do? > Provisioned an S3 bucket for the data uploads > Created a python script that checks for internet connection every 10 seconds > Once a connection is available, it pushes the parquet file from the outbox/ folder to the S3 bucket. > Then moves the file from outbox/ to uploaded/ locally once its sure that the data is now available on the S3 bucket. And there you have it, a simple, reliable offline-first data pipeline that works even with intermittent connectivity. Will be documenting this project and pushing it to GitHub next. If you're interested in the workflow, you can access it there.
posh the engine. tweet mediaposh the engine. tweet media
posh the engine.@poshlovesdata

Phase 2:👀 To prepare the data in the SQLite DB to be sent in a compressed format (parquet), what did I do? 1. Created a python script that : > Checks the table for unsynced records (records where the sync_status is in 'pending') > Converts just those records into parquet using Pandas > Then updates the converted records (using the record_id) sync_status to 'synced' in the DB. Why did I do this? So, when the script runs again, it only looks for records that haven't been synced yet. Now I have lightweight data that can be sent over a minimal internet connection. What's next? > I'll be creating an uploader script that polls for an internet connection every 10 seconds. Once a connection is confirmed, it uploads the parquet file into an already provisioned S3 bucket. #DataEngineering #ETL #Python #DataAnalytics

English
1
2
3
127
CyberDom がリツイート
Dataknight
Dataknight@DDataknight·
We are prioritizing networking, pizza and a cold beer for this event :) Join us at the n8n community event on the 28th of March 2026 at cafe one ikeja @Rita_tyna @ Shadrack @ Chidera luma.com/mabfj63x
Dataknight tweet mediaDataknight tweet mediaDataknight tweet mediaDataknight tweet media
English
7
11
26
1.8K
Tolulade
Tolulade@Tolulade_ato·
@__adewale Their data engineers and db team would need to set up critical infra
English
2
0
1
741
Adéwálé
Adéwálé@__adewale·
A lot of fraud related complaints in the fintech space can be traced back to NIMC’s lack of due diligence
English
3
15
111
9.6K
CyberDom がリツイート
Joy Victor
Joy Victor@Jhoie__·
As data engineers, we build pipelines, manage infrastructure, and ship code, but a lot of our workflow still involves repetitive manual steps. What if we could automate those intelligently? Join us at @data_dec on Saturday 21st, February 2025 by 5pm in our upcoming webinar as @OzigboChidera will walk us through building an AI-powered code review system that automatically reviews pull requests using n8n. Registration link: luma.com/sa73l7q4 See you there!
Joy Victor tweet media
English
0
8
30
1.2K
CyberDom がリツイート
Data Engineering Community (DEC)
📌 Join us in our upcoming webinar to discuss n8n as a practical automation tool for Data Engineers As data engineers, we build pipelines, manage infrastructure, and ship code, but a lot of our workflow still involves repetitive manual steps. What if we could automate those
Data Engineering Community (DEC) tweet media
English
1
2
0
264
CyberDom がリツイート
Data Engineering Community (DEC)
⏰ 𝐑𝐞𝐦𝐢𝐧𝐝𝐞𝐫: 𝐎𝐮𝐫 𝐧8𝐧 𝐖𝐞𝐛𝐢𝐧𝐚𝐫 𝐢𝐬 𝐡𝐚𝐩𝐩𝐞𝐧𝐢𝐧𝐠 𝐓𝐨𝐦𝐨𝐫𝐫𝐨𝐰! Don’t miss this practical session on using n8n as an automation layer for Data Engineers. In this webinar, @OzigboChidera will walk through a real-world build:
Data Engineering Community (DEC)@data_dec

📌 Join us in our upcoming webinar to discuss n8n as a practical automation tool for Data Engineers As data engineers, we build pipelines, manage infrastructure, and ship code, but a lot of our workflow still involves repetitive manual steps. What if we could automate those

English
1
3
4
213
CyberDom
CyberDom@OzigboChidera·
@Itz_JBrown @cogonnaya @_Nsznn As at when it is on the road. U do not know the identity of the owner. The owner is a regular car owner to you
English
0
0
1
461
Nnamdi 🦅
Nnamdi 🦅@_Nsznn·
I want to ask, why do Nigerians always cover their car plate number when posting the car ??
English
85
109
3.1K
214.2K
:) waally
:) waally@_mohawwal·
Perhaps what you dislike is good for you.
:) waally tweet media
English
2
1
9
257
CyberDom がリツイート
Data Engineering Community (DEC)
🎊We’re not done just yet Here’s what the team has to say about an exceptional 𝐂𝐨𝐦𝐦𝐮𝐧𝐢𝐭𝐲 𝐁𝐮𝐢𝐥𝐝𝐞𝐫 whose impact speaks for itself. We celebrate and appreciate you @najeebsulaiman_
English
0
6
10
351
CyberDom がリツイート
Data Engineering Community (DEC)
Happy Birthday @najeebsulaiman_ ! 🎉 Your dedication to advancing data engineering and supporting others has made a lasting impact. Grateful for your leadership, vision, and commitment to growing the Data Engineering Community. You have created more than a platform. You have
Data Engineering Community (DEC) tweet media
English
1
3
4
337