
CyberDom
2.6K posts

CyberDom
@OzigboChidera
Data Engineer || Analytics Engineer || Introvert || 2X Hackathon Winner




This is what a neat and well documented API Docs looks like, and yes I created this for a client.😌




Phase 2:👀 To prepare the data in the SQLite DB to be sent in a compressed format (parquet), what did I do? 1. Created a python script that : > Checks the table for unsynced records (records where the sync_status is in 'pending') > Converts just those records into parquet using Pandas > Then updates the converted records (using the record_id) sync_status to 'synced' in the DB. Why did I do this? So, when the script runs again, it only looks for records that haven't been synced yet. Now I have lightweight data that can be sent over a minimal internet connection. What's next? > I'll be creating an uploader script that polls for an internet connection every 10 seconds. Once a connection is confirmed, it uploads the parquet file into an already provisioned S3 bucket. #DataEngineering #ETL #Python #DataAnalytics



one year of architecting cloud security at @moniepoint 🎉🥳

We are prioritizing networking, pizza and a cold beer for this event :) Join us at the n8n community event on the 28th of March 2026 at cafe one ikeja @Rita_tyna @ Shadrack @ Chidera luma.com/mabfj63x











📌 Join us in our upcoming webinar to discuss n8n as a practical automation tool for Data Engineers As data engineers, we build pipelines, manage infrastructure, and ship code, but a lot of our workflow still involves repetitive manual steps. What if we could automate those





















