Moustafa Mahmoud

Nile University's Big Data and Data Science Professional Diploma (BDDS-PD) offers four academic courses along with a hands-on project integrating real-life customer engagement. The professional diploma combines science, business, technology, and industry knowledge.

Bachelor of Science degree (B.Sc) in Computer Science from Faculty of Computers and Information Systems, Helwan University

As a Senior Solution Architect, I specialize in implementing data and ML initiatives, cloud solutions, and data management platforms for customers. I lead projects to transition from monolithic Data Lakes to Distributed Data Mesh architectures and collaborate with AWS service teams. Additionally, I establish the Data Lab DataOps domain and contribute to AWS Glue service development and testing, including Apache Hudi integration.

As a Senior Data Engineer, I built efficient data pipelines, transformed data sets using AWS services (S3, Glue, Spark, DMS, Redshift, Athena), and migrated the Extraction Layer to near real-time using Terraform and AWS Glue, reducing data delivery time from 1 hour to 5 minutes. I collaborated with the Machine Learning team for MLOps and built data pipeline services for the development organization. Additionally, I facilitated the onboarding of new team members through presentations and pair programming.

As a Senior Big Data Engineer, I had a multifaceted role. I was responsible for building and maintaining Big Data platforms, developing Machine Learning Models, and providing consulting services on Big Data Engineering best practices to customers. My work also involved creating both batch and stream Big Data Jobs using technologies like Kafka, Spark, and Hadoop. I analyzed business requirements and designed solutions for Big Data and Analytics projects, and I assisted customers in building Big Data pipelines and supporting production environments using DevOps tools such as Jenkins, Docker, and Git..

As a Senior Big Data Analytics Engineer, I established and led the Big Data team, scaling it to 18 members. My responsibilities included designing ETL and aggregation jobs while also contributing to significant projects such as building a Real-Time Marketing (RTM) framework, enabling real-time marketing using telecom data, and developing a Customer Happiness Index model that boosted satisfaction by 10%. These projects leveraged various technologies like IBM Streams, PIG, Oozie, Hive, Spark, Hadoop, R, Scala, and Hive.

As a Data Analyst, I played a crucial role in providing essential data and analysis for the Business Intelligence and Reporting Team. My responsibilities included designing and developing ETL processes and reports with intricate transformation and data cleansing logic. I translated business needs into specifications through requirements gathering, performed analytics and reconciliation activities, and automated daily, weekly, and monthly ETL processes to ensure data availability for operational reporting purposes.