Data Engineering on Spreadsheets, Databases And Multiple Data Sources with Python and SQL
About This Course
Data Engineering on Spreadsheets and Databases with Python and SQL is a practical, hands-on course designed for professionals who already have basic Python programming skills and are ready to go beyond working with final datasets. The course focuses on equipping learners with the ability to ingest, clean, transform, and prepare data from various sources—including spreadsheets, APIs, and databases like Google BigQuery—for analytics use.
Learners will explore real-world scenarios where raw data is messy, inconsistent, or fragmented across platforms. Through structured lessons and exercises, participants will learn to build reliable data pipelines using tools such as pandas and SQL, address common data quality issues, and troubleshoot errors in ingestion and transformation processes. By the end of the course, learners will be able to confidently manage the upstream data preparation tasks that power meaningful business insights.
What You'll Learn
• Describe key tools and technologies used across the data lifecycle and identify the different nature and sources of data required for analytics projects
• Evaluate data requirements and design data model based on requirements
• Develop data ingestion pipelines from multiple sources using Python, pandas and SQL
• Cleanse and transform raw data using pandas and SQL to meet data requirements
• Evaluate data quality in datasets and design new data collection processes
• Resolve data issues in the data ingestion, cleaning and transformation process
Entry Requirements
Target age group: 18 - 60
Required years of experience in relevant domain: No domain experience required for entry
Minimum education level: Have good English proficiency (English language at GCE 'O' Level of B4 and above, or WSQ Workplace Literacy skills of Level 7 and above).
Other relevant details on entry requirements: This is a L200 course that builds on existing knowledge of Python programming. Participants need to have a basic understanding Of Python: Variables, Data Structures, Control Flow, Loops, Functions.