Objectives

Activity: Project Proposal Presentations

• Presentations will be done in alphabetical order of last name
• Each student will present for 3 minutes
• Each presentation allows a 5 minute discussion about the presentation

1st Progress Report

1st Progress Report: Summarize early work on data acquisition, cleaning, and exploratory data analysis.

Requirements:

• Description of datasets obtained, including sources and key features.
• Initial data cleaning steps (e.g., handling missing values, removing duplicates).
• Preliminary insights from data exploration (e.g., summary statistics, visualizations).
• Updates on challenges encountered (e.g., data quality issues) and resolutions.

Data Acquisition & Cleaning (1/2)

Data Acquisition

• Sources and key variables
• generate new variables using the data
• cross referencing multiple data sets

Initial Data Cleaning Steps

• Handled missing values
• Removed duplicates to ensure data integrity
• Standardized formats for categorical variables
• Addressed outliers

Data Acquisition & Cleaning (2/2)

Challenges

• Incomplete records
• Inconsistent categorical labels
• Big data (large sample size)
• Coding syntax and logical errors

Questions/Tasks:

• Are there any other data sources you should consider?
• What additional cleaning steps might be needed for consistency?

Exploratory Data Analysis (1/2)

Preliminary Insights

• Summary Statistics
• Trends & Patterns
• Noted seasonal variations
• Visualizations

Exploratory Data Analysis (2/2)

Challenges

• Data imbalance and high variance
• Too much information in one visualization
• Coding syntax and logical errors

Questions/Tasks

• What additional features should you explore?
• Are there any patterns that require deeper analysis?
• Should we apply techniques to improve insights?