Category: Data Cleaning

Find Twitter Influencers Through Social Network Analysis

September 8, 2015

Check out the DEMO R SHINY DASHBOARD! This is an open source project collaborated between NYC Data Science Academy and Fusion media (an ABC-Univision joint-venture). Project Team: –NYC Data Science Academy Fangzhou Cheng (PM, Data Science Fellow) Shu Yan (Data Science Fellow) Alex Singal (Data Science Fellow) –Fusion Noppanit Charassinvichai (Data Engineer) Introduction: This project designs … More Find Twitter Influencers Through Social Network Analysis

The Most Dangerous Intersections in NYC – Interactive Data Visualization in R

July 17, 2015

Why visualize an accident map? As a Citi Bike annual member, I’ve always been proud of contributing to the poor 21% female rider ratio (source). But at the same time, I constantly got warnings from friends and family, “Streets in NYC are crazy! Biking is a bad idea!” How many biking accidents have actually happened compared to other vehicles? Where are … More The Most Dangerous Intersections in NYC – Interactive Data Visualization in R

Okcupid Scraper – Who is pickier? Who is lying? Men or Women?

July 9, 2015

Introduction: 40 million Americans indicated that they used online dating services at least once in their life (source), which got my attention — Who are these people? How do they behave online? Demographics analysis (age and location distribution), along with some psychological analysis (who are pickier? who are lying?) are included in this project. Analysis is … More Okcupid Scraper – Who is pickier? Who is lying? Men or Women?

NYC Oil Boilers – Detailed Fuel Consumption and Building Data

June 22, 2015

NYC Open Data Portal Working Through CSV Source Data Oil-burning boilers are one of the largest sources of air pollution in NYC. The purpose of the project is to see how complete this dataset is and to map the data in a geographic visualization. The original data is small-sized (~22MB, 8K rows), and appropriately enough, … More NYC Oil Boilers – Detailed Fuel Consumption and Building Data