Hi Cardiff!

• I’m Jasmine Dumas
  • Insurance Data Scientist and useR living in Connecticut, USA
  • M.S. Candidate in Predictive Analytics at DePaul University
  • Beginning Home brewer!
• Slides and Materials available at: jasdumas/talks/caRdiff-uk-open-gov-beer

What this presentation is about (and not about)

• I’m going to talk about the state of open government data in relation to beer
  • difficulties in finding and exploring analysis-ready data in a never ending sea of data
• This is not about “drunk politics”
  • not about regulations, hacking, or scandals regarding data

not

The search for datasets

• Finding interesting and available datasets is a concern for all those involved in data analysis
• Where to look?
  • Google public data explorer
  • Github
  • kaggle data repository
  • Open Government Data Portals: UK, Connecticut, SF,
  • Machine Learning Repositories at Universities: UCI

The search continues for analysis-ready datasets

• Many people say that data wrangling (or cleaning) is ~70% of the data science process
  • the desire for analysis-ready data is a high priority after addressing the business questions of a project and before the data wrangling step
• analysis-ready data also needs to include some type of documentation (data wiki’s FTW)

The U.S. Government Open Data Portal

The “clearinghouse” for open U.S. government data is located at data.gov. It also contains tools, and resources to conduct research, develop web and mobile applications, design data visualizations.

Example Application of the U.S. Government open data portal

• datausa.io: an online application developed by a team of data scientists at MIT Media Lab and Datawheel, backed by Deloitte is helping Americans visualize demographic and economic data using an open source platform