DATA DIVE DAYS

Selected as Top 100 Data Science Resources for 2018/2019

Traffic Updates, Road Closures & Road Works in Singapore are published on LTA OneMotoring website. To understand the traffic conditions...

Sep 1, 2022

This notebook presents two ways of scraping table data off website, one using pandas and the other using BeautifulSoup:...

Sep 5, 2020

The Singapore government publishes locations visited by COVID-19 patients in the last 14 days, and removes any data earlier. I decided to...

Jul 31, 2020

The following information for over 5000 job opening listed on a government portal for virtual career fairs was scraped: title, company,...

Jul 8, 2020

With current deep learning algorithms, we can create a new (averaged) face based on photos of multiple faces and this can be done easily....

May 3, 2020

It was a joy to support PyData Salamanca! Many thanks to my friend Víctor Vicente Palacios for hosting. We conducted the live stream...

Mar 26, 2020

Looking at the number of updates published on the Ministry of Health's website, we might be able to get a sense of the severity of the...

Nov 2, 2019

In this webscraping attempt, I want to get data on countries, sites and categories of sites in one table. One challenge I faced is to get...

Oct 9, 2018

In addition to BeautifulSoup, selenium is a very useful package for webscraping when it involves repeated user interaction with the...

Jan 17, 2018

This is Part I of a four-part post. Part I talks about scraping data from a website (bookdepository.com, in this case) while Part II...