DATA DIVE DAYS

Selected as Top 100 Data Science Resources for 2018/2019

Jul 6

Singapore Traffic Updates

Traffic Updates, Road Closures & Road Works in Singapore are published on LTA OneMotoring website. To understand the traffic conditions...

Sep 1, 2022

Scraping table data off website - Python

This notebook presents two ways of scraping table data off website, one using pandas and the other using BeautifulSoup:...

Sep 5, 2020

Updating data in google sheets using API and Python

The Singapore government publishes locations visited by COVID-19 patients in the last 14 days, and removes any data earlier. I decided to...

Jul 31, 2020

Engineering job openings in Singapore

The following information for over 5000 job opening listed on a government portal for virtual career fairs was scraped: title, company,...

Jul 8, 2020

Creating a blended/ average face based on multiple faces

With current deep learning algorithms, we can create a new (averaged) face based on photos of multiple faces and this can be done easily....

May 3, 2020

PyData Salamanca - Webscraping using BeautifulSoup in Python - Announcement

It was a joy to support PyData Salamanca! Many thanks to my friend Víctor Vicente Palacios for hosting. We conducted the live stream...

Mar 26, 2020

Analysing updates on COVID-19 local situation on MOH's website

Looking at the number of updates published on the Ministry of Health's website, we might be able to get a sense of the severity of the...

Nov 2, 2019

Web scraping using Beautifulsoup on embedded html - Process - Python

In this webscraping attempt, I want to get data on countries, sites and categories of sites in one table. One challenge I faced is to get...

Oct 9, 2018

Web scraping using selenium - Process - Python

In addition to BeautifulSoup, selenium is a very useful package for webscraping when it involves repeated user interaction with the...

Jan 17, 2018

Web scraping using Beautifulsoup - Process - Python

This is Part I of a four-part post. Part I talks about scraping data from a website (bookdepository.com, in this case) while Part II...