Jul 6, 2024
Singapore Traffic Updates
Traffic Updates, Road Closures & Road Works in Singapore are published on LTA OneMotoring website. To understand the traffic conditions...
Sep 1, 2022
Scraping table data off website - Python
This notebook presents two ways of scraping table data off website, one using pandas and the other using BeautifulSoup:...
Sep 5, 2020
Updating data in google sheets using API and Python
The Singapore government publishes locations visited by COVID-19 patients in the last 14 days, and removes any data earlier. I decided to...
Jul 31, 2020
Engineering job openings in Singapore
The following information for over 5000 job opening listed on a government portal for virtual career fairs was scraped: title, company,...
Jul 8, 2020
Creating a blended/ average face based on multiple faces
With current deep learning algorithms, we can create a new (averaged) face based on photos of multiple faces and this can be done easily....
May 3, 2020
PyData Salamanca - Webscraping using BeautifulSoup in Python - Announcement
It was a joy to support PyData Salamanca! Many thanks to my friend VÃctor Vicente Palacios for hosting. We conducted the live stream...
Mar 26, 2020
Analysing updates on COVID-19 local situation on MOH's website
Looking at the number of updates published on the Ministry of Health's website, we might be able to get a sense of the severity of the...
Nov 2, 2019
Web scraping using Beautifulsoup on embedded html - Process - Python
In this webscraping attempt, I want to get data on countries, sites and categories of sites in one table. One challenge I faced is to get...
Oct 9, 2018
Web scraping using selenium - Process - Python
In addition to BeautifulSoup, selenium is a very useful package for webscraping when it involves repeated user interaction with the...
Jan 17, 2018
Web scraping using Beautifulsoup - Process - Python
This is Part I of a four-part post. Part I talks about scraping data from a website (bookdepository.com, in this case) while Part II...