Jan 23Data integrityData integrity is vital to enable robust analysis. In the process of open-sourcing Singapore's Covid-19 data, I ran into several data...
Dec 19, 2021OneMap SG Latitude/ Longitude conversionIt's very often to come across datasets from data.gov.sg or open data from Singapore government's portals with X- and Y-coordinates...
Sep 5, 2020Updating data in google sheets using API and PythonThe Singapore government publishes locations visited by COVID-19 patients in the last 14 days, and removes any data earlier. I decided to...
Jul 31, 2020Engineering job openings in SingaporeThe following information for over 5000 job opening listed on a government portal for virtual career fairs was scraped: title, company,...
May 30, 2020Extracting text data from online imageHere's the link to the exact notebook: https://github.com/hxchua/datadoubleconfirm/blob/master/notebooks/pytesseract_onlineimage.ipynb.
Mar 26, 2020Analysing updates on COVID-19 local situation on MOH's websiteLooking at the number of updates published on the Ministry of Health's website, we might be able to get a sense of the severity of the...
Mar 25, 2020COVID-19 Singapore DataThere are various open-source datasets on Python and R relating to global cases but here's sharing a more detailed dataset focusing...
Feb 1, 2020SingStat APISingStat (Singapore Department of Statistics) has made quite some data publicly available but not in the most analyst-friendly format....
Nov 10, 2019Toughest part in a data science projectWas surprised to see my post trending. Since it caught on, I would cross-share it over here. While the post was meant to answer a...
Oct 30, 2019Cross-sharing data on data.worldWhile I mainly host my datasets on my Github repository, I have also cross-shared some datasets on data.world as the platform is...