DATA DIVE DAYS

Selected as Top 100 Data Science Resources for 2018/2019

data.gov.sg has openAPI and for each dataset, it provides a sample Python code to query for the dataset. The output is a JSON and here's...

Aug 22, 2024

The previous post on Extracting data from tables in PDF was many years old and requires an update as it didn't cover a Python package...

Jul 6, 2024

Traffic Updates, Road Closures & Road Works in Singapore are published on LTA OneMotoring website. To understand the traffic conditions...

Jul 6, 2024

If you're looking for the latitude and longitude of places in Singapore, you can make use of OneMap API. It is free for public use. Below...

May 24, 2024

This blogpost shows how Retrieval Augmented Generation can be done easily using Dataiku (without any code!). We want to ask some...

Dec 4, 2023

This post shows an example of how to query data using the MAS API. The results returned are in bytes format and has to be transformed to...

Apr 19, 2023

Public can create an account to get data related to courses published on the SkillsFuture Singapore website via their API. This notebook...

Apr 14, 2023

This notebook presents two ways of scraping table data off website, one using pandas and the other using BeautifulSoup:...

Sep 1, 2022

Data integrity is vital to enable robust analysis. In the process of open-sourcing Singapore's Covid-19 data, I ran into several data...

Jan 23, 2022

It's very often to come across datasets from data.gov.sg or open data from Singapore government's portals with X- and Y-coordinates...

Dec 19, 2021