OECD:MEI JSON Data File with ONLY Quarterly Data Available?

1

We are accessing OECD: MEI data via Python.:
https://git.nomics.world/dbnomics-json-data/oecd-json-data/tree/master/MEI/series.jsonl

We only need to access QUARTERLY data for all MEI series which we are then dumping as a .CSV in Rows x Columns format. The series.jsonl file we are accessing is massive as it contains Monthly (and Annual) data too; the Python script has to check every “row” in order to select only the Quarterly periodicity data and it’s taking a very long time (its regularly updated too)
Question: - do you ever store eg MEI JSON files that contain:
just QUARTERLY data eg “seriesQ.jsonl” or
just ANNUAL data eg “seriesA.jsonl” or
just MONTHLY data eg “seriesM.jsonl”

Accessing seriesQ.jsonl would then be MUCH quicker than the current “grand” series.jsonl
Is this file seperation feasible for MEI (& other datasets containing Monthly data as well as Quarterly & Annual data?)

Most kind

2

We do not store dataset along specific dimensions for now. And I doubt that we will do so in the near future. Indeed, we are trying to be systematic and I don’t see why we would do it for the frequency dimension, and not for the country dimension for example.

However, it is possible to make a query only on the quarterly series under python or R, like this :
library(rdbnomics)
df <- rdb("OECD", "MEI","...Q")
It is quite fast (less than 2 minutes with my computer).

3

Hi @MT_MANC

I’d like to emphasis the fact that DBnomics is primarily designed to be queried via its HTTP API.

Although it is possible to clone *-json-data Git repositories and read data from them, they are more like an internal storage shared between the different components of DBnomics. Furthermore, the storage format is subject to change.