Add prototype PANGAEA harvester
Analogously to the GDI harvester already in place, add a harvester for PANGAEA metadata.
Start by making a clone of the current state of the dev
branch.
I already defined the general structure, see the files pangaea_searcher.py
(here) and pangaea_consumer.py
(here).
We most probably want to harvest the metadata in iso19139
schema. Ideally, we can use the same functions as in the GDI harvesting for the metadata mapping, because there we also use the iso schema, only difference is that in GDI we harvest the CSW endpoint and Pangaea would go via the OAI-PMH endpoint. However I'm not completely sure if this will work, needs to be figured out.
For the MVP it is not necessary that we map all metadata fields, we concentrate on those which could be most promising for an aggregated datasearch via the OneStop, e.g. subject (paying attention to controlled vocabularies), keywords and measured variables/ parameters.