Skip to content
Snippets Groups Projects
Commit f49abb7d authored by Jonathan Hartman's avatar Jonathan Hartman
Browse files

lia markdown updates

parent 30815e63
No related branches found
No related tags found
No related merge requests found
......@@ -11,11 +11,16 @@ The paper is divided into three main steps, focussing on first preparing, second
## Emacs
## org-mode
> "Org-mode does outlining, note-taking, hyperlinks, spreadsheets, TODO lists, project planning, GTD, HTML and LaTeX authoring, all with plain text files in Emacs." - Carsten Dominik
> "Org-mode does outlining, note-taking, hyperlinks, spreadsheets, TODO lists, project planning, GTD, HTML and LaTeX authoring, all with plain text files in Emacs."
>
> -- Carsten Dominik
In other words...
> "Back to the future for plain text" - Carsten Dominik
> "Back to the future for plain text"
>
> -- Carsten Dominik
Let’s make an executive summary of org-mode:
......@@ -37,10 +42,130 @@ Org-mode is a magnificent tool when it comes to reproducible research [^1], sinc
## org-babel
- What is it and how it relates to org mode
### How to write a Code Cell
- syntax
- optional parameters
# Preparing Data
## Wikidata
- What is it
- Who can edit it
## SPARQL
- Related to SQL
- Can be used to query wikidata
## Requesting Our Data
In order to retreive our data from Wikidata...
``` SPARQL
#+NAME: raw-dataset
#+CAPTION: Retrieving the dataset from wikidata
#+HEADER: :url https://query.wikidata.org/sparql
#+HEADER: :format text/csv
#+HEADER: :cache yes :exports both
#+BEGIN_SRC SPARQL -n -k
SELECT ?wLabel ?pLabel
WHERE
{
?p wdt:P31 wd:Q98270496 . (ref:consortium)
?p wdt:P1416 ?w . (ref:affiliations)
SERVICE wikibase:label {
bd:serviceParam wikibase:language "en" .
}
}
ORDER BY ASC(?wLabel) ASC(?pLabel)
LIMIT 50
#+END_SRC
```
Our org-babel cell is made up of several components:
- NAME
* "raw-dataset" is the name of this cell. It will be used later to refer to the output of this cell.
- CAPTION
- HEADER
- BEGIN_SRC / END_SRC
## Viewing Our Results
```
| wLabel | pLabel |
|--------------------------------------------------------------+-------------------|
| Q105775472 | NFDI4Health |
| Q1117007 | NFDI4Health |
| Q115254989 | NFDI4Objects |
| Q1205424 | NFDI4Objects |
| Q17575706 | NFDI4Objects |
| Academy of Sciences and Humanities in Hamburg | Text+ |
| Academy of Sciences and Literature Mainz | NFDI4Culture |
| Academy of Sciences and Literature Mainz | NFDI4Memory |
| Academy of Sciences and Literature Mainz | NFDI4Objects |
| Academy of Sciences and Literature Mainz | Text+ |
| Alfred Wegener Institute for Polar and Marine Research | NFDI4Biodiversity |
| Alfred Wegener Institute for Polar and Marine Research | NFDI4DataScience |
| Alfred Wegener Institute for Polar and Marine Research | NFDI4Earth |
| Anthropological Society (Munich) | NFDI4Objects |
| Arachnologische Gesellschaft | NFDI4Biodiversity |
| Arbeitskreis Provenienzforschung e.V. | NFDI4Memory |
| Archivschule Marburg | NFDI4Memory |
| Archäologische Kommission für Niedersachsen | NFDI4Objects |
| Archäologisches Museum Hamburg und Stadtmuseum Harburg | NFDI4Objects |
| Arthistoricum | NFDI4Culture |
| Association for Data-Intensive Radio Astronomy | PUNCH4NFDI |
| Association for Technology and Construction in Agriculture | FAIRAgro |
| Association of German Architects | NFDI4Culture |
| Association of Population Based Cancer Registries in Germany | NFDI4Health |
| Association of states archaeologists | NFDI4Objects |
| BERD@NFDI | Base4NFDI |
| Bach-Archiv Leipzig | NFDI4Culture |
| Bauhaus-Universität Weimar | NFDI4Ing |
| Bavarian Academy of Sciences and Humanities | BERD@NFDI |
| Bavarian Academy of Sciences and Humanities | NFDI4Earth |
| Bavarian Academy of Sciences and Humanities | NFDI4Memory |
| Bavarian Academy of Sciences and Humanities | NFDI4Objects |
| Bavarian Academy of Sciences and Humanities | NFDIxCS |
| Bavarian Academy of Sciences and Humanities | PUNCH4NFDI |
| Bavarian Academy of Sciences and Humanities | Text+ |
| Bavarian Forest National Park | NFDI4Biodiversity |
| Bavarian Natural History Collections | NFDI4Biodiversity |
| Bavarian Natural History Collections | NFDI4Objects |
| Bavarian State Archaeological Collection | NFDI4Objects |
| Bavarian State Archives | FAIRAgro |
| Bavarian State Archives | NFDI4Biodiversity |
| Bavarian State Archives | NFDI4Earth |
| Bavarian State Archives | NFDI4Objects |
| Bavarian State Library | NFDI4Culture |
| Bavarian State Library | NFDI4Memory |
| Bavarian State Research Center for Agriculture | FAIRAgro |
| Beethoven House | NFDI4Culture |
| Beilstein Institute for the Advancement of Chemical Sciences | NFDI4Chem |
| Berlin State Library | Base4NFDI |
| Berlin State Library | NFDI4Memory |
```
# Cleaning Data
You may have noticed that the first few results we got back from wikidata weren't text, but rather the letter "Q" followed by a series of numbers...
| wLabel | pLabel |
| ---------- | ------------ |
| Q105775472 | NFDI4Health |
| Q1117007 | NFDI4Health |
| Q115254989 | NFDI4Objects |
| Q1205424 | NFDI4Objects |
| Q17575706 | NFDI4Objects |
# Processing Data
# Preserving Data
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Please register or to comment