Gebruiker:OlafJanssen/KladblokMapMakingWorkshopWM2019/EtherpadBackup

Backup of https://github.com/ookgezellig/WikidataMapMakingWorkshop/blob/master/OutlineAndNotes.md , 12-8-2019

1. Workshop outline and notes

• Latest update: 12th August 2019*

1. 1. Module 1: Basic flat & layered maps

<image src="images/module1.jpg" width="200"/>

• • Prerequisites for this Module**
• [Wikimedia account](https://www.wikidata.org/w/index.php?title=Special:CreateAccount)
• Working knowledge of [Wikidata](https://www.wikidata.org/wiki/Wikidata:Main_Page)
• Basic understanding of [SPARQL](https://en.wikipedia.org/wiki/SPARQL) and the [Wikidata Query Service](https://www.mediawiki.org/wiki/Wikidata_Query_Service/User_Manual) (WDQS)
• A Wikidata set of items with geo coordinates [P625](https://www.wikidata.org/wiki/Property:P625)

If you do not have, or cannot create such a Wikidata set, you can use one of these: 1) [Public libraries in The Netherlands](https://w.wiki/6dx) (incomplete set, per 12-8-2019) 2) [National heritage sites of the Netherlands](https://w.wiki/6dy) (limited to 1000 items) 3) [Big cities](https://w.wiki/6e3) in the world 4) [Volcanos](https://w.wiki/6e9) 5) [Airports around the equator](https://w.wiki/6eB) ( between -10 and +10 degrees latitude)

Many examples in this workshop are based on the first dataset [Public libraries in The Netherlands](https://w.wiki/6dx)

1. 1. 1. Module 1.1 Basic flat map

<image src="images/1-1-basic-flat-map.jpg" width="200"/>

• Public libraries in The Netherlands: https://w.wiki/6dx
• Default map view: https://w.wiki/6eq
• Relation between query and popup
• Hiding fields from popup: https://w.wiki/6mU

1. 1. 1. Module 1.2 Clustered flat map

<image src="images/1-2-clustered-flat-map.jpg" width="200"/>

• Clustered flat map: https://w.wiki/6ew

1. 1. 1. Module 1.3 Basic layered map

<image src="images/1-3-basic-layered-map.jpg" width="200"/>

• Dutch public libraries, layered by province: https://w.wiki/6gJ - With non-custom layer names, the layer names are the labels from the Wikidata items

1. 1. 1. Module 1.4 Layered map, custom layer names

<image src="images/1-4-custom-layered-map.jpg" width="200"/>

• Libraries layered by postal code zone: https://bit.ly/3368DPk

1. 1. 1. Module 1.5 Other cool layered maps

<image src="images/1-5-other-cool-layered-maps.jpg" width="200"/>

• Big cities, by population: https://w.wiki/3fx
• Disasters, by type: https://w.wiki/6gY
• Medieval churches, by century of construction: https://w.wiki/6ga
• Dutch municipalities, by number of public libraries: https://w.wiki/6gb

1. 1. Module 2: Embedded maps in Wikimedia projects

<image src="images/module2.jpg" width="200"/>

• • Prerequisites for this Module** (in addtition to those in Module 1)
• User page on Wikipedia, Wikimedia Commons or Wikidata ([example](https://www.wikidata.org/wiki/User:OlafJanssen))... With [Sandbox](https://www.wikidata.org/wiki/User:OlafJanssen/Sandbox)

Nice to have some knowledge about

• [OpenStreetMap](https://www.openstreetmap.org) (OSM)
• [GeoJSON](https://en.wikipedia.org/wiki/GeoJSON)

For embedding maps we'll be using the Mediawiki [Kartographer extension](https://www.mediawiki.org/wiki/Help:Extension:Kartographer)

All embedding examples below are available on https://nl.wikipedia.org/wiki/Gebruiker:OlafJanssen/KladblokMapMakingWorkshopWM2019

1. 1. 1. Basic map

<image src="images/2-basic-embedded-map.jpg" width="200"/>

• Basic embedded map of The Netherlands, no data: https://nl.wikipedia.org/wiki/Gebruiker:OlafJanssen/KladblokMapMakingWorkshopWM2019#/map/0 _{([View source](https://nl.wikipedia.org/w/index.php?title=Gebruiker:OlafJanssen/KladblokMapMakingWorkshopWM2019&action=edit&section=2))}

1. 1. 1. Module 2.1 Single location, hard-coded

<image src="images/2-1-single-location-hard-coded.jpg" width="200"/>

• One public library in Amsterdam, geo coordinates hard-coded: https://nl.wikipedia.org/wiki/Gebruiker:OlafJanssen/KladblokMapMakingWorkshopWM2019#/map/1. _{([View source](https://nl.wikipedia.org/w/index.php?title=Gebruiker:OlafJanssen/KladblokMapMakingWorkshopWM2019&action=edit&section=3))}
• Styling of markers https://github.com/mapbox/simplestyle-spec/tree/master/1.1.0#3-client-behavior and https://www.mediawiki.org/wiki/Help:Extension:Kartographer

1. 1. 1. Module 2.2 Three locations, hard-coded

<image src="images/2-2-three-locations-hard-coded.jpg" width="200"/>

• Library, museum and archive in Amsterdam, geo coordinates hard-coded: https://nl.wikipedia.org/wiki/Gebruiker:OlafJanssen/KladblokMapMakingWorkshopWM2019#/map/2. _{([View source](https://nl.wikipedia.org/w/index.php?title=Gebruiker:OlafJanssen/KladblokMapMakingWorkshopWM2019&action=edit&section=4))}

1. 1. 1. Module 2.3 Outline (GeoShape) via Wikidata & OpenStreetMap

<image src="images/2-3-geoshapes-via-wikidata-and-osm.jpg" width="200"/>

• Outline (GeoShape) of Amsterdam public library OBA Oosterdok, using Wikidata and Open Street Map: https://nl.wikipedia.org/wiki/Gebruiker:OlafJanssen/KladblokMapMakingWorkshopWM2019#/map/3. _{([View source](https://nl.wikipedia.org/w/index.php?title=Gebruiker:OlafJanssen/KladblokMapMakingWorkshopWM2019&action=edit&section=5))}
• Wikidata item of Amsterdam Public Library OBA Oosterdok: https://www.wikidata.org/wiki/Q50413436
• OBA Oosterdok on OSM: https://www.openstreetmap.org/way/240467636#map=19/52.37605/4.90853. Notice the Wikidata=Q50413436 in the tags on the left hand side.

1. 1. 1. Module 2.4 Many locations, GeoJSON .map file

<image src="images/2-4-many-locations-geojson-map-file.jpg" width="200"/>

• Map of Dutch public libraries: https://nl.wikipedia.org/wiki/Gebruiker:OlafJanssen/KladblokMapMakingWorkshopWM2019#/map/4. _{([View source](https://nl.wikipedia.org/w/index.php?title=Gebruiker:OlafJanssen/KladblokMapMakingWorkshopWM2019&action=edit&section=6))}
• Corresponding .map file on Wikimedia Commons: https://commons.wikimedia.org/wiki/Data:DutchPublicLibraries.map _{([View source](https://commons.wikimedia.org/w/index.php?title=Data:DutchPublicLibraries.map&action=edit))}
• Help: Map Data: https://www.mediawiki.org/wiki/Help:Map_Data
• http://geojson.io
• SPARQL query to make .tsv file as input for Geojson.io: https://bit.ly/2YG48aY. Don't forget to rename the headers (replace '_' with '-')

1. 1. 1. Module 2.5 Combining data types

<image src="images/2-5-combining-data-types.jpg" width="200"/>

• https://www.mediawiki.org/wiki/Help:Extension:Kartographer#Combining_multiple_data_types
• Combining GeoShape (with geomask) and .map: https://nl.wikipedia.org/wiki/Gebruiker:OlafJanssen/KladblokMapMakingWorkshopWM2019#/map/5. _{([View source](https://nl.wikipedia.org/w/index.php?title=Gebruiker:OlafJanssen/KladblokMapMakingWorkshopWM2019&action=edit&section=7))}
• Map of public libraries in the Dutch province of North-Holland: https://commons.wikimedia.org/wiki/Data:DutchPublicLibrariesNorthHolland.map

1. 1. 1. Module 2.6 GeoShapes using SPARQL and OSM

<image src="images/2-6-geoshapes-using-sparql-and-osm.jpg" width="200"/>

• https://www.mediawiki.org/wiki/Help:Extension:Kartographer#GeoShapes_via_Wikidata_Query
• Maps with GeoShapes based on SPARQL queries in Wikidata: https://nl.wikipedia.org/wiki/Gebruiker:OlafJanssen/KladblokMapMakingWorkshopWM2019#/map/6. _{([View source](https://nl.wikipedia.org/w/index.php?title=Gebruiker:OlafJanssen/KladblokMapMakingWorkshopWM2019&action=edit&section=8))}
• GeoShape of Libya (Q1016) on OSM: https://www.openstreetmap.org/relation/192758#map=5/22.086/20.039
• SPARQL query to generate GeoShapes of African countries: https://bit.ly/2YBxV4t
• Variables *must have* names ?id ?title ?description ?fill ?stroke
• In the SPARQL query only use single quotes, otherwise you’ll get a JSON parse error

1. 1. 1. Module 2.7 Other cool embedded maps

<image src="images/2-7-other-cool-embedded-maps.jpg" width="200"/>

• Railway lines around Klang Valley, Malaysia: https://nl.wikipedia.org/wiki/Gebruiker:OlafJanssen/KladblokMapMakingWorkshopWM2019#/map/7. _{([View source](https://nl.wikipedia.org/w/index.php?title=Gebruiker:OlafJanssen/KladblokMapMakingWorkshopWM2019&action=edit&section=9))}
• Governors of US states with their party affiliation: https://www.mediawiki.org/wiki/Help:Extension:Kartographer#/map/4 and https://www.mediawiki.org/wiki/Help:Extension:Kartographer#GeoShapes_via_Wikidata_Query
• Examples by Simon Cobb: https://www.wikidata.org/wiki/User:Sic19#GeoShapes

1. 1. Module 3 : Interactive, layered off-Wiki maps driven by Wikidata

<image src="images/module3.jpg" width="200"/>

• • Prerequisites for this Module** (in addtition to those in Modules 1 and 2)
• Mediawiki account - https://www.mediawiki.org

Nice to have basic working knowledge about

• Python
• PAWS / Jupyter Notebooks: https://www.mediawiki.org/wiki/PAWS + https://realpython.com/jupyter-notebook-introduction/

And nice to have heard about

• Jupyter-Leaflet: https://github.com/jupyter-widgets/ipyleaflet + https://ipyleaflet.readthedocs.io/en/latest/
• Jupyter-widgets: https://github.com/jupyter-widgets/ipywidgets + https://ipywidgets.readthedocs.io/en/latest/

1. 1. 1. Module 3.1 Introduction to PAWS // Getting PAWS up and running

<image src="images/3-1-introduction-to-paws.jpg" width="200"/>

• Important PAWS pages: https://www.mediawiki.org/wiki/PAWS + https://www.mediawiki.org/wiki/Manual:Pywikibot/PAWS + https://wikitech.wikimedia.org/wiki/PAWS
• Starting your PAWS server: https://paws.wmflabs.org/paws/hub + https://paws.wmflabs.org/paws/hub/user/USERNAME
• Running your PAWS server: https://paws.wmflabs.org/paws/user/USERNAME/tree
• Your PAWS terminal(s): https://paws.wmflabs.org/paws/user/USERNAME/terminals/1 (/2, /3, /4 etc for additional terminals)
• Stopping your PAWS server: https://paws.wmflabs.org/paws/hub/home
• Your PAWS public folder (even when server is offline) https://paws-public.wmflabs.org/paws-public/User:USERNAME
• PAWS alternative, local Jupyter Notebook installation via [Anaconda](https://www.anaconda.com/distribution/): https://jupyter.org/install + https://dataiseasy.com/2019/03/how-to-install-anaconda-and-jupyter-notebook

1. 1. 1. Module 3.2 Installing example notebook

<image src="images/3-2-installing-example-notebook.jpg" width="200"/>

• Go to PAWS public folder of User:OlafJanssen: https://paws-public.wmflabs.org/paws-public/User:OlafJanssen
• Save raw json file *WikidataMapMakingWorkshop.ipynb* to your PC: https://paws-public.wmflabs.org/paws-public/User:OlafJanssen/WikidataMapMakingWorkshop.ipynb?format=raw
• Upload this raw json file to your own PAWS server
• Example notebook to play around with on your own server: https://paws.wmflabs.org/paws/user/USERNAME/notebooks/WikidataMapMakingWorkshop.ipynb

1. 1. 1. Module 3.3 Adapt example notebook, create your own interactive layered map

<image src="images/3-3-adapt-example-notebook-create-your-own-interactive-layered-map.jpg" width="200"/>

• Full instructions are given in the notebook. The notebook should be self-explanatory, so adapt, play, understand, get frustrated, learn.... Make your own interactive, layered map
• The resulting map from the [default notebook](module3stuff/WikidataMapMakingWorkshop.ipynb) looks like this:

<image src="images/3-3-netherlands-public-libraries-heatmap.jpg" width="400"/>

1. 1. 1. Module 3.4 Save your map for off-Wiki use

<image src="images/3-4-save-your-map-for-offline-use.jpg" width="200"/>

• Exporting the map to stand-alone off-Wiki HTML file: https://ipywidgets.readthedocs.io/en/latest/embedding.html#python-interface
• The addition of ```python state=dependency_state([m])``` keeps the html file growing too large
• Python code: ```python embed_minimal_html('NetherlandsPublicLibrariesHeatmap.html', views=[m], state=dependency_state([m]), title='Heat map of Dutch public libraries, Wikimania map making workshop, 18th August 2019')```
• <a href="http://ookgezellig.github.io/WikidataMapMakingWorkshop/NetherlandsPublicLibrariesHeatmap.html">Off-Wiki version of NetherlandsPublicLibrariesHeatmap.html</a>

1. 1. Feedback

<image src="images/thanks-and-feedback.jpg" width="200"/>
Feedback on this workshop is more than welcome, please let me know your suggestions, improvements, dislikes etc.

• Olaf Janssen, Wikimedia coordinator of the national library of The Netherlands - https://www.kb.nl/wikipedia
• olaf.janssen{@}kb.nl
• User:OlafJanssen on [(Dutch) Wikipedia](https://nl.wikipedia.org/wiki/Gebruiker:OlafJanssen), [Wikimedia Commons](https://commons.wikimedia.org/wiki/User:OlafJanssen) and [Wikidata](https://www.wikidata.org/wiki/User:OlafJanssen)
• Twitter: [@ookgezellig](https://twitter.com/ookgezellig)