IAH 2013, Perth, Australia

This presentation provides a great overview of my PhD research.
(presented at IAH 2013, Perth, Australia)

PLACE 2013 - Maori GIS Conference

I had the great opportunity to present my PhD work at the 2013 Maori GIS conference in Auckland. In order to provide a seamless spatial and multi-purpose view of collected groundwater related datasets, the SMART project joins forces to establish a valuable basis for groundwater analysis and decision support tools (Kmoch et al., 2012, Klug et al., 2011). One of the project’s objectives is to build a web-based data and knowledge portal and attached three-dimensional web visualisation tool according to OGC and ISO compliant standards (OGC, 2012).

Iwi/Māori have a well-recognised relationship with the natural environment which spans many centuries and is the result of interaction and adaptation with native flora and fauna of Aotearoa/New Zealand. Integral to this relationship is water which sustains life and is a taonga (treasure) with significant cultural and physical dimension. This is reflected through the on-going desire of many iwi/Māori groups to have a role in the way water is managed in New Zealand to ensure its sustainable utilisation moving forward (Kawharu, 2002). The development of scientific research tools and models that incorporate mātauranga Māori (Māori knowledge) and te reo Māori (the Māori language) are also beneficial to iwi/Māori resource policymakers, planners and decision makers.

GNS has been collecting and compiling Māori terms on hydrology, geology and geothermal phenomena to, amongst other things, explore the contribution that traditional indigenous knowledge can make to the research outcomes and model development by identifying the cultural significance of groundwater and the associated cultural links with surface water (Tipa and Tierney, 2003, Boast, 1991). The potential benefits of creating research tools that utilise te reo Maori and mātauranga Maori (within government institutional settings) includes generating increased uptake in and familiarity with te reo Māori and exposure of te reo Māori as a minority language to broader audiences. Further research could identify gaps in the dual knowledge systems (either the western scientific knowledge paradigm, or mātauranga Māori) that could be explored as an outcome of this combined research (De Bres, 2008).

To support te reo Māori and mātauranga Māori within the SMART portal web mapping and catalogue application, we evaluate a multi-language concept to incorporate semantic web methodologies to map and connect English and Māori terms and descriptions of presented natural phenomena as well as metadata and descriptive text within the application (Lutz et al., 2009). Beside a language template system for in-application-navigation use, a vocabulary web service is demonstrated to access content the thesauri, classification schemes, taxonomies, metadata and other types of controlled vocabulary and to document, link and merge concepts/terms to be with other spatial and non-spatial data (Antoine Isaac and Ed Summers, 2008). Further intentions include also a possibility to upload and geolocate orally passed on knowledge in the regard of ancient place information.

Evaluation of the lexicon’s effectiveness will be measured in part by its ability to be applied successfully to the SMART portal web mapping and cataloguing application.

References:

  ANTOINE ISAAC, V. U. A. & ED SUMMERS, L. O. C. 2008. SKOS Simple Knowledge Organization System Primer [Online]. Available: http://www.w3.org/TR/2008/WD-skos-primer-20080221/.
  BOAST, R. P. 1991. The legal framework for geothermal resources : a historical study : a report to the Waitangi Tribunal. Wai 153. Wellington: Waitangi Tribunal, 1991.
  DE BRES, J. 2008. Planning for tolerability: promoting positive attitudes and behaviours towards the Māori Language among non-Māori New Zealanders. Ph. D (Linguistics). Wellington: Victoria University of Wellington.
  KAWHARU, M. 2002. Whenua : managing our resources, Auckland: Reed, 2002.
  KLUG, H., DAUGHNEY, C., VERHAGEN, F., WESTERHOFF, R. & WARD, N. D. 2011. Freshwater resources management: Starting SMART characterization of New Zealand’s aquifers. Earthzine. http://www.earthzine.org/2011/12/13/freshwater-resources-management-starting-smart-characterization-of-new-zealands-aquifers/.
  KMOCH, A., KLUG, H. & WHITE, P. 2012. Freshwater resources management: first steps towards the characterisation of New Zealand's aquifers. GI_Forum 2012: Geovisualization, Society and Learning, 2012 2012 Salzburg. Car, A., Griesebner, G., Strobl, J., 376-385.
  LUTZ, M., J.SPRADO, E.KLIEN, C.SCHUBERT & CHRIST, I. 2009. Overcoming semantic heterogeneity in spatial data infrastructures. Computers &Geosciences, 35, 739-752.
  OGC 2012. OGC Standards. http://www.opengeospatial.org/standards: Open Geospatial Consortium.
  TIPA, G. & TIERNEY, L. 2003. A Cultural health index for streams and waterways : indicators for recognising and expressing Māori values. New Zealand. Ministry for the Environment.
  WHITE, P. A. 2006. Some Future Directions in Hydrology. Journal of Hydrology (NZ), 45, 63-68

Geospatial web-enablement for environmental data in New Zealand

This blog post can be seen as a sequel to a former blog post on the introduction on geospatial data sharing and spatial data infrastructures (SDI), where I explained the basics of OGC standards and web services. Quite some research organisations and governmental agencies already employ OGC standards to make data available online, often even free of charge for the public. I would like to present some really good examples of interoperable data sharing in New Zealand.

Through the standardised and web-based access to so many data sources, not only traditional geographical processing and analysis (GIS) based research is made easier, but also complete new technical and methodological research possibilities arise.

LINZ - Land Information New Zealand

I would like to start with Land Information New Zealand (LINZ). LINZ, as a governmental body, has issued and maintains New Zealand’s geospatial strategy. LINZ runs the LINZ Data Service, which provide tons of NZ-related data sets, topography, maps, place names and much more, almost all of it is available under a NZ Creative Commons license. You can register for free, get an API key and use data directly through web, basically as long as you tell that it is LINZ data. LINZ provides standard OGC CSW, WMS and WFS web service interfaces.

http://data.linz.govt.nz

More news about the NZ geospatial strategy can be found on here.

DOC – Department of Conservation

Also the New Zealand Department of Conservation is going towards geospatial web services. It looks like they use ESRI software, which supports OGC standards to certain bit already, although ESRI (producer of the ArcGIS software) as a commercial closed-source software provider has been known to notoriously neglect open standards. However, the Shapefile format is open and besides ESRI REST services, the DOC Geoportal also allows for OGC-based access (CSW/ISO 19139 metadata for search and discovery and WMS/WFS for map/feature data access)

http://geoportal.doc.govt.nz

GNS Science

The Institute of Geological and Nuclear Sciences is one of the 9 New Zealand Crown Research Institutes (CRI), which conduct about one half publicly/governmentally funded and the other half commercial research projects and, together with the universities of course, can be seen as New Zealand’s main science and research providers, each claiming a particular scientific domains. GNS Science is New Zealand’s leading provider of Earth, geoscience and isotope research and the geological survey of New Zealand. GNS’s research topics also include volcanoes, earthquakes, geothermal features and groundwater.

GNS has published the 1:250 000 Geological Map of New Zealand (QMAP. It is also digitally accessible – GNS exports the QMAP as OGC WMS and WFS in the OGC format GeoSciML. An easy way and very interesting example for interoperability is to explore New Zealand’s geology is through the OneGeology project, which sources and displays such services from geological surveys from all over the world.

The GNS-EU collaborative SMART Acquifer Characterisation programme (SAC) also aims to connect OGC based data sources. Within the research aim “Data Synthesis and Visualisation” the SMART Data Portal aims to develop an integrated OGC framework for discovery, access, processing and visualisation of hydrogeological data.

http://data.gns.cri.nz/metadata/

NIWA – National Institute of Water and Atmospheric Research

NIWA NIWA, another CRI, has a strong reputation in climate, marine and marine ecosystem and biodiversity sciences. Whereas a lot of organisations and agencies make data available first and then (if at all) add more sophisticated search technology, NIWA started the other way round. They established a discovery portal - the Environmental Information Browser, which is basically a catalogue, where one can search by keywords, places, data and time. All the data NIWA has, will eventually be listed and can be queried and also harvested through the OGC CSW interface. Furthermore NIWA is also moving towards providing OGC web services to their data sets. One particular example has been a “Summer of eResearch” project and its progress documented on the eResearch website.

http://ei.niwa.co.nz

Landcare Research

Landcare Research is also a New Zealand Crown Research Institute and focuses on the management of terrestrial biodiversity and land resources in order to both protect and enhance the terrestrial environment. I have come across several Landcare projects on soils and land use data, where Landcare not only uses OGC standards, but also participates in the development and maturing of some of those standards. Like the former parties, Landcare runs a data or geoportal (LRIS), too, which can be accessed and queried through CSW, WMS and WFS web interfaces,

https://lris.scinfo.org.nz/

Landcare also hosts a dedicated soil map portal (S-map), which sources the digital soil information layers based on WMS. Furthermore they drive the development of a global soil map portal (http://www.globalsoilmap.net/), which under the hood, of course, uses OGC standards again. To enable international, comparable, interoperable soil data exchange Landcare participates in the development of a soil information standard.

Outlook

Regional councils are on the way, too. Many regional councils already make data accessible on their web sites. A quick investigation shows for example Environment Waikato, Horizons, HBRC, BOP or Environment Canterbury. However most of these data sources need to be accessed manually and/or do not provide a standardised interface. Not to speak of a generalised way to actually find them. In conjunction with the open data initiatives (Open and Transparent Government , Open New Zealand) and catalogues available ( government datasets online, Open Data Catalogue), there is massive potential to link diverse datasets, relate and analyse seemingly unrelated datasets and gain new insights, find and (re-use) data by type, time and location or just enable ubiquitous mobile access to the data you need. However, we might end up needing a catalogue for the catalogues, and of course a lot of existing data needs to be geo-located/geo-referenced, so that they could be found by location. There is still a way to go and definitely some more research necessary in that space.

Originally posted on the New Zealand eResearch website - 16/04/2013

SOS for CLIDB Mid-term - we got data

Based on the "vanilla" code from the 52North SVN repository I basically added a CLIDBHelper class to the "52n-sos-hibernate-core" Maven module that encapsulates the CLIDB database connection and re-directed most of the original Hibernate calls from the core DAOs to the helper.

Especially the Cache Feeder DAO needed a lot of attention, as it would fill the internal "capabilities" cache, which is the basic thing that needs to happen before the SOS instance is actually usable.

Then Describe Sensor DAO and GetObservation DAO are pretty straightforward, as they would "just" do specific queries, like give me the sensor description for sensor station XY or give rainfall data for station XY in the time period ...

Link to the full eResearch blog post

Final NZ Summer of eResearch 2012 presentation slides

The final student project presentations were held in Wellington at Victoria University.

Link to the slides of the final student project presentation

Random Reflections

Kia Ora :-)

The last weeks, two months were packed with experiences, developments, progress. I would like to shortly summarise the main three happenings. It is great to see progress and experience interest in that progress, so I'd like to share that, too :-)

New Zealand Hydrological Society Conference 2012, Nelson and the Data Access Workshop

• Water: know your limits (linked from NZHS website)
• Data Access and Visualisation Workshop at HydSoc (resources)

New Zealand Summer of eResearch (Dec 2012 - Feb 2013)

• NZ Summer of eResearch (Centre for eResearch, Auckland University)
• Sensor Observation Service (OGC SOS) for NIWA CLIDB
• Blog posts within the Summer of eResearch project context
• Introduction
• A first review
• A side note on geospatial data sharing
• Mid-Term review

SCANZ 2013 3rd nature hui and wananga symposium

• Intercreate.org and SCANZ 2013: 3rd nature
• Wananga-symposium (Friday to Sunday)
• Our abstract - a groundwater portal for New Zealand, towards a Te Reo Maori and Matauranga Maori integration with "Western Science"

This is sooo much stuff, I will have to write out details later :-) So far enjoy the links.

A side note on geospatial data sharing and spatial data infrastructures (SDI)

This blog post is dedicated to provide a general overview over the field of geospatial and environmental data sharing. The term geospatial is actually tautologous: The prefix “geo” implies geography, which always relates things to each other based on their location, where nearer things are stronger related than things further away from each other (Tobler’s 1st law of geography). And the word “spatial” also means having an extent and location in a space. However “geospatial” nowadays is almost exclusively used in the field of digital data with geographical context. Therefore software that delivers, analyses, presents, processes, stores and retrieves is also often called geospatial software (having its origins in the good old GIS – Geographical Information Systems).

Part 1: GIS and GI Science intro

Research areas that work on the science behind GIS and spatial data, on the analytical methods, processes techniques, on ways of (standardised) spatial data exchange, effective and efficient storage and retrieval, are called GI Science, Geoinformatics, Geomatics, Geocomputation, Spatial Computation or Spatial Science … There is actually quite some discussion, if the necessity, even an entitlement for such a dedicated mixed branch of computer science and geography exists, a similar discussion when geography emerged as an accepted field of research (ref). On the other hand you’ll often find the quote that “80% of data has a spatial component” or something like that. Apparently I can get the source right anymore, therefore you might handle this with care. It might go back to the 1990s when GIS software for PCs wanted to get their feet into the market (gis lounge). However a lot of data in the geosciences have a spatial context and - a lot - of those data are needed for governmental agencies to manage land and water resources properly :smile: Agreed?

Part 2: The Opengeospatial Consortium, aka OpenGIS, aka OGC

“The Open Geospatial Consortium (OGC) is an international industry consortium of 479 companies, government agencies and universities participating in a consensus process to develop publicly available interface standards. OGC® Standards support interoperable solutions that ‘geo-enable’ the Web, wireless and location-based services and mainstream IT.”

The OGC standards framework provides means to build a spatial Data infrastructure (LINZ - Land Information New Zealand) – which is “the technology, policies, standards, and human resources necessary to acquire, process, store, distribute and improve the usability of geospatial data. (SDI) facilitates the connections between these important sources of information, and allows people to find and access them.” Quite some of the OGC standards and web services are also ISO international standards. There are interface and service descriptions on the one hand and data encodings/formats and conceptual data models on the other side. I will provide a short summary:

WMS – Web Mapping Service (ISO 19128 WMS v1.3.0)

Essentially provides (web) maps (as images like png or jpg) output data Geographiclly correct images, png, jpg, view or portrayal service

Major methods: GetCapabilties and GetMap

WFS – Web Feature Service (ISO 19142 WFS v2.0)

Provides an interface to access, query, store and retrieve vector “features”, aka discrete data – like in ESRI shapefiles. Data is accessible by their data schema, which can be soft-typed and values in schema fields and location queries are utilized. Output GML (ISO 19136), which is in a particular “domain-specific” XML schema. With WFS-T – transactional – there is also support to write back to the WFS server.

GetCapabilities GetFeature – get the data DescribeFeatureType – get schema

WCS – Web Coverage Service

Provides an interface to access, query and retrieve raster imagery and coverages, grids (aka “fields”) as in continuous data. eg NetCDF-CF, GeoTIFF, ArcGRID

GetCapabilities DescribeCoverage GetCoverage

CSW – Catalogue Service for Web (ISO 19115 CSW 2.0.2)

Provides an interface to access, query, store and retrieve metadata, aka data about the geospatial data, which is accessible through other geospatial webservices. Output is usually XML ISO 19139 metadata or Dublin core.

GetCapabilities GetRecords – find metadata record by search criteria GetRecordById – get one record by its unique id DescribeRecord – metadata type GetDomain – get range of values and/or keywords

SOS – Sensor Observation Service

Provides an interface to access, query, store and retrieve time-series based data that has been measured at locations, eg through sensors or field surveying/sampling. But the focus is to query on temporal and then on spatial or value comparison basis. Standard output formats are O&M, WaterML2.0 time-series and SensorML sensor/procedure metadata.

SOS is part of the sensor web enablement initiative (SWE) which advances to its version 2, where a lot of things become more flexible, but also moe complicated. I will write about that later ☺ SOS explicitly also describes a group of methods to insert sensor and observation data. This is handled through different profiles.

GetCapabilities GetObservation DescribeSensor

There are quite some commercial and Open Source software packages and tool kits available, for the desktop and server-based for the web that support or where explicitly written for OGC webservices and splendid Open Source resources in the web:

OSGeo Foundation: http://www.osgeo.org

(Spatially enabled) Databases:

• Postgresql/Postgis
• MySQL
• Oracle Database
• Microsoft SQL Server
• ESRI Geodatabase / ArcSDE
• SpatiaLite
• Rasdaman
• GeoCouch

Data Servers (store data in databases):

• Geoserver (WMS, WFS, WCS)
• Mapserver (WMS, WFS, SOS)
• 52°North SOS server
• Geonetwork (CSW)
• ESRI ArcIMS / ArcServer
• Thredds (WCS, netCDF)

Web mapping tool kits / frameworks (take data from data servers):

• openlayers
• Mapbender
• MapFish
• Geomajas
• Flash
• Silverlight

Desktop clients supporting (at least partially) OGC standards:

• QuantumGIS
• uDig
• ESRI ArcGIS
• Intergraph Geomedia

And on it goes … in the next weeks, I will write about New Zealand and international examples of OGC webservices implementations and SDIs for geospatial data publishing (where the data is basically public domain and needs to made accessible) and provide some closer insights to OGC SWE and the next generation sensor networks initiative SWE 2.0 et al.

A Climate Database Web Service - 1st Review

The first week before the break I spent some efforts to integrate my software development project into NIWA’s software development process and environment. So it is ensured that once I have finished the eResearch project, the software can be maintained by NIWA staff afterwards. They also provide an
elegant and robust development environment with the Eclipse IDE, source code revision management (Subversion), continuous integration (Jenkins) and testing. This shall ensure software quality and functionality being checked automatically with every code commit for everything that is developed within the research institute.

Link to the full eResearch blog post