Showing posts with label Z_GIS. Show all posts
Showing posts with label Z_GIS. Show all posts

Thursday, 30 June 2016

Amazon IoT and OGC SensorThings vs SOS/SPS on MQTT

Today I stumbled over a blog post on the OGC Blog about "Amazon IoT and the candidate OGC SensorThings API Standard"

It was great to learn that Amazon IoT uses MQTT as network / transport layer. The more interesting is the move towards REST (which is HTTP) to address semantic issues with IoT systems:
AWS IoT, MQTT and many other network interoperability standards (LWM2M, CoAP, etc.) enable message interchange.  However, IoT network interoperability doesn’t enable the systems that are exchanging messages to interpret those messages. To realize the many-to-many system-of-systems vision, IoT applications need to implement standard ways of communicating sensor locations, sensor and data parameters, and sensor instruction sets. This is what the OGC SensorThings API provides.
It is understandable from the point of view, that OGC OWS is in general intrinsically interwoven with HTTP semantics and the application of SWE in the IoT context is desirable, well, even crucial.

However, MQTT stems from the constraints of low bandwidth, low energy consumption and unreliable connectivity, and implements a robust, small footprint asynchronous messaging platform. Earlier this we have developed a prototype system, that aims to add SWE semantics into MQTT messaging. We keep the specialisation of MQTT, where for example connections can be resumed which under SSL/TLS security can be a significant power saver. MQTT would also better address the "addressability" of distributed "things" which might be isolated behind IP NAT or run with dynamically assigned addresses, because in MQTT context the "things" would subscribe to SPS management topics and therefore higher order SDI services don't need to direct data queries or task requests to an address but place it on the queue with respective topics.




For an agricultural research project we distributed monitoring stations as a wireless sensor network throughout the catchment to deliver frequent measurements in near-realtime, which mimics OGC SOS.

A dynamic implementation of measurement frequencies, adapted to certain environmental conditions like heavy rainfall events require re-tasking of the nodes, which mimics OGC SPS. Within this paper we provide a framework where a threshold event triggers a reconfiguration task for a phosphorus measurement device, using asynchronous, push-based communication, on an MQTT queue, which links the ground stations with a cloud-based control system. OGC WPS algorithms continuously analyse incoming SOS measurements commits such a request into the wireless sensor network, and updates the measurement frequency of the target nodes to enable nutrient peak flow estimation during storm events.


This on-going work is based on original thoughts on the  interlinking  of  OGC  SWE  semantics  for  sensor  descriptions  and  observations (OGC Sensor Observation Service, SOS), sensor configuration and planning (OGC  Sensor Planning Service, SPS)  with  the  open  Message  Queue  Telemetry  Transport  (MQTT)  protocol.
MQTT  is  a  simple,  yet  very performing  and  robust  publish/subscribe  message  passing  system,  which  can  also  serve  for  event  brokering as  described  in  the  SWE  Service  Model.  Actual  addressing  and  data  transmission  is  done  by  a  topic  string and an arbitrary payload. The topic string and the payload need to reflect the necessary standard semantics to be  mapped  back  and  forth  to  allow  for  a  seamless,  and  preferably  lossless  bi-directional  multi-lateral communication  between  the  WSN  as  data  provider  (SOS),  web  clients  as  data  consumers  (SOS)  and  the management system, which interacts with the WSN in a standardised way, too (SOS and SPS). 



Monday, 4 February 2013

Random Reflections

Kia Ora :-)

The last weeks, two months were packed with experiences, developments, progress. I would like to shortly summarise the main three happenings. It is great to see progress and experience interest in that progress, so I'd like to share that, too :-)

New Zealand Hydrological Society Conference 2012, Nelson and the Data Access Workshop





New Zealand Summer of eResearch (Dec 2012 - Feb 2013)


SCANZ 2013 3rd nature hui and wananga symposium



This is sooo much stuff, I will have to write out details later :-) So far enjoy the links.

Monday, 27 August 2012

GSoC and Master Thesis completed

Busy summer, well or winter, depends on the hemisphere and the full time extent. Last 2-3 months have been packed with work and included about 25.000 air miles (which means concatenated spending several days in airplanes).
I finally managed to finish my Master Thesis "Towards a 4D WebGIS using harmonised datasets: Examined on a New Zealand Example" which examines in the first part existing groundwater-related geoportal projects and scientific applications around the globe, existing and useful, web-based technologies and standards (e.g. OGC) to implement such a portal, a draft architecture. In the second part actual prototypical implementations of a selected subset of the examined standards and and technologies demonstrate their feasibility for the SMART project. I also hold a talk at the GI_Forum conference in Salzburg (proceedings/conference paper).
Furthermore I successfully completed my Google Summer of Code (GSoC) project with the 52°North Initiative, where I implemented an exchangeable encodings mechanism for their Sensor Observation Service (SOS). I additionally implemented a plugin that provides SOS time-series output in the WaterML2.0 format. I could acquire the latest schema, which will be published soon.. we were supposed to write a series of blog articles to document or progress in the project:

After flying back to New Zealand I was lucky to visit the GeoSciML Face-to-Face-Meeting at GNS Science in Wellington. It was really exciting to meet these people, working on the international standard of a Geoscience Markup Language. also issues around the OneGeology portal have been disussed, as it uses GeoSciML to build up a world geology map. Additionally I could get in touch with one of the inspiring driving persons behind the Canadian Groundwater Information Network and their its sematic foundation, the Groundwater Markup Language (GWML), which itself is derived from GeoSciML.
Now I will dedicate my research to the development of a New Zealand groundwater geoportal within the SMART project, using OGC webservices, GeoSciML and/or GWML, WaterML2.0 and X3D as its foundations to transform and consume all available data relevant to aquifer characterisation and create a completely new, visually appealing 3D/4D view on New Zealand's groundwater resources.

Exciting ;-)

Thursday, 5 April 2012

Groundwater Resources in New Zealand

Data Synthesis and visualisation for groundwater resources in New Zealand


“As a conservative estimate, better understanding of groundwater resources could lead to improvements in water management with potential to prevent social, cultural, environmental and economic losses of $1 billion or more, about 1% of New Zealand’s GDP. Understandably, central and regional government has identified improved characterisation of groundwater resources as a top research priority.”
The SMART project is about characterisation of New Zealand’s aquifers, to improve ground- and freshwater management (www.smart-project.info).


The main research aims of the SMART project

  • focus on novel, passive suite of methods to measure groundwater volume and changes in it over time
  • aquifer hydraulic properties
  • fluxes of groundwater interchange with surface waters
  • water age
  • with methods like ...
    • ambient noise seismic tomography
    • airborne geophysical surveying
    • satellite remote sensing
    • fibre optic temperature sensing
    • novel age tracers
Outcomes shall made available via a web portal and harmonised 3D groundwater database that will meet stakeholder needs for open access, ease of use, and interoperability with existing systems. Furthermore the integration of existing data is crucial.

My Thesis Topics

I contribute in the field of “data synthesis and visualisation” in the form of a prototype 3D/4D WebGIS, data processing and web services to provide harmonised hydro(geo)logical data from multiple sources. Within the works for my Master Thesis until June 2012, I identified following milestones:
  • stakeholder consultation - groundwater workshop, visited HBRC and EW
  • gather and analyse (sample) hydro(geo)logical datasets from wells, boreholes or pump tests, managed in systems/databases like GGW/NGMP (GNS), Hilltop and Wiski (very popular among regional councils) – Feb 2012
  • find a common data scheme/data model, migrate and/or transform data online and provide via web services to connect to a (NZ) SDI or integrate/link in web portal for easy access – April 2012
  • identify appropriate technology and standards (ISO, OGC, OASIS … ) 3D/4D visualisation in the web, as aquifers are inherently 3D structures plus time (water time series data -> 4D) – June 2012
The prototype implementations of this thesis will be in test mode, accessible by designated staff and stakeholders. The research about “data synthesis and visualisation” including the topics of this Master Thesis will be continued in more detail by a PhD student from July 2012.
We focus on hydro(geo)logical data. The first steps are about accessing multiple existing sources of data and find a way to publish them via web services (most likely OGC).

Major Challenges include

  • complexity of water-related data – many parameters and measurement properties, parameter naming, units etc.
  • data policy issues (ownership, restricted access ...)
  • data quality and quality and assurance issues – uncertainty, hint/description in metadata
  • as existing data often is not accessible outside their environments (GNS network, regional councils’ local data storage), or mostly via manual file-based email/ftp interchange or as “pdf”-reports, the publishing of existing data from multiple sources is anticipated via the web e.g. via WMS, WFS, WCS, WaterML2.0?, SOS, download (shapefile, raster coverage) to allow easy recombination, correlation and analysis at national scale (surpassing regional boundaries)
  • find a common data scheme, probably “just” implement a software to access databases and deliver WaterML2.0?! Good idea might be to transform online (e.g. XSLT/WPS web service)
  • provide infrastructure, for storage, access, delivery and manipulation of different geodata (vector, raster, time series …)
  • Prepare catalogue and provide metadata in standard encodings (XML, OGC web services, ISO 19115/19139 metadata, CSW, CS-W ebRIM/ISO)
  • Regarding exisiting methods and infrstructures, like Auscope / SISS (AU), GeoNet (NZ), GENESIS FP7 (EU), CUAHSI (North America)
  • Think about GeoSciML for description of geology and geometry, as WaterML is more about time series and measurement data prototypical web 3D/4D map/aquifer visualisation (X3D earth ...)

Monday, 30 January 2012

Hello World

"Hello World"

Obligatory, awkward first post :-)

I am going to post infos about stuff I am actually doing. That mainly includes my UNIGIS studies and the Master Thesis in particular. I am officially matriculated at the University of Salzburg, Austria. I am contributing to their research in the SMART project as a working student in New Zealand. My main interests and recently my main activities lie in the convergence zone of web technologies and GIS. Pretty cool stuff ^^

Cheers,
Alex