Showing posts with label X3D. Show all posts
Showing posts with label X3D. Show all posts

Wednesday, 28 October 2015

Environment Southland Information Management Conference

Regional councils and government agencies are increasingly under pressure to resolve data questions and discover how best to acquire, manage, collate, analyse, report and disseminate data, while managing  the associated costs. Steering organisations through these complex issues requires a solid understanding of what technologies are available and the information demands of the future *(source).

I had the great opportunity to speak at the Environment Southland Information Management Conference in Invercargill. It was a great event, well organised and very informative. I believe I could contribute my part to the line up and fill a few more gaps in the whole picture.
This was not a business as usual conference, it was obvious that the speakers took it serious to cater their presentations to the needs of the stakeholders. And with 70 attendees from regional and central government, as well as visitors from research and industry.


It was great to see the emerging patterns around NZ and similar approaches to a holistic, comprehensive and modern data strategy. If you are interested, this is a link to programme, and please see below for my slides. Watch the talk on Youtube.





Monday, 24 November 2014

Web-based 3D Data Visualisation for Hydrogeology

When I was in Salzburg/Austria last year at the GI_Forum 2014 conference, I had the chance to present some of my recent experiments with the mapping of OGC interoperable geo-data to X3D interoperable open web 3D scenes and visualisation in the browser. Back in New Zealand later that year I had to present this work to the New Zealand Hydrological Society, too, of course :-)

Characterisation of a hydrogeological setting is a multi-faceted complex task. The assessment of usefulness and quality of relevant data is a major challenge. Statistical analysis and visual exploration of the datasets demand practical support by computer applications. Although a variety of software for this purpose is freely available nowadays, they require a good understanding of the technology or programming language for application in complex hydrogeological settings. Thus, integrated proprietary software products are often used to analyse and particularly provide high-quality visualisation of the system. However, these software tools are typically desktop programs with a strict licensing scheme and a limited extensibility and lack of interoperability with other applications.
We present an open and free to use web-based (platform independent) framework to enable retrieval, exploration and visualisation of hydro-climate time series data as well as three-dimensional geological information via a web browser. How distributed data and processing services can be linked to prepare an on-demand 3D visualisation of geological and hydrological data is demonstrated. A flexible toolbox design enables extensibility via open standards.

The method developed is applied to a case study area presented (s. figure), which is the Horowhenua district in the Manawatu-Wanganui region. Available datasets of 3D geology, hydrology and hydrogeology are combined and serve as example data for demonstrating the framework.

The slides of the presentations are now made accessible here (click here).

The full ISI-indexed conference paper is available here (click here).


Sunday, 15 July 2012

First X3D example to visualise geological layers in the web

Recently I have played around with tools to visualise geological layers in 3D in the web, preferably without any browser plugins. With HTML5 and WebGL some really cool possibilities arise. WebGL is not supported by every browser, but apparently  all newer cool browsers like Chrome or Firefox, as well as Safari and Opera support WebGL at least experimentally. What a surprise that Microsoft Internet Explorer does not net yet support neither HTML5 canvas nor WebGL. But luckily there is the Chromeframe plugin :-)

If anyone has ever been working with OpenGL for 3D stuff probably in C or C++, well, WebGL is quite arcane, too, but in JavaScript ^^

Nevertheless, X3D for the rescue. X3D is a) an ISO standard (ISO/IEC 19775-1.2:2008 ), b) the successor of the working, but not really successful VRML97 (ISO/IEC 14772-1.2:1997) and c) a fully XML-based scenegraph declarative language. And the final ingredient is the Fraunhofer IGD experimental open source framework x3dom that thrives to integrate X3D content into HTML5.

Well, to the actual task. I am supposed to visualise a 3D geological model that originally has been designed with EarthVision(c). EarthVision(c) has its own binary format to store the 3D models, but they van be exported to a simpe XYZ-ASCII file:

2696105 6047205 150 20 11
2696605 6047205 150 21 11
2697105 6047205 150 22 11
2697605 6047205 150 23 11
2701105 6047205 150 30 11

...

The first two columns are Easting and Northing - implicitly known that the spatial reference system is New Zealand Map Grid. Third column is the height value and the further columns represent some additional attribute data. Based on the resolution, the surfaces from the roundabout 20 km  by 30 km range from 50KB (500m), 1MB (100m) to 20MB (20m) per layer (5 layers altogether).
X3D provides two easy (point set based) possibilities to show surfaces (right now the geological layers are represented as surfaces, they are not described as full bodies).

Furthermore there are the NURBS and extrusion implementations, which describes surfaces through splines. But that's rather complicated for the first shot :-) ElevationGrid requires an evenly spaced grid of height values, whereas IndexedFaceSet  notes all point coordinates and then defines coordinate indexes to define a mesh of single surfaces (similar to TINs, but not necessarily triangles).
I decided for the ElevationGrid. X3D has a geospatial extension (X3D Earth), which can geographically reference and place 3D objects in a defined spatial reference system. I didn't try this feature yet. And apparently it does not make sense to load 100MB for a 3D model into the browser. Therefore the 500m grid has been used here. The following example outlines a rather simple definition of such an elevation grid in X3D:

<shape> 

    <elevationgrid colorpervertex="false" creaseangle="3.14" def="Greywacke_top_500" 
        normalPerVertx="true" colorPerVertex='false' xDimension='37'
        zDimension='44' xSpacing='500' zSpacing='500' creaseAngle='3.14' solid='false'
        height='
150 150 150 ...
           '>
    </elevationgrid> 
    <appearance>
        <material ambientintensity="0.1" diffusecolor="red" id="Greywacke" 
            shininess="0.2" specularcolor="lightred" transparency="0.0">
        </material> 
    </appearance>
<shape>

To prepare that grid, you need to take care of some things:

  • you need to know the extent and resolution of the dataset, from that you calculate and define the x- and zSpacing (how many values will be filled, because you only need the height values)
  • the coordinate system orientation of the X3D 3-dimensional space is probably from the 2/2,5 coordinate system from the source dataset
  • the source datasets only contained points with actual values, to fill the ElevationGrid properly, NODATA values need to added
Finally I got my data sorted on built a neat first little demo :-) There might happen some improvement, as we are intending to visualise wells, bores and other hydro(geo)logical data in such a scene.

Fig. 1: Preliminary (X)3D  model with five layers and a (not aligned) image as an underlayer

Thursday, 5 April 2012

Boiling it down

Boiling it down


After all this theoretical research about why, what, when and how I identified three major work packages to develop a functional prototype:

  1. making existing groundwater-related time-series and measurements data sets available via SOS O&M (or even WaterML2.0) - March 2012
  2. chosing a demonstration area and associated available sample data, analyse, describe and harmonise these different data sets, design the database scheme and migrate them to the SMART main repository, display all fine in proper standard 2D web map - April 2012
  3. take exisitng 3D geological model ( x-y-z grids from EarthVision) and make them visible as X3D model in the browser (with or without plugin :-) ) - May 2012
The thesis should be submitted around mid of June, so there are some smaller buffers. But thesis itself needs to be written, too :-)




Designing the big picture

Designing the big picture


After literature review and further research and gathering a lot of information about state-of-the-art technology and paradigms, I designed a bigger concept of a possible, full-fledged WebGIS that is more than capable to support the data-related and computational needs of the research of the SMART aquifer characterisation program. after writing it down, we already got a paper to submit to the GI_Forum Geoinformatics conference.
.

SMART Portal archtitecture concept

As shown in the picture, the whole portal / WebGIS is based on standardised interfaces, mainly the OGC geo-spatial web services. as a requirement from the New Zealand Ministry of Science and Innovation all software produced (and used) should be Open Source, the main building blocks for the portal will be tested and evaluated in the prototype, I am going to develop:
  • PostGres/PostGis - data storage, spatial database
  • Geoserver - for WMS and WFS (subsequently WCS, too)
  • OpenLayers as web mapping client
  • 52North SOS Server, customise DAO backend to serve data from an existing legacy DB
  • Thredds server to serve netCDF coverage data
  • X3D as 3D file format to display 3D geological model in the browser
  • Geonetwork - CSW, metadata, to connect to upstream NZ spatial data infrastructure

Groundwater Resources in New Zealand

Data Synthesis and visualisation for groundwater resources in New Zealand


“As a conservative estimate, better understanding of groundwater resources could lead to improvements in water management with potential to prevent social, cultural, environmental and economic losses of $1 billion or more, about 1% of New Zealand’s GDP. Understandably, central and regional government has identified improved characterisation of groundwater resources as a top research priority.”
The SMART project is about characterisation of New Zealand’s aquifers, to improve ground- and freshwater management (www.smart-project.info).


The main research aims of the SMART project

  • focus on novel, passive suite of methods to measure groundwater volume and changes in it over time
  • aquifer hydraulic properties
  • fluxes of groundwater interchange with surface waters
  • water age
  • with methods like ...
    • ambient noise seismic tomography
    • airborne geophysical surveying
    • satellite remote sensing
    • fibre optic temperature sensing
    • novel age tracers
Outcomes shall made available via a web portal and harmonised 3D groundwater database that will meet stakeholder needs for open access, ease of use, and interoperability with existing systems. Furthermore the integration of existing data is crucial.

My Thesis Topics

I contribute in the field of “data synthesis and visualisation” in the form of a prototype 3D/4D WebGIS, data processing and web services to provide harmonised hydro(geo)logical data from multiple sources. Within the works for my Master Thesis until June 2012, I identified following milestones:
  • stakeholder consultation - groundwater workshop, visited HBRC and EW
  • gather and analyse (sample) hydro(geo)logical datasets from wells, boreholes or pump tests, managed in systems/databases like GGW/NGMP (GNS), Hilltop and Wiski (very popular among regional councils) – Feb 2012
  • find a common data scheme/data model, migrate and/or transform data online and provide via web services to connect to a (NZ) SDI or integrate/link in web portal for easy access – April 2012
  • identify appropriate technology and standards (ISO, OGC, OASIS … ) 3D/4D visualisation in the web, as aquifers are inherently 3D structures plus time (water time series data -> 4D) – June 2012
The prototype implementations of this thesis will be in test mode, accessible by designated staff and stakeholders. The research about “data synthesis and visualisation” including the topics of this Master Thesis will be continued in more detail by a PhD student from July 2012.
We focus on hydro(geo)logical data. The first steps are about accessing multiple existing sources of data and find a way to publish them via web services (most likely OGC).

Major Challenges include

  • complexity of water-related data – many parameters and measurement properties, parameter naming, units etc.
  • data policy issues (ownership, restricted access ...)
  • data quality and quality and assurance issues – uncertainty, hint/description in metadata
  • as existing data often is not accessible outside their environments (GNS network, regional councils’ local data storage), or mostly via manual file-based email/ftp interchange or as “pdf”-reports, the publishing of existing data from multiple sources is anticipated via the web e.g. via WMS, WFS, WCS, WaterML2.0?, SOS, download (shapefile, raster coverage) to allow easy recombination, correlation and analysis at national scale (surpassing regional boundaries)
  • find a common data scheme, probably “just” implement a software to access databases and deliver WaterML2.0?! Good idea might be to transform online (e.g. XSLT/WPS web service)
  • provide infrastructure, for storage, access, delivery and manipulation of different geodata (vector, raster, time series …)
  • Prepare catalogue and provide metadata in standard encodings (XML, OGC web services, ISO 19115/19139 metadata, CSW, CS-W ebRIM/ISO)
  • Regarding exisiting methods and infrstructures, like Auscope / SISS (AU), GeoNet (NZ), GENESIS FP7 (EU), CUAHSI (North America)
  • Think about GeoSciML for description of geology and geometry, as WaterML is more about time series and measurement data prototypical web 3D/4D map/aquifer visualisation (X3D earth ...)