Skip to main content

Apache Zeppelin integration with Geonetwork

We've been exploring Apache Zeppelin as a way of providing a powerful and flexible analytical interface for Geonetwork and are pleased to announce beta integration with the Geonetwork login credentials.

Astun use Geonetwork 3.2 as our metadata portal, supplying metadata to local authorities and government bodies, for both INSPIRE and Enterprise use. A question our customers often ask is which metadata records are the most popular? Our Enterprise customers also have more detailed requirements, such as discovering which metadata records have been started but not finished, how many have been published and so on.

Geonetwork itself provides search and content statistics, but only to users with Administrative rights, and it's not always straightforward to extend these to include new search options.

Enter Apache Zeppelin!

From the blurb:
Apache Zeppelin is a web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.

It's possible to connect Zeppelin to PostgreSQL, which is the database we use behind the scenes to store not only the Geonetwork metadata, but also user information, metadata status, and so on. Therefore, we can use Zeppelin to interrogate the Geonetwork catalog using SQL, and do more analysis than is exposed by Geonetwork itself.



Zeppelin provides a safe, read-only front-end to the database, avoiding any concerns about data integrity. Query results can be displayed in a number of ways, so the end-user can choose the most appropriate chart type for their data. Users can embed their results in reports, or send links to colleagues, and can schedule query updates to ensure the reports are always up to date.

Integration with Geonetwork


The holy grail of this work is to seemlessly integrate Geonetwork and Zeppelin so that users don't have to log in to both packages, and maintain two sets of passwords. Eventually we also want to style Zeppelin so that it fits with the new, clean Geonetwork style, and link to it from the Geonetwork home page.

The first part of this wish-list is now complete! We commissioned GeoCat, as core Geonetwork developers, to build the necessary components, and a beta-version of this code is now available on GitHub. This can be configured to connect to a Geonetwork PostgreSQL database and will allow you to log in with your Geonetwork Administrative credentials.

Watch this space for further enhancements!

Comments

Popular posts from this blog

Wychavon District, Malvern Hills District, and Worcester City councils sponsor improvements to the Gemini metadata plugin for Geonetwork

Astun have been working with Wychavon District, Malvern Hills District and Worcester City councils on some improvements to the Gemini 2.2 Metadata Plugin for Geonetwork.

The councils approached us at one of our User Group events in 2018 for some assistance with their joint data and metadata publishing workflow. In this workflow, data is published as WMS and WFS using Geoserver. Metadata in the WMS and WFS responses are harvested by Geonetwork to create metadata records, which are then published to data.gov.uk. The goal was to create fully valid Gemini 2.2 metadata directly from Geoserver, without the need for editing the records in Geonetwork. We worked with the councils to establish that the Geoserver INSPIRE plugin and built-in metadata tools met most of that requirement, but that some elements were either incorrectly added or missing entirely when the metadata was harvested into Geonetwork.

Astun have enhanced the Gemini 2.2 metadata plugin for Geonetwork to improve it's WMS an…

FOSS4G UK Edinburgh 2019

This year, Astun staff are giving 4 presentations and 1 workshop at FOSS4G UK Edinburgh to share with the community what we are passionate about as individuals, and as an organisation. At Astun we believe that we are the 'Experts in Place', but to live up to this claim we must do everything but stay 'in place' by constantly evolving what works, and revolutionising what doesn't. With that in mind, here's a preview of the presentations we're giving next month:
Matt Walker; OpenLayers Workshop The OpenLayers (OL) Workshop will guide attendees through the official Workshop material, providing a comprehensive overview of OL as a web mapping solution. The workshop format follows a series of modules covering everything from the basics of creating an OL map, through to specific functionality such as handling vector data, and building content for consumption on mobile devices.

We will work through as many of these modules as we have time for! The workshop material is…

GeoCom 2018 in London

IntroductionOn the 8th November the Association for Geographic Information held their 2018 conference at the Royal Geographical Society in London. Their focus was on productivity - how Location Intelligence can deliver a more productive economy. There was a wide range of speakers in attendance and they provided a diverse take on productivity with some hitting the mark more than others. If there was a common takeaway from the conference it would be about the growing size and availability of data. More on that later.
Presenters’ highlightsHelen Bartlett, Data Manager at the MET Office spoke of their new climate change dataset - UKCP18. The raw data has already been released but November sees the launch of the full service. The UKCP09 service will cease at the end of 2018. The 2009 data will be archived at the Centre for Environmental Data Analysis catalogue. The maps & reports for the 2018 key findings are available as PDFs. Raw data should be available this month.
William Priest, Ch…