Skip to main content

Apache Zeppelin integration with Geonetwork

We've been exploring Apache Zeppelin as a way of providing a powerful and flexible analytical interface for Geonetwork and are pleased to announce beta integration with the Geonetwork login credentials.

Astun use Geonetwork 3.2 as our metadata portal, supplying metadata to local authorities and government bodies, for both INSPIRE and Enterprise use. A question our customers often ask is which metadata records are the most popular? Our Enterprise customers also have more detailed requirements, such as discovering which metadata records have been started but not finished, how many have been published and so on.

Geonetwork itself provides search and content statistics, but only to users with Administrative rights, and it's not always straightforward to extend these to include new search options.

Enter Apache Zeppelin!

From the blurb:
Apache Zeppelin is a web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.

It's possible to connect Zeppelin to PostgreSQL, which is the database we use behind the scenes to store not only the Geonetwork metadata, but also user information, metadata status, and so on. Therefore, we can use Zeppelin to interrogate the Geonetwork catalog using SQL, and do more analysis than is exposed by Geonetwork itself.



Zeppelin provides a safe, read-only front-end to the database, avoiding any concerns about data integrity. Query results can be displayed in a number of ways, so the end-user can choose the most appropriate chart type for their data. Users can embed their results in reports, or send links to colleagues, and can schedule query updates to ensure the reports are always up to date.

Integration with Geonetwork


The holy grail of this work is to seemlessly integrate Geonetwork and Zeppelin so that users don't have to log in to both packages, and maintain two sets of passwords. Eventually we also want to style Zeppelin so that it fits with the new, clean Geonetwork style, and link to it from the Geonetwork home page.

The first part of this wish-list is now complete! We commissioned GeoCat, as core Geonetwork developers, to build the necessary components, and a beta-version of this code is now available on GitHub. This can be configured to connect to a Geonetwork PostgreSQL database and will allow you to log in with your Geonetwork Administrative credentials.

Watch this space for further enhancements!

Comments

Popular posts from this blog

Improving project documentation with a codesprint

Background  At the end of November I was asked by Francois Prunayre at Titellus to help organise and manage a 3-day code-sprint with the aim of improving GeoNetwork documentation . Documentation can be problematic for projects, even open source, where the majority of the work is done by volunteers. Updating documentation is rarely a priority for developers, who are time-poor and have actual project issues to deal with, and efforts to widen the base of contributors so that others can help, also take time. Back to the code-sprint This code-sprint was timed very well though, as it comes on the back of work being done to update GeoNetwork documentation as part of OSGeo's participation in Google's Season of Docs . This pairs a paid technical writer with an open source project for either three or six months, with the aim of seeing a rapid improvement in that project's documentation. I'm an admin and mentor for OSGeo on Season of Docs, so was well-placed to provide inp...

Reflections on the Amazon Web Services Summit, 2018

Last month, a handful of us from 'operations' attended the AWS Summit to keep up to date with what is going on in the Amazon Web Services world.  We've shared our reflections in this Blog and linked through to videos or slides of the sessions where we can. What is the AWS Summit? Amazon run a series of global events in major cities around the world getting to each one every couple of years; 2018 was London's turn. Amazon Web Services (AWS) is a cloud hosted computing platform, that Astun use for pretty much everything.  Our own cloud products and services such as iShare in the Cloud, Astun Data Services, Geonetwork / INSPIRE are all hosted there.  Even if what you use from us is exclusively deployed on your own premises, all of software development and most of our internal IT is done in the AWS environment.  It is critical to our business.  If you think that we are putting all our eggs in one basket, it is worth remembering that AWS is a $22 billion p.a. ...

QGIS 3.0: the time has come...

QGIS 3.0 was released in February , and although it's labelled an 'early adopter' release, with the long term release (LTR) available in October, there's plenty in it to excite not just the early adopters, but the rest of us too. We've had a chance now to have a good look at it, kick the tyres a bit and see what everyone has to say about it, so here are our thoughts. There are a few big steps forward - for example 3D support and multiple map canvasses - and while many of the other changes are relatively minor on their own, put together they represent a major leap in usability and effectiveness. There's been work on consolidation, upgrades of core packages, efficiency and speed improvements, resulting in a slicker, easier to use and more tightly integrated application. You could say that the 'easier to use' bit is the best thing about QGIS 3.0 - and when you think about it, that's not a description that could be applied to most application upgrad...