Kamil Nešetřil

Environmental data management and analytics

User Tools

Site Tools


Action disabled: source

Tools

Pentaho Platform – BI   Pentaho Data Integration (Kettle)   PostgreSQL – database DBeaver – database manager + (R – programming language  QGIS – geographical information system Nextcloud – alternative to Dropbox, Google Drive or OneDrive)

HgIS applies BI tools (Pentaho platform) and GIS for the groundwater domain. Technologies and tools used in HgIS are listed here.

Apache Hop :!: Since Hitachi acquired Pentaho, the development of the Pentaho platform has stagnated, and the platform's website is confusing. The original author of PDI (Matt Casters) created Apache Hop, a fork of PDI that finally has elegant architecture and is being intensively developed. PDI transformations can be imported into it.

Pentaho platform

Pentaho platform

Pentaho platform is a set of business intelligence tools.

Pentaho Platform components and typical deployment

It contains the following components (download):

  • Pentaho Report Designer (screenshot).
    Development of Pentaho Reporting does not move forward, so it makes sense to use an alternative as Metabase – easy-to-use data analytics. FOSS alternatives in Python are Superset or even Redash.

  • Pentaho Server (PBA, formerly BI Server, screenshot) is a key component of the platform. Dashboards can be executed here. Dashboards can be designed by CDE – more: Community Tools (CTools).

  • Pentaho Metadata Editor – creates an abstract data layer. See a figure:


Machine Intelligence utilizes engines: R, Python, Weka, or Deeplearning4j (Java with GPU Nvidia).

Adaptive Execution Layer (AEL) runs transformations not only locally or on the Pentaho Server, but also on Spark. Pentaho also supports cloud platforms like Amazon Web Services, Google Cloud Platform, or Microsoft Azure (Cloud agnostic analytic pipeline). Alternative to AEL is Apache Beam.

Pentaho platform is built on

PostgreSQL / PostGIS

Other GIS tools

  • QGIS – desktop GIS
  • QGIS Server – map server
  • EnviroInsite – advanced hydrogeological visualization. The company developing EI was acquired by the corporation developing EQuIS (EarthSoft). It does not plan to develop the standalone EI.2) Therefore, we plan to replace EI probably by QGIS with the Midvatten or FREEWAT3) plugin.

For detailed information, go to the Czech version of this site.

1)
Acronym means: Kettle Extraction, Transformation, Transportation and Loading Environment.
2)
"EarthSoft will release new versions of the desktop EnviroInsite in EQuIS Professional, but does not currently plan to release new versions of non-EQuIS versions of EnviroInsite."
3)
The AkvaGIS tools enhance FREEWAT with hydrochemical and hydrogeological data processing and analysis.
Last modified: 2024-03-21