HgIS

Správa a analýza dat o životním prostředí
Environmental data management and analysis

User Tools

Site Tools


en:tools

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Previous revision
en:tools [2019-06-06]
en:tools [2019-08-29] (current)
Kamil Nešetřil
Line 1: Line 1:
 ====== Tools ======= ====== Tools =======
-HgIS combines ​BI tools ([[http://​community.pentaho.com|Pentaho platform]]) and GIS. Technologies and tools used in HgIS are listed here.+|[[https://​community.pentaho.com|{{:​pentaho-hgc-logo.png?​nolink&​150|Pentaho Platform – BI}}]] \_ [[cs:​cheatsheet|{{:​spoon.png?​nolink|Pentaho Data Integration (Kettle)}}]] \_ [[https://​www.postgresql.org|{{:​logo_postgres.svg?​nolink&​36|PostgreSQL – database}}]] [[https://​dbeaver.io|{{:​logo_dbeaver.png?​nolink&​40|DBeaver – database manager}}]] + ([[https://​www.r-project.org|{{:​r_logo.svg?​nolink&​45|R – programming language}}]]\_ [[https://​qgis.org|{{:​qgis-icon32.svg?​nolink&​36|QGIS – geographical information system}}]] [[https://​nextcloud.com/​|{{:​nextcloud.png?​nolink&​60|Nextcloud – alternative to Dropbox, Google Drive or OneDrive}}]])| 
 + 
 +HgIS applies ​BI tools ([[http://​community.pentaho.com|Pentaho platform]]) and GIS for groundwater domain. Technologies and tools used in HgIS are listed here.
  
 ===== Pentaho platform ===== ===== Pentaho platform =====
 [[http://​community.pentaho.com|{{ ​ :​pentaho-hgc-logo.png?​nolink&​150|Pentaho platform}}]] [[http://​community.pentaho.com|{{ ​ :​pentaho-hgc-logo.png?​nolink&​150|Pentaho platform}}]]
-[[http://​community.pentaho.com|Pentaho platform]] is a set of business intelligence tools.\\ It contains following components:+[[http://​community.pentaho.com|Pentaho platform]] is a set of business intelligence tools.\\ It contains following components ​(download from [[https://​sourceforge.net/​projects/​pentaho/​files/​Pentaho%208.3/​|SourceForge]]):
  
-  * [[http://​community.pentaho.com/​projects/​data-integration|Pentaho Data Integration]] (<​nowiki>​PDI</​nowiki>,​ also known as Kettle)((Acronym means: //Kettle Extraction, Transformation,​ Transportation and Loading Environment//​.)) It is an [[wp>​Extract,​_transform,​_load|ETL]] tool. It can read data from diverse databases, resources (e-mail, local computer, FTP, HTTP) and files (MS Excel, MS Access, [[wp>​Comma-separated values|CSV]],​ TXT, [[wp>​Shapefile|ESRI SHP]], [[wp>​XML]],​ [[wp>​JSON]],​ [[wp>​YAML]],​ [[wp>​RSS]],​ [[wp>​XBase]] or ZIP).  Official resource lists all steps of [[https://​wiki.pentaho.com/​display/​EAI/​Pentaho+Data+Integration+Steps|transformations]] and [[https://​wiki.pentaho.com/​display/​EAI/​Pentaho+Data+Integration+Job+Entries|jobs]].+  * [[cs:​cheatsheet|{{ :​spoon.png?​nolink|PDI cheat sheet}}]][[http://​community.pentaho.com/​projects/​data-integration|Pentaho Data Integration]] (<​nowiki>​PDI</​nowiki>,​ also known as Kettle)((Acronym means: //Kettle Extraction, Transformation,​ Transportation and Loading Environment//​.)) It is an [[wp>​Extract,​_transform,​_load|ETL]] tool. It can read data from diverse databases, resources (e-mail, local computer, FTP, HTTP) and files (MS Excel, MS Access, [[wp>​Comma-separated values|CSV]],​ TXT, [[wp>​Shapefile|ESRI SHP]], [[wp>​XML]],​ [[wp>​JSON]],​ [[wp>​YAML]],​ [[wp>​RSS]],​ [[wp>​XBase]] or ZIP).  Official resource lists all steps of [[https://​wiki.pentaho.com/​display/​EAI/​Pentaho+Data+Integration+Steps|transformations]] and [[https://​wiki.pentaho.com/​display/​EAI/​Pentaho+Data+Integration+Job+Entries|jobs]]. Geospatial data can be handled with [[https://​github.com/​atolcd/​pentaho-gis-plugins|PDI GIS Plugins]]. See more info in [[en:​cheatsheet|]].
  
-  * [[http://​community.pentaho.com/​projects/​reporting|Pentaho Report Designer]] ({{:​profil_prd.png?​linkonly|screenshot}}). Designed reports can be run (displayed) on Pentaho Business Analytics Platform. \\ \\  +  * [[http://​community.pentaho.com/​projects/​reporting|Pentaho Report Designer]] ({{:​profil_prd.png?​linkonly|screenshot}}). \\ \\  
-  * [[http://​community.pentaho.com|Pentaho ​Business Analytics Platform]] (<​nowiki>​PBA</​nowiki>,​ formerly BI Server, {{:​prubeh_server.png?​linkonly| screenshot}}) is a key component of the platform. \\ \\  +  * [[http://​community.pentaho.com|Pentaho ​Server]] (<​nowiki>​PBA</​nowiki>,​ formerly BI Server, {{:​prubeh_server.png?​linkonly| screenshot}}) is a key component of the platform. Dashboards can be executed here. Dashboard can be designed by CDE – more: [[https://​help.pentaho.com/​Documentation/​8.3/​Products/​CTools|Community Tools (CTools)]].\\ \\  
-  * [[https://​help.pentaho.com/​Documentation/​8.2/Data/Relational|Pentaho Metadata Editor]] – creates an abstract data layer. See a figure: \\ {{https://​help.pentaho.com/​@api/​deki/​files/​8143/​01_metadata_domain.png}} \\ \\ +  * [[https://​help.pentaho.com/​Documentation/​8.3/Products/Pentaho_Metadata_Editor|Pentaho Metadata Editor]] – creates an abstract data layer. See a figure: \\ {{https://​help.pentaho.com/​@api/​deki/​files/​8143/​01_metadata_domain.png}} \\ \\ 
  
 Machine Intelligence ([[https://​community.hitachivantara.com/​community/​products-and-solutions/​pentaho/​blog/​2018/​03/​06/​operationalizing-machine-learning|blog post]]) utilizes engines: R, Python, Weka or [[https://​deeplearning4j.org/​|Deeplearning4j]] (Java with GPU Nvidia). Machine Intelligence ([[https://​community.hitachivantara.com/​community/​products-and-solutions/​pentaho/​blog/​2018/​03/​06/​operationalizing-machine-learning|blog post]]) utilizes engines: R, Python, Weka or [[https://​deeplearning4j.org/​|Deeplearning4j]] (Java with GPU Nvidia).
  
-Adaptive Execution Layer ([[https://​help.pentaho.com/​Documentation/​8.2/Products/​Data_Integration/​Adaptive_Execution_Layer|AEL]]) runs transformations not only locally or on the Pentaho Server, but also on  Spark. Dále Pentaho supports also cloud platforms like Amazon Web Services, Google Cloud Platform or Microsoft Azure (Cloud agnostic analytic pipeline). Alternative to AEL is [[https://​diethardsteiner.github.io/​pdi/​streaming/​2018/​12/​01/​Kettle-Beam.html|Apache Beam]].+Adaptive Execution Layer ([[https://​help.pentaho.com/​Documentation/​8.3/​Products/​Adaptive_Execution_Layer|AEL]]) runs transformations not only locally or on the Pentaho Server, but also on  Spark. Dále Pentaho supports also cloud platforms like Amazon Web Services, Google Cloud Platform or Microsoft Azure (Cloud agnostic analytic pipeline). Alternative to AEL is [[https://​diethardsteiner.github.io/​pdi/​streaming/​2018/​12/​01/​Kettle-Beam.html|Apache Beam]].
  
  
en/tools.1559805231.txt.gz · Last modified: 2019-06-06