Merge updates to Dorieh into NSAPH repository - #6

Open

mmcentre wants to merge 127 commits into

NSAPH-Data-Platform:mainfrom

ForomePlatform:main

Commits on Jun 29, 2024

Merge pull request #1 from ForomePlatform/dev-0.1.x
mmcentre
authored
782b650

Commits on Jun 30, 2024

Merge pull request #2 from ForomePlatform/dev-0.1.x
mmcentre
authored
f233523

Commits on Aug 2, 2024

MAB Building docker image for Amazon Linux to avoid CVEs. Removed High CVE caused by Fiona
mmcentre
committed
2a89361
MAB Cleaning up unused dependencies
mmcentre
committed
42d5714

Commits on Aug 3, 2024

MAB Minor fixes
mmcentre
committed
c3beb54

Commits on Aug 7, 2024

MAB Cleaning up unused dependencies
mmcentre
committed
1210ac2

Commits on Aug 8, 2024

MAB Data lineage - generating Markdown
mmcentre
committed
ca717ed
MAB Data lineage - generating Markdown
mmcentre
committed
e31a457

Commits on Aug 9, 2024

MAB Data lineage - generating Markdown
mmcentre
committed
c109090
MAB Data lineage - generating Markdown
mmcentre
committed
a033836
MAB Data lineage - generating Markdown for Sphinx
mmcentre
committed
b630155
MAB Data lineage - generating Markdown for Sphinx
mmcentre
committed
3cb956a
MAB Data lineage - generating Markdown for Sphinx
mmcentre
committed
7d31082
MAB Data lineage - generating Markdown for Sphinx
mmcentre
committed
73f9e68
MAB Data lineage - generating Markdown for Sphinx
mmcentre
committed
bcdbe18
MAB Data lineage - generating Markdown for Sphinx
mmcentre
committed
f9dd550
MAB Data lineage - generating Markdown for Sphinx
mmcentre
committed
0a20037
MAB Data lineage - generating Markdown for Sphinx
mmcentre
committed
7403c92
MAB Data lineage - generating Markdown for Sphinx
mmcentre
committed
490480a
MAB Data lineage - generating Markdown for Sphinx
mmcentre
committed
f6f6ea7
MAB Data lineage - generating Markdown for Sphinx
mmcentre
committed
f8b1957
MAB Data lineage - generating Markdown for Sphinx
mmcentre
committed
e6ef201

Commits on Aug 10, 2024

MAB Cosmetic changes to documentation
mmcentre
committed
4844fe2

Commits on Aug 12, 2024

MAB Cosmetic changes to documentation
mmcentre
committed
70a9b1c
MAB Documenting data dictionary tools
mmcentre
committed
cb1e0a1
MAB Documenting data dictionary tools
mmcentre
committed
299c2d6
MAB Documenting data dictionary tools
mmcentre
committed
7425b02
MAB Documenting data dictionary tools
mmcentre
committed
bf46444
MAB Documenting data dictionary tools
mmcentre
committed
b969085
Merge pull request #3 from ForomePlatform/dev-0.2.x
mmcentre
authored
1fae89c

Commits on Aug 15, 2024

MAB Add building docker container for clean environment to the project
mmcentre
committed
0749011

Commits on Sep 16, 2024

MAB Add workflows: version, handshake, monitor
mmcentre
committed
51410c5

Commits on Sep 19, 2024

MAB Only display secret value in debug mode
mmcentre
committed
882e9c6

Commits on Sep 21, 2024

MAB Run configurations
mmcentre
committed
4dd61a1

Commits on Oct 17, 2024

MAB Fix a bug in psql, when there is no results from a query
mmcentre
committed
a000753

Commits on Oct 18, 2024

MAB Fixing export to Parquet, adding JSONLines, HDF5
mmcentre
committed
05f6a22

Commits on Oct 19, 2024

MAB Support Spark, add Parquet export to gridmet [test]
mmcentre
committed
b073799
MAB Support Spark, add Parquet export to gridmet [test]
mmcentre
committed
8dcbd52

Commits on Oct 20, 2024

MAB Updating Gridmet workflows
mmcentre
committed
7be4982
MAB Updating workflows to export parquet correctly
mmcentre
committed
db5890b

Commits on Oct 21, 2024

MAB Improving Parquet and Spark support
mmcentre
committed
a7d7d98

Commits on Oct 22, 2024

MAB Updating Dockerfiles
mmcentre
committed
a0de93a

Commits on Nov 1, 2024

MAB Add option to set Xmx option for JVM when using Spark
mmcentre
committed
6e73b78

Commits on Nov 2, 2024

MAB Updating Spark utilities
mmcentre
committed
51b475d
MAB Updating Export Parquet to be more compatible with Spark
mmcentre
committed
07a564d
MAB Revert: Export Parquet to be more compatible with Spark
mmcentre
committed
0aaeb64

Commits on Nov 19, 2024

MAB Adding Groovy DSL
mmcentre
committed
a44a809

Commits on Dec 15, 2024

MAB Adding Groovy DSL
mmcentre
committed
e5d9ee5
MAB Adding Groovy DSL
mmcentre
committed
d9526a4
MAB Adding Groovy DSL
mmcentre
committed
ac285da

Commits on Mar 10, 2025

MAB Fix Parquet export of non-string lists
mmcentre
committed
f7bf9a6

Commits on Mar 11, 2025

MAB Add an option to add sql when exporting a table
mmcentre
committed
b022ffc
MAB Fix JDK reflection issue for Spark
mmcentre
committed
cac2347
MAB Docker files for Dorieh withSpark
mmcentre
committed
bcd3c08

Commits on Mar 13, 2025

MAB Fix incompatibility of hard partitioning with extra sql
mmcentre
committed
c2ae35a

Commits on Mar 20, 2025

Merge pull request #4 from ForomePlatform/dev-0.3x
mmcentre
authored
1529c38

Commits on Mar 25, 2025

MAB Docker files for Dorieh withSpark
mmcentre
committed
55f961f

Commits on Apr 29, 2025

MAB Aggregating 2024 FOSSA data
mmcentre
committed
b48fae6
MAB Aggregating 2024 FOSSA data
mmcentre
committed
89ac83e

Commits on May 10, 2025

Commits on May 11, 2025

Commits on Oct 3, 2025

Commits on Oct 4, 2025

MAB Working with examples
mmcentre
committed
bd9232f
MAB Working with examples
mmcentre
committed
2a014ce
MAB Working with examples
mmcentre
committed
6f8916a
MAB Working with examples
mmcentre
committed
1cca6a4

Commits on Oct 6, 2025

MAB Medicare processing examples
mmcentre
committed
730c5d7

Commits on Oct 15, 2025

MAB Reformatting Workflows documentation
mmcentre
committed
0205fbb

Commits on Nov 7, 2025

MAB Amending code to align with the tutorial
mmcentre
committed
d517e23
MAB Adding runtime config
mmcentre
committed
366cfbe
MAB Pre-release Cleanup
mmcentre
committed
a8385a1
Merge pull request #5 from ForomePlatform/dev-0.4.x
mmcentre
authored
66391a5
MAB Updating Tutorial example
mmcentre
committed
4e61ef9

Commits on Nov 11, 2025

MAB Updating Tutorial example
mmcentre
committed
e7cb646

Commits on Nov 18, 2025

MAB Cleaning up Data Dictionary Tool
mmcentre
committed
8485752

Commits on Dec 17, 2025

MAB Adding a figure illustrating a data preparation pipeline for the book
mmcentre
committed
b8e352a

Commits on Dec 21, 2025

MAB Writing the Pipeline Building Tutorial
mmcentre
committed
206173b
Merge pull request #6 from ForomePlatform/dev-0.4.x
mmcentre
authored
9e5331b

Commits on Dec 22, 2025

MAB Writing the Pipeline Building Tutorial
mmcentre
committed
3aed41a
MAB Writing the Pipeline Building Tutorial
mmcentre
committed
79f20dd
MAB Updating paths for documentation
mmcentre
committed
d1ada27
MAB Updating paths for documentation
mmcentre
committed
a71d5df
MAB Trying to make collapsible code snippets
mmcentre
committed
c3486b8
MAB Trying to make collapsible code snippets
mmcentre
committed
09100f9
MAB Made collapsible code snippets
mmcentre
committed
c2487cc
MAB Cleaning the tutorial
mmcentre
committed
08a8639
MAB Cleaning the tutorial
mmcentre
committed
e6425a7
MAB Adding tutorials for documentation and lineage
mmcentre
committed
137b1d1
MAB Adding tutorials for documentation and lineage
mmcentre
committed
2b3256c
MAB Adding tutorials for documentation and lineage
mmcentre
committed
d2dc8f7
MAB Adding tutorials for documentation and lineage
mmcentre
committed
97d85c7

Commits on Dec 23, 2025

Commits on Dec 25, 2025

MAB Adding EPS Pipeline picture
mmcentre
committed
de9b9e7
MAB Adding EPS pictures used in the book
mmcentre
committed
c39ce57

Commits on Mar 24, 2026

Commits on Jun 1, 2026

Commits on Jun 19, 2026

MAB Add reference to the book
mmcentre
committed
85140f0
Merge pull request #9 from ForomePlatform/dev-0.4.x
mmcentre
authored
f7243ea

Commits on Jul 4, 2026

MAB Complete rewriting of documentation
mmcentre
committed
e8bc722

Commits on Jul 5, 2026

MAB Refining the documentation
mmcentre
committed
46a617c
MAB Use dev 5 branch for documentation
mmcentre
committed
b645e87

Commits on Jul 12, 2026

MAB Use dev 5 branch for documentation
mmcentre
committed
486dfa9
MAB Use dev 5 branch for documentationFixing lineage generation
mmcentre
committed
f358001

Commits on Jul 13, 2026

MAB Refactor documentation again
mmcentre
committed
4d4f105
MAB Update doc build script
mmcentre
committed
d5d46ee
MAB More do crefactoring
mmcentre
committed
a0c203b
MAB More doc refactoring
mmcentre
committed
91cd507
MAB More doc refactoring
mmcentre
committed
be3a7ba
MAB Documentation cleanup
mmcentre
committed
3ae589a
MAB Fix climate tests
mmcentre
committed
0ea7a74
MAB Fix climate tests
mmcentre
committed
a76817f
MAB More fixes to documentation and examples
mmcentre
committed
ca5f3ff
Merge pull request #10 from ForomePlatform/dev-0.5.x
mmcentre
authored
bb9e7b0