Handling large geo data with Julia - snapshot
has assertion: assertion
has provenance: provenance
has publication info: pubinfo
type: Nanopublication
created: 2025-11-11T16:28:29.631+01:00
type: RoCrateNanopub

Applied sciences
type: DefinedTerm

Earth sciences
type: DefinedTerm

Nordic e-Infrastructure Collaboration
type: Organization
type: Agent

POLYGON ((6.152342408895493 36.11420992771953, 6.152342408895493 46.14432008685165, 19.042966514825824 46.14432008685165, 19.042966514825824 36.11420992771953, 6.152342408895493 36.11420992771953))
type: Place

POLYGON ((6.152342408895493 36.11420992771953, 6.152342408895493 46.14432008685165, 19.042966514825824 46.14432008685165, 19.042966514825824 36.11420992771953, 6.152342408895493 36.11420992771953))
polygon: 6.152342408895493 36.11420992771953, 6.152342408895493 46.14432008685165, 19.042966514825824 46.14432008685165, 19.042966514825824 36.11420992771953, 6.152342408895493 36.11420992771953
type: GeoShape

Handling large geo data with Julia - snapshot
doi: 10.24424/2byf-7r07
is finalized: False
is snapshot of: https://w3id.org/ro-id/a802f7dc-f3f4-4eac-b69f-748fb90958fb
snapshoted at time: 2022-10-05 11:05:15.781374+00:00
about: Applied sciences
about: Earth sciences
content size: 163759
date created: 2022-09-02 19:02:01.731061+00:00
date modified: 2024-03-05 12:18:33.627372+00:00
date published: 2022-09-02 19:02:01.731061+00:00
description: This talk is part of the Pangeo Show & Tell series and was given on September 1st 2022 by Felix Cremer. Bio Felix Cremer received his diploma in mathematics from the University of Leipzig in 2014. In 2016 he started his PhD study on time series analysis of hypertemporal Sentinel-1 radar data. He currently works at the Max-Planck-Institute for Biogeochemistry on the development of the JuliaDataCubes ecosystem in the scope of the NFDI4Earth 5 project. Abstract The Earth Data Lab (EDL) is a data cube framework in Julia for the efficient handling of raster data. It is based on the YAXArrays.jl package. YAXArrays.jl provides functionality to deal with labelled arrays, similar to the xarray python package and it also provides efficient and easy multithreading and distributed computation of user defined functions along arbitrary slices of the data. EarthDataLab.jl uses DiskArrays.jl in the backend to deal with out of memory datasets. In this Show-and-Tell Felix is going to give a short introduction into the EarthDataLab.jl package for raster data handling in Julia.
encoding format: application/ld+json
keywords: geodata
keywords: julia
license: no-permission
main entity: Video
name: Handling large geo data with Julia
publisher: Nordic e-Infrastructure Collaboration
creation mode: MANUAL
concept: calculation
concept: data
concept: dataset
concept: diploma
concept: functionality
concept: multithreading
concept: parcel
concept: time series
concept: treatment
field of research: earth sciences
IPTC: Library and museum
IPTC: Science and technology
lemma: EarthDataLab.jl
lemma: Felix Cremer
lemma: YAXArrays.jl
lemma: data
lemma: dataset
lemma: handling
lemma: raster data
NASA: mathematical and computer sciences
phrase: YAXArrays.jl package
phrase: geo data
phrase: memory dataset
phrase: raster data handling
phrase: series analysis
sentence: In this Show-and-Tell Felix is going to give a short introduction into the EarthDataLab.jl package for raster data handling in Julia.
sentence: The Earth Data Lab (EDL) is a data cube framework in Julia for the efficient handling of raster data.
sentence: This talk is part of the Pangeo Show & Tell series and was given on September 1st 2022 by Felix Cremer.
time reference: In 2016
time reference: in 2014
time reference: on Sep-1-2022
has geometry: https://w3id.org/ro-id/77a61d94-3318-4d33-a3c0-4730e7026fdb/abe09580-1113-4c77-a7d9-71f181341daf
type: ResearchObject
type: SnapshotRO
type: Dataset
type: ExecutableResearchObject
domain: computer science
domain: database
place: Plovdiv
cite-as: Felix Cremer, and Pangeo Europe. "Handling large geo data with Julia." ROHub. Sep 02 ,2022. https://doi.org/10.24424/2byf-7r07.

https://w3id.org/ro-id/77a61d94-3318-4d33-a3c0-4730e7026fdb/abe09580-1113-4c77-a7d9-71f181341daf
as WKT: POLYGON ((6.152342408895493 36.11420992771953, 6.152342408895493 46.14432008685165, 19.042966514825824 46.14432008685165, 19.042966514825824 36.11420992771953, 6.152342408895493 36.11420992771953))
type: Geometry
type: Polygon

output
type: Folder
type: Dataset

tool
type: Folder
type: Dataset

biblio
type: Folder
type: Dataset

input
type: Folder
type: Dataset

Youtube video "Handling large geo data with julia by Felix Cremer."
date created: 2022-09-02 19:13:04.311770+00:00
date modified: 2022-10-05 11:05:08.693363+00:00
description: This is the recorded talk from Felix Cremer during the Pangeo Show & Tell in September 1st, 2022. Felix is going through his Julia Notebook and explain us about handling large geo data with Julia.
license: no-permission
sd date published: 2022-09-02 19:13:04.311770+00:00
type: Resource
type: MediaObject
type: VideoObject

ne_50m_admin_0_countries.README.html
date created: 2022-09-02 19:23:40.734491+00:00
date modified: 2022-10-05 11:05:10.091697+00:00
description: Admin 0 & Countries | Natural Earth
encoding format: text/html
license: no-permission
sd date published: 2022-09-02 19:23:40.734491+00:00
type: Document
type: Resource
type: MediaObject

HackMD Pangeo Show and Tell
date created: 2022-09-20 12:05:09.775445+00:00
date modified: 2022-10-05 11:05:12.569218+00:00
description: This is the shared document we use for all the Pangeo Show and Tell. We collect information, Q&A and feedback. Each Show and Tell has its own sub-section.
license: no-permission
sd date published: 2022-09-20 12:05:09.775445+00:00
type: Document
type: Resource
type: MediaObject

ne_50m_admin_0_countries.cpg
date created: 2022-09-02 19:26:00.758390+00:00
date modified: 2022-10-05 11:05:10.411799+00:00
description: cpg file from shapefile dataset.
license: no-permission
sd date published: 2022-09-02 19:26:00.758390+00:00
type: Document
type: Resource
type: MediaObject

How to use EarthDataLab.jl to do large scale computations (Jupyter Notebook)
date created: 2022-09-02 19:19:48.682613+00:00
date modified: 2022-10-05 11:05:09.458760+00:00
description: Jupyter Notebook used by Felix during the Pangeo Show & Tell to demonstrate how to use EarthDataLab.jl to do large scale computations. To execute this Jupyter Notebook, data contained in the "input folder" is needed (please create a folder called "data" in the folder where you have stored the notebook).
license: no-permission
sd date published: 2022-09-02 19:19:48.682613+00:00
type: Resource
type: MediaObject
type: JupyterNotebook

ne_50m_admin_0_countries.prj
date created: 2022-09-02 19:27:59.472971+00:00
date modified: 2022-10-05 11:05:12.806251+00:00
description: Part of ne_50m_admin_0_countries shapefile (projection information).
license: no-permission
sd date published: 2022-09-02 19:27:59.472971+00:00
type: Dataset
type: Resource
type: MediaObject

Pangeo discourse post announcing 1st September Show & Tell by Felix Cremer.
date created: 2022-09-02 19:15:52.939627+00:00
date modified: 2022-10-05 11:05:10.738946+00:00
description: You will find here all the information published to advertise the Pangeo Show & Tell Talk frm Felix Cremer on "Handling large geo data with Julia ".
license: no-permission
sd date published: 2022-09-02 19:15:52.939627+00:00
type: Document
type: Resource
type: MediaObject

ne_50m_admin_0_countries.VERSION.txt
date created: 2022-09-02 19:24:56.813174+00:00
date modified: 2022-10-05 11:05:08.830771+00:00
description: Version
encoding format: text/plain
license: no-permission
sd date published: 2022-09-02 19:24:56.813174+00:00
type: Document
type: Resource
type: MediaObject

plot_italy_julia_pangeo_ST.png
content size: 138593
date created: 2022-09-02 19:30:37.195378+00:00
date modified: 2022-10-05 11:05:15.216316+00:00
description: Plot from the Julia Jupyter notebook.
encoding format: image/png
license: no-permission
sd date published: 2022-09-02 19:30:37.195378+00:00
type: Sketch
type: Resource
type: MediaObject

ne_50m_admin_0_countries.dbf
date created: 2022-09-02 19:27:25.914754+00:00
date modified: 2022-10-05 11:04:59.380562+00:00
description: Part of ne_50m_admin_0_countries shapefile.
license: no-permission
sd date published: 2022-09-02 19:27:25.914754+00:00
type: Dataset
type: Resource
type: MediaObject

ne_50m_admin_0_countries.shp
date created: 2022-09-02 19:28:35.477795+00:00
date modified: 2022-10-05 11:05:01.072396+00:00
description: Part of ne_50m_admin_0_countries shapefile.
encoding format: application/x-qgis
license: no-permission
sd date published: 2022-09-02 19:28:35.477795+00:00
type: Dataset
type: Resource
type: MediaObject

YAXArrays.jl Documentation
date created: 2022-09-02 19:18:10.607898+00:00
date modified: 2022-10-05 11:05:10.000002+00:00
description: YAXArrays.jl is another xarray-like Julia package. A package for operating on out-of-core labeled arrays, based on stores like NetCDF, Zarr or GDAL. Package Features: - open datasets from a variety of sources (NetCDF, Zarr, ArchGDAL) - interoperability with other named axis packages through YAXArrayBase - efficient mapslices(x) operations on huge multiple arrays, optimized for high-latency data access (object storage, compressed datasets)
license: no-permission
sd date published: 2022-09-02 19:18:10.607898+00:00
type: Resource
type: MediaObject
type: SoftwareDocumentation

ESDLtutorial Github repository.
date created: 2022-09-02 19:36:28.455672+00:00
date modified: 2022-10-05 11:05:08.571565+00:00
description: This will become a selection of tutorials on the use of ESDL.jl and YAXArrays.jl julia packages for the handling of large scale out-of-core geospatial datasets.
keywords: github
license: no-permission
sd date published: 2022-09-02 19:36:28.455672+00:00
type: Resource
type: MediaObject
type: SWDocumentation

ne_50m_admin_0_countries.shx
date created: 2022-09-02 19:29:06.833916+00:00
date modified: 2022-10-05 11:05:08.283815+00:00
description: Part of ne_50m_admin_0_countries shapefile.
encoding format: application/x-qgis
license: no-permission
sd date published: 2022-09-02 19:29:06.833916+00:00
type: Dataset
type: Resource
type: MediaObject

Felix Cremer
affiliation: Max-Planck-Institute (Germany)
type: Agent

Pangeo Europe
type: Agent

sig
has algorithm: RSA
signed by: RoCrateBot