Zarr and Dask for Large-scale Image Data

The Jackson Laboratory

Online

Mar 3, 2022

9:00 am - 12:00 pm

Instructors: Dave Mellert

Helpers: Erick Ratamero

Some adblockers block the registration window. If you do not see the registration box below, please check your adblocker settings.

General Information

Very large numeric arrays (i.e. many gigabytes or even terabytes) can pose a significant computational challenge in imaging and many other areas of scientific data analysis. This is because analysts are frequently unfamiliar with the advanced memory management techniques required to work with such data using limited computational resources. zarr and dask are two Python libraries designed to facilitate analysis of very large arrays by 1) making efficient use of multiprocessor architecture and 2) “lazy loading” array data only when requested by a process. This workshop will provide an introduction to zarr and dask and walk through a few common use cases in image analysis.

In this workshop you will learn to:

Who: The course is aimed at Jackson Laboratory researchers who want to analyze large-scale image data. External participants cannot be admitted. You need to have Python programming experience to get the most from this workshop.

Where: This training will take place online. The instructors will provide you with the information you will need to connect to this meeting.

When: Mar 3, 2022. Add to your Google Calendar.

Requirements: Participants must bring a laptop with a Mac, Linux, or Windows operating system (not a tablet, Chromebook, etc.). They should have a few specific software packages installed (listed below).

Accessibility: We are dedicated to providing a positive and accessible learning environment for all. Please notify the instructors in advance of the workshop if you require any accommodations or if there is anything we can do to make this workshop more accessible to you.

Contact: Please email susan.mcclatchy@jax.org or dave.mellert@jax.org for more information.

Roles: To learn more about the roles at the workshop (who will be doing what), refer to our Workshop FAQ.


Survey

Please be sure to complete this survey after the workshop.

Post-workshop Survey


Schedule


Setup

To participate in a workshop, you will need access to software as described below. In addition, you will need an up-to-date web browser.

We maintain a list of common issues that occur during installation as a reference for instructors that may be useful on the Configuration Problems and Solutions wiki page.

Install the videoconferencing client

If you haven't used Zoom before, go to the official website to download and install the Zoom client for your computer.

Set up your workspace

Like other Carpentries workshops, you will be learning by "coding along" with the Instructors. To do this, you will need to have both the window for the tool you will be learning about (a terminal, RStudio, your web browser, etc..) and the window for the Zoom video conference client open. In order to see both at once, we recommend using one of the following set up options:

This blog post includes detailed information on how to set up your screen to follow along during the workshop.