C3S_34e Meeting with Ouranos and CRIM: 28th October 2021

[agstephens]

Agenda - C3S_34e Meeting with Ouranos and CRIM: 30th September 2021

1. Minutes and actions from previous meeting

Previous minutes: #106

Previous actions

None

2. Project update: c3s_34e [Ag]

• xarray setting _FillValue on outputs - we have had feedback from CDS users on this issue. Future release should remove it.

• fixes for decadal (DCPP) runs for C3S

  • delayed due to discussions about how to allow subsetting across two time dimensions (actual and lead time)

• clisops updates:

  • 0.7.0 released with updates to time/level subsetting by values, and time components selection
  • regridding not yet merged in but should be there soon

• STAC meeting with CMIP6 in Cloud meetings:

  • planning frontend and backend technical meetings - would you like to be involved?

• funding future for C3S:

  • some extra funding found up to December 2021

3. Project updates: relevant Ouranos/CRIM projects [David/Tom]

Ouranos (DH):

CRIM (TL):

4. Discussion topics:

• clisops Pull Requests:

  • https://github.com/roocs/clisops/pulls

• ESGF Compute Working Team:

  • need to re-launch this
  • needs a manifesto
  • previous notes...

We have suggested that a suitable approach for the CWT would be:

- Hold the meeting monthly (they were 2-weekly but were often cancelled)
- The standard meeting is will focus on immediate collaborations and a roadmap 
  (in the short-term we would focus on integration of the roocs stack with C4I within 
  IS-ENES3, then we might pick up on C3S plans, and hopefully other projects in future).
- Every third meeting (3-monthly), we propose a more general share-and-discuss 
  meeting in which all groups are invited to present on their recent work in the 
  general area of compute services/tools. We would look to combine this meeting 
  with some existing meetings such as the quarterly Birdhouse meetings.

This approach would allow us to meet both needs of:
- prioritising a common goal/collaboration
- allowing wider information-sharing and discussion

5. Agree next steps and next meeting

Next meeting date: Thursday 18th November

[agstephens]

Minutes - C3S_34e Meeting with Ouranos and CRIM: 28th October 2021

1. Minutes and actions from previous meeting

Previous minutes: #106

Previous actions

2. Project update: c3s_34e [Ag]

• xarray setting _FillValue on outputs - we have had feedback from CDS users on this issue. Future release should remove it.

• fixes for decadal (DCPP) runs for C3S:

  • delayed due to discussions about how to allow subsetting across two time dimensions (actual and lead time)

• clisops updates:

  • 0.7.0 released with updates to time/level subsetting by values, and time components selection
  • regridding not yet merged in but should be there soon

• STAC meeting with CMIP6 in Cloud meetings:

  • planning frontend and backend technical meetings - would you like to be involved?
  • DH: interested to see if Ouranos can write a plugin to write outputs to a static file (e.g. Intake). Would be keen to include metadata validation as well.

• funding future for C3S:

  • some extra funding found up to December 2021

3. Project updates: relevant Ouranos/CRIM projects [David/Tom]

Ouranos (DH):

• Pascal reworked indicators in Xclim
• Setting up new hardware - replacing PAVICS server:
  • moving to SSD to improve performance (for TDS etc)
  • with room for expansion
• Discussion about clisops calculation of weights:
  • https://github.com/roocs/clisops/blob/regrid-main/clisops/core/subset.py#L499
  • ESMF should calculate weights that reflect the relative areas of each cell
  • Need to check xesmf can also do this

CRIM (TL):

• Presented at the Phi Week
• Conferences: looking at Living Planet Symposium
  • could present our collaborative work
  • in Germany
  • could also include EO

4. Discussion topics:

• clisops Pull Requests:

  • https://github.com/roocs/clisops/pulls

• ESGF Compute Working Team:

  • need to re-launch this
  • needs a manifesto
  • previous notes...

We have suggested that a suitable approach for the CWT would be:

- Hold the meeting monthly (they were 2-weekly but were often cancelled)
- The standard meeting is will focus on immediate collaborations and a roadmap 
  (in the short-term we would focus on integration of the roocs stack with C4I within 
  IS-ENES3, then we might pick up on C3S plans, and hopefully other projects in future).
- Every third meeting (3-monthly), we propose a more general share-and-discuss 
  meeting in which all groups are invited to present on their recent work in the 
  general area of compute services/tools. We would look to combine this meeting 
  with some existing meetings such as the quarterly Birdhouse meetings.

This approach would allow us to meet both needs of:
- prioritising a common goal/collaboration
- allowing wider information-sharing and discussion

Tom and Ag discussed:

• future opportunities
• CWT reboot
• OGC Climate Services 1-year cycles for the next 5 years:
  • https://www.ogc.org/projects/initiatives/ccspilot#:~:text=The%20objective%20of%20the%20Climate,push%20for%20achieving%20climate%20resilience.

5. Agree next steps and next meeting

Next meeting date: Thursday 18th November