parsl-wq-chdir-fix

fix (#3542)

release/7.7.0

We are pleased to announce the release of version 7.7.0
of the Cooperative Computing Tools from the University of Notre Dame,
including TaskVine, Work Queue, Makeflow, Parrot, Chirp, and other software.

Docs: https://cctools.readthedocs.io/
Download: http://ccl.cse.nd.edu/software/download
Forum: http://ccl.cse.nd.edu/community/forum

This is a feature release that primarily improves the scalability and performance of TaskVine:

Main Features:

• TaskVine workers now perform transfers asynchronously while communicating with manager, by @BarrySlyDelgado
• TaskVine Serverless function execution simplified and accelerated by @tphung3
• Improved integration of Parsl and TaskVine by @tphung3
• Improved scheduler performance in Work Queue and TaskVine by @colinthomas-z80
• Multiple improvements to reliability at scale with physics applications by @btovar
• Change to API for cancelling tasks: all tasks are now returned by vine_wait by @dthain
• Change to serverless resource management: functions consume library resources by @dthain
• Improved visualization by @JinZhou5042
• New environment.yml for development dependencies by @thieber22

Full Changelog: nightly...release/7.7.0

release/7.6.2

We are pleased to announce the release of version 7.6.2
of the Cooperative Computing Tools from the University of Notre Dame,
including TaskVine, Work Queue, Makeflow, Parrot, Chirp, and other software.

• Docs: https://cctools.readthedocs.io/
• Download: http://ccl.cse.nd.edu/software/download
• Forum: http://ccl.cse.nd.edu/community/forum

This is a bug fix release that addresses several minor issues:

Bug Fixes

• dttools: fix too many open files by @tphung3 in #3416
• Vine Futures Executor by @BarrySlyDelgado in #3403
• TaskVine: fix FunctionCall API, update example, and add test by @tphung3 in #3418
• Vine: Removed Serverless Test by @dthain in #3426
• TaskVine + Poncho: Add env option serverless by @tphung3 in #3427
• adds del dummy method to WorkQueue by @btovar in #3428
• Vine: Fix worker crash when using serverless. by @dthain in #3435
• Vine: Fix two core bugs. by @dthain in #3437

Test Infrastructure

• Build: Add Python deps to docker images. by @dthain in #3421
• Vine: Remove test for poncho to force test run. by @dthain in #3422
• Parrot: Fix test cases. by @dthain in #3424
• Build: Add Conda developer platform. by @dthain in #3423
• Parrot: Fix test cases by @dthain in #3425

Full Changelog: release/7.6.1...release/7.6.2

release/7.6.1

We are pleased to announce the release of version 7.6.1
of the Cooperative Computing Tools from the University of Notre Dame,
including TaskVine, Work Queue, Makeflow, Parrot, Chirp, and other software.

• Docs: https://cctools.readthedocs.io/
• Download: http://ccl.cse.nd.edu/software/download
• Forum: http://ccl.cse.nd.edu/community/forum

This release introduces several bug fixes and minor improvementsto the TaskVine workflow executor and Work Queue scheduler.
TaskVine:

• Fix bug in task scheduling that would result in manager hanging.  (Colin Thomas)
• Fix bug in execution of Dask task graphs that would lead to a hang.  (Ben Tovar)
• Fix bug in deployment of serverless LibraryTask.  (Thanh Phung)
• Add option to specify Python package dependencies inline.  (Barry Sly-Delgado)
• Add visualization of task graph and documentation. (Douglas Thain)

Work Queue:

• Fix bug in task scheduling that would result in manager hanging.  (Colin Thomas)

release/7.6.1rc1

We are pleased to announce the release of version 7.6.1
of the Cooperative Computing Tools from the University of Notre Dame,
including TaskVine, Work Queue, Makeflow, Parrot, Chirp, and other software.

• Docs: https://cctools.readthedocs.io/
• Download: http://ccl.cse.nd.edu/software/download
• Forum: http://ccl.cse.nd.edu/community/forum

This release introduces several bug fixes and minor improvementsto the TaskVine workflow executor and Work Queue scheduler.

TaskVine:

• Fix bug in task scheduling that would result in manager hanging.  (Colin Thomas)
• Fix bug in execution of Dask task graphs that would lead to a hang.  (Ben Tovar)
• Fix bug in deployment of serverless LibraryTask.  (Thanh Phung)
• Add option to specify Python package dependencies inline.  (Barry Sly-Delgado)
• Add visualization of task graph and documentation. (Douglas Thain)

Work Queue:

• Fix bug in task scheduling that would result in manager hanging.  (Colin Thomas)

release/7.6.0

bump to version 7.6.0

release/7.5.5

• TaskVine: Fixes for dask executor in TaskVine
• TaskVine: Fix for non-cached files being shared in peer transfers
• TaskVine: Re-computation of temp files when workers are lost.

release/7.5.5rc1

bump to 7.5.5rc1

release/7.5.4

Fixes for dask executor

release/7.5.3

• Experimental support to run dask task graphs with TaskVine
• Python modules should now be imported as, e.g., import ndcctools.taskvine. import taskvine prints a deprecation warning.