Observability Improvements

Release Notes

uc-cdis/cloud-automation

New Features

• chore(observability): Enable metrics scraping for revproxy (#1376)
• Improving prometheus exporter side-cars for fence. (#1376)
• Script for download metrics (#1473)
• New Gen3 CLI command (gen3 gen3qa-run <test_job>) (#1474)
• Google cloud setup for covid19 (#1460)
• Add ability to sync docker images from docker hub to quay.io (#1455)
• Added terraform to create sftp server (#1437)

Deployment Changes

• Put google cloud credential into Gen3Secrets/g3auto/covid19-etl/default.json (#1460)

Dependency Updates

• remove python-pygit2 (#1447)
• pylib2 added (#1446)

Bug Fixes

• fixed helm repo (#1467)
• gen3release has new dependency
  https://github.com/uc-cdis/gen3-release-utils/blob/1b611e6b13371e039a725c24519a7b7ba3354c3f/gen3release-sdk/pyproject.toml#L16
  which requires pip version >19. (#1448)

Improvements

• chore(pybase): Adopt parent img from quay to avoid pull rate limit errors (#1485)
• Clarify metadata exchange instructions for cognito-adfs integration (#1466)
• revproxy sets cache-control: no-store for lw-workspace/proxy (#1469)
• tty service (#1468)
• awshelper changes for tty service - include ubuntu-user sshd (#1468)
• gen3 infra helper - collect infrastructure reports on a VPC for pen
  tests, security reviews, whatever (#1468)
• gen3 api indexd-delete $did (#1468)
• k8s rbac to v1 api (#1468)
• add anaconda.com to whitelist (#1462)
• patch gen3 jupyter idle to properly consider the length limit on
  ambassador cluster names - the hatchery-reaper should properly garbage
  collect hatchery pods with long names now ... (#1452)
• automation for ws-storage service (#1450)
• fix kube-setup-wts - mkdir before writing creds (#1449)
• fix hatchery-reaper - add namespace from metadata (#1449)
• fix gen3 gitops configmaps key1 key2 ... (#1445)
• make kube-setup-wts fail fast on failure to setup OIDC client with fence
  (#1445)
• add AWS_STS_REGIONAL_ENDPOINTS=regional environment to ssjdispatcher
  (#1445)