Skip to content

feat(ingestion/airflow): Add support for mutiple datahub emitter #29408

feat(ingestion/airflow): Add support for mutiple datahub emitter

feat(ingestion/airflow): Add support for mutiple datahub emitter #29408

Triggered via pull request January 20, 2025 14:08
Status Success
Total duration 1h 25m 1s
Artifacts 9

docker-unified.yml

on: pull_request
Build and Push DataHub Ingestion (Base) Docker Image
1m 13s
Build and Push DataHub Ingestion (Base) Docker Image
Build and Push DataHub Upgrade Docker Image
0s
Build and Push DataHub Upgrade Docker Image
Build and Push DataHub Elasticsearch Setup Docker Image
0s
Build and Push DataHub Elasticsearch Setup Docker Image
Build and Push DataHub Frontend Docker Image
0s
Build and Push DataHub Frontend Docker Image
Build and Push DataHub GMS Docker Image
0s
Build and Push DataHub GMS Docker Image
Build and Push DataHub Kafka Setup Docker Image
0s
Build and Push DataHub Kafka Setup Docker Image
Build and Push DataHub MAE Consumer Docker Image
0s
Build and Push DataHub MAE Consumer Docker Image
Build and Push DataHub MCE Consumer Docker Image
0s
Build and Push DataHub MCE Consumer Docker Image
Build and Push DataHub MySQL Setup Docker Image
0s
Build and Push DataHub MySQL Setup Docker Image
smoke_test_matrix
0s
smoke_test_matrix
Build and Push DataHub Ingestion (Base-Full) Docker Image
29s
Build and Push DataHub Ingestion (Base-Full) Docker Image
Build and Push DataHub Ingestion (Base-Slim) Docker Image
38s
Build and Push DataHub Ingestion (Base-Slim) Docker Image
[Monitoring] Scan DataHub Upgrade images for vulnerabilities
0s
[Monitoring] Scan DataHub Upgrade images for vulnerabilities
[Monitoring] Scan ElasticSearch setup images for vulnerabilities
0s
[Monitoring] Scan ElasticSearch setup images for vulnerabilities
[Monitoring] Scan Frontend images for vulnerabilities
0s
[Monitoring] Scan Frontend images for vulnerabilities
[Monitoring] Scan GMS images for vulnerabilities
0s
[Monitoring] Scan GMS images for vulnerabilities
[Monitoring] Scan Kafka Setup images for vulnerabilities
0s
[Monitoring] Scan Kafka Setup images for vulnerabilities
[Monitoring] Scan MAE consumer images for vulnerabilities
0s
[Monitoring] Scan MAE consumer images for vulnerabilities
[Monitoring] Scan MCE consumer images for vulnerabilities
0s
[Monitoring] Scan MCE consumer images for vulnerabilities
[Monitoring] Scan MySQL Setup images for vulnerabilities
0s
[Monitoring] Scan MySQL Setup images for vulnerabilities
Build and Push DataHub Ingestion (Full) Docker Images
5m 43s
Build and Push DataHub Ingestion (Full) Docker Images
Build and Push DataHub Ingestion Docker Images
3m 30s
Build and Push DataHub Ingestion Docker Images
[Monitoring] Scan Datahub Ingestion images for vulnerabilities
5m 17s
[Monitoring] Scan Datahub Ingestion images for vulnerabilities
Matrix: Run Smoke Tests
[Monitoring] Scan Datahub Ingestion Slim images for vulnerabilities
2m 48s
[Monitoring] Scan Datahub Ingestion Slim images for vulnerabilities
Deploy to Datahub HEAD
0s
Deploy to Datahub HEAD
Fit to window
Zoom out
Zoom in

Annotations

14 warnings
setup
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
smoke_test_matrix
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Build and Push DataHub Ingestion (Base) Docker Image
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Build and Push DataHub Ingestion (Base-Full) Docker Image
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Build and Push DataHub Ingestion (Base-Slim) Docker Image
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Build and Push DataHub Ingestion Docker Images
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Build and Push DataHub Ingestion (Full) Docker Images
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
[Monitoring] Scan Datahub Ingestion Slim images for vulnerabilities
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
[Monitoring] Scan Datahub Ingestion images for vulnerabilities
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Smoke Tests (pytests, 0, 5)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Smoke Tests (pytests, 5, 2)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Smoke Tests (pytests, 5, 1)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Smoke Tests (pytests, 5, 4)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Smoke Tests (pytests, 5, 3)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636

Artifacts

Produced during runtime
Name Size
Test Results (smoke tests) pytests 0
1.08 KB
Test Results (smoke tests) pytests 1
1.24 KB
Test Results (smoke tests) pytests 2
1020 Bytes
Test Results (smoke tests) pytests 3
1.66 KB
Test Results (smoke tests) pytests 4
1.12 KB
action_image_artifact_acryldata_datahub-ingestion_pr12398
944 MB
action_image_artifact_acryldata_datahub-ingestion_pr12398-slim
653 MB
datahub-project~datahub~9N96V7.dockerbuild
51.1 KB
datahub-project~datahub~R85LZK.dockerbuild
38.2 KB