Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test failure: test_table_migration_job_refreshes_migration_status[hiveserde-migrate-external-hiveserde-tables-in-place-experimental] #3502

Open
github-actions bot opened this issue Jan 9, 2025 · 0 comments
Labels
bug Something isn't working

Comments

@github-actions
Copy link

github-actions bot commented Jan 9, 2025

❌ test_table_migration_job_refreshes_migration_status[hiveserde-migrate-external-hiveserde-tables-in-place-experimental]: AssertionError: Workflow failed: assessment (3m51.934s)
AssertionError: Workflow failed: assessment
assert False
[gw8] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python
05:12 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Z4Ka/config.yml) doesn't exist.
05:12 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
05:12 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
05:12 INFO [databricks.labs.ucx.install] Fetching installations...
05:12 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Z4Ka is corrupted. Skipping...
05:12 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
05:12 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:12 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:12 INFO [databricks.labs.ucx.install] Installing UCX v0.53.2+1020250109051239
05:12 INFO [databricks.labs.ucx.install] Creating ucx schemas...
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
05:12 INFO [databricks.labs.ucx.install] Creating dashboards...
05:12 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
05:12 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
05:12 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration...
05:12 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress...
05:12 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
05:12 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
05:12 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
05:12 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
05:12 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups...
05:12 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main...
05:12 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main...
05:12 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:12 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:12 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:12 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:12 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:12 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:12 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:12 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Z4Ka/README for the next steps.
05:12 INFO [databricks.labs.ucx.progress.install] Installation completed successfully!
05:12 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/904558775872419
05:13 INFO [databricks.labs.ucx.installer.workflows] Started assessment job: https://DATABRICKS_HOST#job/904558775872419/runs/962834213247152
05:13 DEBUG [databricks.labs.ucx.installer.workflows] Validating assessment workflow: https://DATABRICKS_HOST#job/904558775872419
05:13 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
05:12 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Z4Ka/config.yml) doesn't exist.
05:12 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
05:12 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
05:12 INFO [databricks.labs.ucx.install] Fetching installations...
05:12 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Z4Ka is corrupted. Skipping...
05:12 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
05:12 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:12 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:12 INFO [databricks.labs.ucx.install] Installing UCX v0.53.2+1020250109051239
05:12 INFO [databricks.labs.ucx.install] Creating ucx schemas...
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
05:12 INFO [databricks.labs.ucx.install] Creating dashboards...
05:12 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
05:12 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
05:12 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration...
05:12 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress...
05:12 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
05:12 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
05:12 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
05:12 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
05:12 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups...
05:12 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main...
05:12 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main...
05:12 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:12 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:12 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:12 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:12 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:12 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:12 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:12 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Z4Ka/README for the next steps.
05:12 INFO [databricks.labs.ucx.progress.install] Installation completed successfully!
05:12 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/904558775872419
05:13 INFO [databricks.labs.ucx.installer.workflows] Started assessment job: https://DATABRICKS_HOST#job/904558775872419/runs/962834213247152
05:13 DEBUG [databricks.labs.ucx.installer.workflows] Validating assessment workflow: https://DATABRICKS_HOST#job/904558775872419
05:13 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
05:15 INFO [databricks.labs.ucx.install] Deleting UCX v0.53.2+1020250109051239 from https://DATABRICKS_HOST
05:15 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_swqkk
05:15 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=904558775872419, as it is no longer needed
05:15 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1052152824898727, as it is no longer needed
05:15 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=410248444558733, as it is no longer needed
05:15 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=659762700320524, as it is no longer needed
05:15 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=117849228827071, as it is no longer needed
05:15 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=821678081617621, as it is no longer needed
05:15 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=546883494718490, as it is no longer needed
05:15 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=618831188090077, as it is no longer needed
05:15 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=585906276400578, as it is no longer needed
05:15 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=970577603233329, as it is no longer needed
05:15 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=754818422344220, as it is no longer needed
05:15 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=408848917887919, as it is no longer needed
05:15 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=722163270775538, as it is no longer needed
05:15 INFO [databricks.labs.ucx.install] Deleting cluster policy
05:15 INFO [databricks.labs.ucx.install] Deleting secret scope
05:15 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
[gw8] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python

Running from nightly #344

@github-actions github-actions bot added the bug Something isn't working label Jan 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

0 participants