Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bump hive and EMR cluster version #1536

Merged
merged 5 commits into from
May 27, 2024
Merged

Bump hive and EMR cluster version #1536

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
26eb5a5
Bump hive version to 4.0.0 as 2.x.x is EOL
vatsrahul1001 May 27, 2024
a943b1d
update hive and emr version
vatsrahul1001 May 27, 2024
bdb2b71
Merge branch 'main' into bump-hive-version
vatsrahul1001 May 27, 2024
8c4e797
updating hive version to 3.1.3
vatsrahul1001 May 27, 2024
47c3443
Merge branch 'bump-hive-version' of github.com:astronomer/Astronomer-…
vatsrahul1001 May 27, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .circleci/integration-tests/Dockerfile.astro_cloud
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ RUN apt-get update -y \


# Set Hive and Hadoop versions.
ENV HIVE_LIBRARY_VERSION=hive-4.0.0
ENV HIVE_LIBRARY_VERSION=hive-3.1.3
ENV HADOOP_LIBRARY_VERSION=hadoop-2.10.1

# install AWS CLI
Expand Down
2 changes: 1 addition & 1 deletion astronomer/providers/apache/hive/example_dags/example_hive.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -55,7 +55,7 @@
# match the hive and hadoop versions same as specified in the integration tests `Dockefile`.
JOB_FLOW_OVERRIDES = {
"Name": HIVE_CLUSTER,
"ReleaseLabel": "emr-5.34.0",
"ReleaseLabel": "emr-6.6.0",
"Applications": [
{"Name": "Spark"},
{
Expand Down
Loading