Skip to content

RANGER-5310:Include Apache Tez as the process framework for ranger-hive docker #660

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 3 commits into
base: master
Choose a base branch
from
Open

RANGER-5310:Include Apache Tez as the process framework for ranger-hive docker #660

Show file tree
Hide file tree
Changes from 2 commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
6cd72c3
RANGER-5310:Include Apache Tez as the process framework for ranger-hi…
Sep 6, 2025
83d17bb
RANGER-5310:Include Apache Tez as the process framework for ranger-h…
Sep 8, 2025
482d27f
RANGER-5310:Include Apache Tez as the process framework for ranger-hi…
Oct 1, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 2 additions & 1 deletion dev-support/ranger-docker/.env
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -25,8 +25,9 @@ SOLR_VERSION=8.11.3
HADOOP_VERSION=3.3.6
HBASE_VERSION=2.6.0
HIVE_VERSION=4.0.1
HIVE_HADOOP_VERSION=3.1.1
KAFKA_VERSION=2.8.2
HIVE_HADOOP_VERSION=3.3.6
TEZ_VERSION=0.10.4
KNOX_VERSION=2.0.0
TRINO_VERSION=377
OZONE_VERSION=1.4.0
Expand Down
3 changes: 3 additions & 0 deletions dev-support/ranger-docker/Dockerfile.ranger
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -29,6 +29,7 @@ COPY ./dist/ranger-${RANGER_VERSION}-admin.tar.gz /home/ranger/dist/
COPY ./scripts/ranger.sh ${RANGER_SCRIPTS}/
COPY ./scripts/ranger-admin-install-${RANGER_DB_TYPE}.properties ${RANGER_SCRIPTS}/ranger-admin-install.properties
COPY ./scripts/create-ranger-services.py ${RANGER_SCRIPTS}/
COPY ./scripts/create-users.sh ${RANGER_SCRIPTS}/

RUN tar xvfz /home/ranger/dist/ranger-${RANGER_VERSION}-admin.tar.gz --directory=${RANGER_HOME} \
&& ln -s ${RANGER_HOME}/ranger-${RANGER_VERSION}-admin ${RANGER_HOME}/admin \
Expand All @@ -37,6 +38,8 @@ RUN tar xvfz /home/ranger/dist/ranger-${RANGER_VERSION}-admin.tar.gz --direct
&& mkdir -p /var/run/ranger \
&& mkdir -p /var/log/ranger \
&& chown -R ranger:ranger ${RANGER_HOME}/admin/ ${RANGER_SCRIPTS}/ /var/run/ranger/ /var/log/ranger/ \
&& chmod +x ${RANGER_SCRIPTS}/create-users.sh \
&& ${RANGER_SCRIPTS}/create-users.sh \
&& chmod 755 ${RANGER_SCRIPTS}/ranger.sh \
&& mkdir -p /usr/share/java/

Expand Down
7 changes: 7 additions & 0 deletions dev-support/ranger-docker/Dockerfile.ranger-hadoop
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -21,22 +21,27 @@ FROM ${RANGER_BASE_IMAGE}:${RANGER_BASE_VERSION}
ARG HADOOP_VERSION
ARG HDFS_PLUGIN_VERSION
ARG YARN_PLUGIN_VERSION
ARG TEZ_VERSION


COPY ./dist/version /home/ranger/dist/
COPY ./dist/ranger-${HDFS_PLUGIN_VERSION}-hdfs-plugin.tar.gz /home/ranger/dist/
COPY ./dist/ranger-${YARN_PLUGIN_VERSION}-yarn-plugin.tar.gz /home/ranger/dist/
COPY ./downloads/hadoop-${HADOOP_VERSION}.tar.gz /home/ranger/dist/
COPY ./downloads/apache-tez-${TEZ_VERSION}-bin.tar.gz /home/ranger/dist/

COPY ./scripts/ranger-hadoop-setup.sh /home/ranger/scripts/
COPY ./scripts/ranger-hadoop.sh /home/ranger/scripts/
COPY ./scripts/ranger-hadoop-mkdir.sh /home/ranger/scripts/
COPY ./scripts/ranger-hdfs-plugin-install.properties /home/ranger/scripts/
COPY ./scripts/ranger-yarn-plugin-install.properties /home/ranger/scripts/
COPY ./scripts/create-users.sh /home/ranger/scripts/

RUN tar xvfz /home/ranger/dist/hadoop-${HADOOP_VERSION}.tar.gz --directory=/opt/ && \
ln -s /opt/hadoop-${HADOOP_VERSION} /opt/hadoop && \
rm -f /home/ranger/dist/hadoop-${HADOOP_VERSION}.tar.gz && \
tar xvfz /home/ranger/dist/apache-tez-${TEZ_VERSION}-bin.tar.gz --directory=/opt/ && \
ln -s /opt/apache-tez-${TEZ_VERSION}-bin /opt/tez && \
tar xvfz /home/ranger/dist/ranger-${HDFS_PLUGIN_VERSION}-hdfs-plugin.tar.gz --directory=/opt/ranger && \
ln -s /opt/ranger/ranger-${HDFS_PLUGIN_VERSION}-hdfs-plugin /opt/ranger/ranger-hdfs-plugin && \
rm -f /home/ranger/dist/ranger-${HDFS_PLUGIN_VERSION}-hdfs-plugin.tar.gz && \
Expand All @@ -46,6 +51,8 @@ RUN tar xvfz /home/ranger/dist/hadoop-${HADOOP_VERSION}.tar.gz --directory=/opt/
rm -f /home/ranger/dist/ranger-${YARN_PLUGIN_VERSION}-yarn-plugin.tar.gz && \
cp -f /home/ranger/scripts/ranger-yarn-plugin-install.properties /opt/ranger/ranger-yarn-plugin/install.properties && \
chmod 744 ${RANGER_SCRIPTS}/ranger-hadoop-setup.sh ${RANGER_SCRIPTS}/ranger-hadoop.sh ${RANGER_SCRIPTS}/ranger-hadoop-mkdir.sh && \
chmod +x ${RANGER_SCRIPTS}/create-users.sh && \
${RANGER_SCRIPTS}/create-users.sh && \
chown hdfs:hadoop ${RANGER_SCRIPTS}/ranger-hadoop-mkdir.sh

RUN apt-get update && \
Expand Down
5 changes: 4 additions & 1 deletion dev-support/ranger-docker/Dockerfile.ranger-hbase
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -29,6 +29,7 @@ COPY ./downloads/hbase-${HBASE_VERSION}-bin.tar.gz /home/ranger/dis
COPY ./scripts/ranger-hbase-setup.sh /home/ranger/scripts/
COPY ./scripts/ranger-hbase.sh /home/ranger/scripts/
COPY ./scripts/ranger-hbase-plugin-install.properties /home/ranger/scripts/
COPY ./scripts/create-users.sh /home/ranger/scripts/
COPY ./scripts/hbase-site.xml /home/ranger/scripts/

RUN tar xvfz /home/ranger/dist/hbase-${HBASE_VERSION}-bin.tar.gz --directory=/opt/ && \
Expand All @@ -38,7 +39,9 @@ RUN tar xvfz /home/ranger/dist/hbase-${HBASE_VERSION}-bin.tar.gz --directory=/op
ln -s /opt/ranger/ranger-${HBASE_PLUGIN_VERSION}-hbase-plugin /opt/ranger/ranger-hbase-plugin && \
rm -f /home/ranger/dist/ranger-${HBASE_PLUGIN_VERSION}-hbase-plugin.tar.gz && \
cp -f /home/ranger/scripts/ranger-hbase-plugin-install.properties /opt/ranger/ranger-hbase-plugin/install.properties && \
chmod 744 ${RANGER_SCRIPTS}/ranger-hbase-setup.sh ${RANGER_SCRIPTS}/ranger-hbase.sh
chmod 744 ${RANGER_SCRIPTS}/ranger-hbase-setup.sh ${RANGER_SCRIPTS}/ranger-hbase.sh && \
chmod +x ${RANGER_SCRIPTS}/create-users.sh && \
${RANGER_SCRIPTS}/create-users.sh

RUN apt-get update && \
apt-get install -y --no-install-recommends openssh-server && \
Expand Down
16 changes: 13 additions & 3 deletions dev-support/ranger-docker/Dockerfile.ranger-hive
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,13 +22,15 @@ FROM ${RANGER_BASE_IMAGE}:${RANGER_BASE_VERSION}
ARG HIVE_VERSION
ARG HIVE_HADOOP_VERSION
ARG HIVE_PLUGIN_VERSION
ARG TEZ_VERSION
ARG RANGER_DB_TYPE


COPY ./dist/version /home/ranger/dist/
COPY ./dist/ranger-${HIVE_PLUGIN_VERSION}-hive-plugin.tar.gz /home/ranger/dist/
COPY ./downloads/apache-hive-${HIVE_VERSION}-bin.tar.gz /home/ranger/dist/
COPY ./downloads/hadoop-${HIVE_HADOOP_VERSION}.tar.gz /home/ranger/dist/
COPY ./downloads/apache-tez-${TEZ_VERSION}-bin.tar.gz /home/ranger/dist/
COPY ./downloads/postgresql-42.2.16.jre7.jar /home/ranger/dist/
COPY ./downloads/mysql-connector-java-8.0.28.jar /home/ranger/dist/
COPY ./downloads/ojdbc8.jar /home/ranger/dist/
Expand All @@ -37,8 +39,9 @@ COPY ./scripts/ranger-hive-setup.sh /home/ranger/scripts/
COPY ./scripts/ranger-hive.sh /home/ranger/scripts/
COPY ./scripts/ranger-hive-plugin-install.properties /home/ranger/scripts/
COPY ./scripts/hive-site-${RANGER_DB_TYPE}.xml /home/ranger/scripts/hive-site.xml
COPY ./scripts/create-users.sh /home/ranger/scripts/

RUN tar xvfz /home/ranger/dist/apache-hive-${HIVE_VERSION}-bin.tar.gz --directory=/opt/ && \
RUN cd /opt && tar xzf /home/ranger/dist/apache-hive-${HIVE_VERSION}-bin.tar.gz && \
ln -s /opt/apache-hive-${HIVE_VERSION}-bin /opt/hive && \
rm -f /home/ranger/dist/apache-hive-${HIVE_VERSION}-bin.tar.gz && \
mv /home/ranger/dist/postgresql-42.2.16.jre7.jar /opt/hive/lib/ && \
Expand All @@ -47,15 +50,22 @@ RUN tar xvfz /home/ranger/dist/apache-hive-${HIVE_VERSION}-bin.tar.gz --director
tar xvfz /home/ranger/dist/hadoop-${HIVE_HADOOP_VERSION}.tar.gz --directory=/opt/ && \
ln -s /opt/hadoop-${HIVE_HADOOP_VERSION} /opt/hadoop && \
rm -f /home/ranger/dist/hadoop-${HIVE_HADOOP_VERSION}.tar.gz && \
tar xvfz /home/ranger/dist/apache-tez-${TEZ_VERSION}-bin.tar.gz --directory=/opt/ && \
ln -s /opt/apache-tez-${TEZ_VERSION}-bin /opt/tez && \
rm -f /home/ranger/dist/apache-tez-${TEZ_VERSION}-bin.tar.gz && \
tar xvfz /home/ranger/dist/ranger-${HIVE_PLUGIN_VERSION}-hive-plugin.tar.gz --directory=/opt/ranger && \
ln -s /opt/ranger/ranger-${HIVE_PLUGIN_VERSION}-hive-plugin /opt/ranger/ranger-hive-plugin && \
rm -f /home/ranger/dist/ranger-${HIVE_PLUGIN_VERSION}-hive-plugin.tar.gz && \
cp -f /home/ranger/scripts/ranger-hive-plugin-install.properties /opt/ranger/ranger-hive-plugin/install.properties && \
chmod 744 ${RANGER_SCRIPTS}/ranger-hive-setup.sh ${RANGER_SCRIPTS}/ranger-hive.sh
chmod 744 ${RANGER_SCRIPTS}/ranger-hive-setup.sh ${RANGER_SCRIPTS}/ranger-hive.sh && \
chmod +x ${RANGER_SCRIPTS}/create-users.sh && \
${RANGER_SCRIPTS}/create-users.sh

ENV HIVE_HOME=/opt/hive
ENV HADOOP_HOME=/opt/hadoop
ENV PATH=/usr/java/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/opt/hive/bin:/opt/hadoop/bin
ENV TEZ_HOME=/opt/tez
ENV TEZ_CONF_DIR=/opt/tez/conf
ENV PATH=/usr/java/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/opt/hive/bin:/opt/hadoop/bin:/opt/tez/bin


ENTRYPOINT [ "/home/ranger/scripts/ranger-hive.sh" ]
6 changes: 5 additions & 1 deletion dev-support/ranger-docker/Dockerfile.ranger-kafka
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -29,6 +29,7 @@ COPY ./downloads/kafka_2.12-${KAFKA_VERSION}.tgz /home/ranger/dist
COPY ./scripts/ranger-kafka-setup.sh /home/ranger/scripts/
COPY ./scripts/ranger-kafka.sh /home/ranger/scripts/
COPY ./scripts/ranger-kafka-plugin-install.properties /home/ranger/scripts/
COPY ./scripts/create-users.sh /home/ranger/scripts/

RUN tar xvfz /home/ranger/dist/kafka_2.12-${KAFKA_VERSION}.tgz --directory=/opt/ && \
ln -s /opt/kafka_2.12-${KAFKA_VERSION} /opt/kafka && \
Expand All @@ -37,7 +38,10 @@ RUN tar xvfz /home/ranger/dist/kafka_2.12-${KAFKA_VERSION}.tgz --directory=/opt/
ln -s /opt/ranger/ranger-${KAFKA_PLUGIN_VERSION}-kafka-plugin /opt/ranger/ranger-kafka-plugin && \
rm -f /home/ranger/dist/ranger-${KAFKA_PLUGIN_VERSION}-kafka-plugin.tar.gz && \
cp -f /home/ranger/scripts/ranger-kafka-plugin-install.properties /opt/ranger/ranger-kafka-plugin/install.properties && \
chmod 744 ${RANGER_SCRIPTS}/ranger-kafka-setup.sh ${RANGER_SCRIPTS}/ranger-kafka.sh
chmod 744 ${RANGER_SCRIPTS}/ranger-kafka-setup.sh ${RANGER_SCRIPTS}/ranger-kafka.sh && \
chmod +x ${RANGER_SCRIPTS}/create-users.sh && \
${RANGER_SCRIPTS}/create-users.sh


ENV KAFKA_HOME=/opt/kafka
ENV PATH=/usr/java/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/opt/kafka/bin
Expand Down
4 changes: 3 additions & 1 deletion dev-support/ranger-docker/Dockerfile.ranger-kms
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -26,6 +26,7 @@ COPY ./dist/ranger-${KMS_VERSION}-kms.tar.gz /home/ranger/dist

COPY ./scripts/ranger-kms.sh ${RANGER_SCRIPTS}/
COPY ./scripts/ranger-kms-install-${RANGER_DB_TYPE}.properties ${RANGER_SCRIPTS}/ranger-kms-install.properties
COPY ./scripts/create-users.sh /home/ranger/scripts/

RUN tar xvfz /home/ranger/dist/ranger-${KMS_VERSION}-kms.tar.gz --directory=${RANGER_HOME} && \
ln -s ${RANGER_HOME}/ranger-${KMS_VERSION}-kms ${RANGER_HOME}/kms && \
Expand All @@ -39,7 +40,8 @@ RUN tar xvfz /home/ranger/dist/ranger-${KMS_VERSION}-kms.tar.gz --directory=${RA
ln -s /etc/init.d/ranger-kms /etc/rc3.d/K90ranger-kms && \
ln -s ${RANGER_HOME}/kms/ranger-kms-services.sh /usr/bin/ranger-kms-services.sh && \
chown -R rangerkms:ranger ${RANGER_HOME}/kms/ ${RANGER_SCRIPTS}/ /var/run/ranger_kms/ /var/log/ranger/ && \
chmod 744 ${RANGER_SCRIPTS}/ranger-kms.sh
chmod 744 ${RANGER_SCRIPTS}/ranger-kms.sh && \
${RANGER_SCRIPTS}/create-users.sh

FROM ranger-kms AS ranger_postgres
COPY ./downloads/postgresql-42.2.16.jre7.jar /home/ranger/dist/
Expand Down
5 changes: 4 additions & 1 deletion dev-support/ranger-docker/Dockerfile.ranger-knox
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -25,6 +25,7 @@ ARG KNOX_PLUGIN_VERSION
COPY ./dist/version /home/ranger/dist/
COPY ./dist/ranger-${KNOX_PLUGIN_VERSION}-knox-plugin.tar.gz /home/ranger/dist/
COPY ./downloads/knox-${KNOX_VERSION}.tar.gz /home/ranger/dist/
COPY ./scripts/create-users.sh /home/ranger/scripts/

COPY ./scripts/ranger-knox-setup.sh /home/ranger/scripts/
COPY ./scripts/ranger-knox.sh /home/ranger/scripts/
Expand All @@ -40,7 +41,9 @@ RUN tar xvfz /home/ranger/dist/knox-${KNOX_VERSION}.tar.gz --directory=/opt/ &&
rm -f /home/ranger/dist/ranger-${KNOX_PLUGIN_VERSION}-knox-plugin.tar.gz && \
cp -f /home/ranger/scripts/ranger-knox-plugin-install.properties /opt/ranger/ranger-knox-plugin/install.properties && \
cp -f /home/ranger/scripts/ranger-knox-sandbox.xml /opt/knox/conf/topologies/sandbox.xml && \
chmod 744 ${RANGER_SCRIPTS}/ranger-knox-setup.sh ${RANGER_SCRIPTS}/ranger-knox.sh ${RANGER_SCRIPTS}/ranger-knox-expect.py
chmod 744 ${RANGER_SCRIPTS}/ranger-knox-setup.sh ${RANGER_SCRIPTS}/ranger-knox.sh ${RANGER_SCRIPTS}/ranger-knox-expect.py && \
chmod +x ${RANGER_SCRIPTS}/create-users.sh && \
${RANGER_SCRIPTS}/create-users.sh

ENV KNOX_HOME=/opt/knox
ENV PATH=/usr/java/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/opt/knox/bin
Expand Down
5 changes: 4 additions & 1 deletion dev-support/ranger-docker/Dockerfile.ranger-tagsync
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -26,6 +26,7 @@ COPY ./dist/ranger-${TAGSYNC_VERSION}-tagsync.tar.gz /home/ranger/dist/
COPY ./scripts/ranger-tagsync.sh ${RANGER_SCRIPTS}/
COPY ./scripts/ranger-tagsync-install.properties ${RANGER_SCRIPTS}/
COPY ./scripts/ranger-tagsync-tags.json ${RANGER_SCRIPTS}/
COPY ./scripts/create-users.sh ${RANGER_SCRIPTS}/

RUN tar xvfz /home/ranger/dist/ranger-${TAGSYNC_VERSION}-tagsync.tar.gz --directory=${RANGER_HOME} && \
ln -s ${RANGER_HOME}/ranger-${TAGSYNC_VERSION}-tagsync ${RANGER_HOME}/tagsync && \
Expand All @@ -43,7 +44,9 @@ RUN tar xvfz /home/ranger/dist/ranger-${TAGSYNC_VERSION}-tagsync.tar.gz --direct
ln -s /etc/init.d/ranger-tagsync /etc/rc3.d/K00ranger-tagsync && \
ln -s ${RANGER_HOME}/tagsync/ranger-tagsync-services.sh /usr/bin/ranger-tagsync-services.sh && \
chown -R ranger:ranger ${RANGER_HOME}/tagsync/ ${RANGER_SCRIPTS}/ /var/run/ranger/ /var/log/ranger/ /etc/ranger /etc/init.d/ranger-tagsync && \
chmod 744 ${RANGER_SCRIPTS}/ranger-tagsync.sh
chmod 744 ${RANGER_SCRIPTS}/ranger-tagsync.sh && \
chmod +x ${RANGER_SCRIPTS}/create-users.sh && \
${RANGER_SCRIPTS}/create-users.sh

USER ranger

Expand Down
5 changes: 4 additions & 1 deletion dev-support/ranger-docker/Dockerfile.ranger-usersync
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -26,6 +26,7 @@ COPY ./dist/ranger-${USERSYNC_VERSION}-usersync.tar.gz /home/ranger/dist/
COPY ./scripts/ranger-usersync.sh ${RANGER_SCRIPTS}/
COPY ./scripts/ranger-usersync-install.properties ${RANGER_SCRIPTS}/
COPY ./scripts/ugsync-file-source.csv ${RANGER_SCRIPTS}/
COPY ./scripts/create-users.sh ${RANGER_SCRIPTS}/

RUN tar xvfz /home/ranger/dist/ranger-${USERSYNC_VERSION}-usersync.tar.gz --directory=${RANGER_HOME} && \
ln -s ${RANGER_HOME}/ranger-${USERSYNC_VERSION}-usersync ${RANGER_HOME}/usersync && \
Expand All @@ -42,7 +43,9 @@ RUN tar xvfz /home/ranger/dist/ranger-${USERSYNC_VERSION}-usersync.tar.gz --dire
ln -s /etc/init.d/ranger-usersync /etc/rc3.d/K00ranger-usersync && \
ln -s ${RANGER_HOME}/usersync/ranger-usersync-services.sh /usr/bin/ranger-usersync && \
chown -R ranger:ranger ${RANGER_HOME}/usersync/ ${RANGER_SCRIPTS}/ /var/run/ranger/ /var/log/ranger/ /etc/ranger /etc/init.d/ranger-usersync && \
chmod 744 ${RANGER_SCRIPTS}/ranger-usersync.sh
chmod 744 ${RANGER_SCRIPTS}/ranger-usersync.sh && \
chmod +x ${RANGER_SCRIPTS}/create-users.sh && \
${RANGER_SCRIPTS}/create-users.sh

USER ranger

Expand Down
2 changes: 2 additions & 0 deletions dev-support/ranger-docker/docker-compose.ranger-hadoop.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,7 @@ services:
- HADOOP_VERSION=${HADOOP_VERSION}
- HDFS_PLUGIN_VERSION=${HDFS_PLUGIN_VERSION}
- YARN_PLUGIN_VERSION=${YARN_PLUGIN_VERSION}
- TEZ_VERSION=${TEZ_VERSION}
image: ranger-hadoop
container_name: ranger-hadoop
hostname: ranger-hadoop.example.com
Expand All @@ -32,6 +33,7 @@ services:
- HADOOP_VERSION
- HDFS_PLUGIN_VERSION
- YARN_PLUGIN_VERSION
- TEZ_VERSION

networks:
ranger:
Expand Down
3 changes: 3 additions & 0 deletions dev-support/ranger-docker/docker-compose.ranger-hive.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,7 @@ services:
- HIVE_HADOOP_VERSION=${HIVE_HADOOP_VERSION}
- HIVE_VERSION=${HIVE_VERSION}
- HIVE_PLUGIN_VERSION=${HIVE_PLUGIN_VERSION}
- TEZ_VERSION=${TEZ_VERSION}
- RANGER_DB_TYPE=${RANGER_DB_TYPE}
image: ranger-hive
container_name: ranger-hive
Expand All @@ -19,6 +20,7 @@ services:
- ranger
ports:
- "10000:10000"
- "9083:9083"
depends_on:
ranger:
condition: service_started
Expand All @@ -30,6 +32,7 @@ services:
- HIVE_HADOOP_VERSION
- HIVE_VERSION
- HIVE_PLUGIN_VERSION
- TEZ_VERSION
- RANGER_DB_TYPE

networks:
Expand Down
2 changes: 2 additions & 0 deletions dev-support/ranger-docker/download-archives.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -53,6 +53,7 @@ then
downloadIfNotPresent hbase-${HBASE_VERSION}-bin.tar.gz https://archive.apache.org/dist/hbase/${HBASE_VERSION}
downloadIfNotPresent apache-hive-${HIVE_VERSION}-bin.tar.gz https://archive.apache.org/dist/hive/hive-${HIVE_VERSION}
downloadIfNotPresent hadoop-${HIVE_HADOOP_VERSION}.tar.gz https://archive.apache.org/dist/hadoop/common/hadoop-${HIVE_HADOOP_VERSION}
downloadIfNotPresent apache-tez-${TEZ_VERSION}-bin.tar.gz https://archive.apache.org/dist/tez/${TEZ_VERSION}
downloadIfNotPresent kafka_2.12-${KAFKA_VERSION}.tgz https://archive.apache.org/dist/kafka/${KAFKA_VERSION}
downloadIfNotPresent knox-${KNOX_VERSION}.tar.gz https://archive.apache.org/dist/knox/${KNOX_VERSION}
downloadIfNotPresent ozone-${OZONE_VERSION}.tar.gz https://archive.apache.org/dist/ozone/${OZONE_VERSION}
Expand All @@ -72,6 +73,7 @@ else
then
downloadIfNotPresent apache-hive-${HIVE_VERSION}-bin.tar.gz https://archive.apache.org/dist/hive/hive-${HIVE_VERSION}
downloadIfNotPresent hadoop-${HIVE_HADOOP_VERSION}.tar.gz https://archive.apache.org/dist/hadoop/common/hadoop-${HIVE_HADOOP_VERSION}
downloadIfNotPresent apache-tez-${TEZ_VERSION}-bin.tar.gz https://archive.apache.org/dist/tez/${TEZ_VERSION}
elif [[ $arg == 'kafka' ]]
then
downloadIfNotPresent kafka_2.12-${KAFKA_VERSION}.tgz https://archive.apache.org/dist/kafka/${KAFKA_VERSION}
Expand Down
43 changes: 43 additions & 0 deletions dev-support/ranger-docker/scripts/create-users.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,43 @@
#!/bin/bash
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@rameeshm - following users and groups are created in ranger-base image, using https://github.com/apache/ranger-tools/blob/main/docker/Dockerfile#L50. It might be useful to add users alice and abram in ranger-base image itself, so that these users are available in all Ranger images.

users: ranger rangeradmin rangerusersync rangertagsync rangerkms hdfs yarn hive hbase kafka ozone knox
groups: ranger hadoop knox

With this approach, updates to many Dockerfiles in this PR can be eliminated.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@mneethiraj Addressed this review comment to use ranger-base image and create users. Thanks


# Licensed to the Apache Software Foundation (ASF) under one
# or more contributor license agreements. See the NOTICE file
# distributed with this work for additional information
# regarding copyright ownership. The ASF licenses this file
# to you under the Apache License, Version 2.0 (the
# "License"); you may not use this file except in compliance
# with the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.

# Script to create alice and abram users in ranger containers
# This script is designed to be run during container initialization

# Function to create a user for testing.
create_user_if_not_exists() {
local username=$1
local home_dir=$2

if ! id "$username" &>/dev/null; then
echo "Creating user: $username"
useradd -m -d "$home_dir" -s /bin/bash "$username"

# Set a default password
echo "$username:$username" | chpasswd

echo "User $username created successfully"
else
echo "User $username already exists"
fi
}

# Create alice user
create_user_if_not_exists "alice" "/home/alice"
# Create abram user
create_user_if_not_exists "abram" "/home/abram"
Loading
Loading