|
@@ -97,24 +97,30 @@ Livy`_. Then run:
|
|
|
.. code:: shell
|
|
.. code:: shell
|
|
|
|
|
|
|
|
% export SPARK_HOME=/usr/lib/spark
|
|
% export SPARK_HOME=/usr/lib/spark
|
|
|
|
|
+ % export HADOOP_CONF_DIR=/etc/hadoop/conf
|
|
|
% mvn test
|
|
% mvn test
|
|
|
|
|
|
|
|
|
|
|
|
|
Running Livy
|
|
Running Livy
|
|
|
============
|
|
============
|
|
|
|
|
|
|
|
-In order to run Livy with local sessions, start the server with:
|
|
|
|
|
|
|
+In order to run Livy with local sessions, first export these variables:
|
|
|
|
|
+
|
|
|
|
|
+.. code:: shell
|
|
|
|
|
+
|
|
|
|
|
+ % export SPARK_HOME=/usr/lib/spark
|
|
|
|
|
+ % export HADOOP_CONF_DIR=/etc/hadoop/conf
|
|
|
|
|
+
|
|
|
|
|
+Then start the server with:
|
|
|
|
|
|
|
|
.. code:: shell
|
|
.. code:: shell
|
|
|
|
|
|
|
|
- % export SPARK_HOME=/usr/lib/spark
|
|
|
|
|
% ./bin/livy-server
|
|
% ./bin/livy-server
|
|
|
|
|
|
|
|
Or with YARN sessions by running:
|
|
Or with YARN sessions by running:
|
|
|
|
|
|
|
|
.. code:: shell
|
|
.. code:: shell
|
|
|
|
|
|
|
|
- % export SPARK_HOME=/usr/lib/spark
|
|
|
|
|
% env \
|
|
% env \
|
|
|
LIVY_SERVER_JAVA_OPTS="-Dlivy.server.session.factory=yarn" \
|
|
LIVY_SERVER_JAVA_OPTS="-Dlivy.server.session.factory=yarn" \
|
|
|
CLASSPATH=`hadoop classpath` \
|
|
CLASSPATH=`hadoop classpath` \
|