فهرست منبع

[spark] Document how to specify a queue in YARN mode

Romain Rigaux 10 سال پیش
والد
کامیت
97eea305a0
1فایلهای تغییر یافته به همراه13 افزوده شده و 4 حذف شده
  1. 13 4
      apps/spark/java/README.rst

+ 13 - 4
apps/spark/java/README.rst

@@ -20,9 +20,15 @@ Quick Start
 Livy is used for powering the Spark snippets of the `Hadoop Notebook`_ of `Hue 3.8`_, which you can see the
 `implementation here`_.
 
-See some `curl examples`_ and the API documentation is available below.
+See the API documentation below and some curl examples:
 
-.. _curl examples: http://gethue.com/how-to-use-the-livy-spark-rest-job-server-for-interactive-spark/
+  * `Interactive shells`_
+  * `Batch jobs`_
+  * `Shared RDDs`_
+
+.. _Interactive shells: http://gethue.com/how-to-use-the-livy-spark-rest-job-server-for-interactive-spark/
+.. _Batch jobs: http://gethue.com/how-to-use-the-livy-spark-rest-job-server-api-for-sharing-spark-rdds-and-contexts/
+.. _Shared RDDs: http://gethue.com/how-to-use-the-livy-spark-rest-job-server-api-for-submitting-batch-jar-python-and-streaming-spark-jobs/
 .. _Hadoop Notebook: http://gethue.com/new-notebook-application-for-spark-sql/
 .. _Hue 3.8: http://gethue.com/hue-3-8-with-an-oozie-editor-revamp-better-performances-improved-spark-ui-is-out/
 .. _implementation here: https://github.com/cloudera/hue/blob/master/apps/spark/src/spark/job_server_api.py
@@ -138,7 +144,7 @@ takes Scala code:
 
 .. code:: shell
     % sudo pip install requests
-    
+
 .. code:: python
 
     >>> import json, pprint, requests, textwrap
@@ -360,6 +366,8 @@ Request Body
 +----------------+--------------------------------------------------------------------------------+------------------+
 | archives       | Archives to be uncompressed in the executor working directory (YARN mode only) | list of paths    |
 +----------------+--------------------------------------------------------------------------------+------------------+
+| queue          | The YARN queue to submit too (YARN mode only)                                  | string           |
++----------------+--------------------------------------------------------------------------------+------------------+
 
 
 Response Body
@@ -502,7 +510,8 @@ Request Body
 +----------------+--------------------------------------------------+-----------------+
 | archives       | Archives to be uncompressed (YARN mode only)     | list of paths   |
 +----------------+--------------------------------------------------+-----------------+
-
+| queue          | The YARN queue to submit too (YARN mode only)    | string          |
++----------------+--------------------------------------------------+-----------------+
 Response Body
 ^^^^^^^^^^^^^