index.html 37 KB

1234567891011121314151617181920212223242526272829303132333435363738394041424344454647484950515253545556575859606162636465666768697071727374757677787980818283848586878889909192939495969798991001011021031041051061071081091101111121131141151161171181191201211221231241251261271281291301311321331341351361371381391401411421431441451461471481491501511521531541551561571581591601611621631641651661671681691701711721731741751761771781791801811821831841851861871881891901911921931941951961971981992002012022032042052062072082092102112122132142152162172182192202212222232242252262272282292302312322332342352362372382392402412422432442452462472482492502512522532542552562572582592602612622632642652662672682692702712722732742752762772782792802812822832842852862872882892902912922932942952962972982993003013023033043053063073083093103113123133143153163173183193203213223233243253263273283293303313323333343353363373383393403413423433443453463473483493503513523533543553563573583593603613623633643653663673683693703713723733743753763773783793803813823833843853863873883893903913923933943953963973983994004014024034044054064074084094104114124134144154164174184194204214224234244254264274284294304314324334344354364374384394404414424434444454464474484494504514524534544554564574584594604614624634644654664674684694704714724734744754764774784794804814824834844854864874884894904914924934944954964974984995005015025035045055065075085095105115125135145155165175185195205215225235245255265275285295305315325335345355365375385395405415425435445455465475485495505515525535545555565575585595605615625635645655665675685695705715725735745755765775785795805815825835845855865875885895905915925935945955965975985996006016026036046056066076086096106116126136146156166176186196206216226236246256266276286296306316326336346356366376386396406416426436446456466476486496506516526536546556566576586596606616626636646656666676686696706716726736746756766776786796806816826836846856866876886896906916926936946956966976986997007017027037047057067077087097107117127137147157167177187197207217227237247257267277287297307317327337347357367377387397407417427437447457467477487497507517527537547557567577587597607617627637647657667677687697707717727737747757767777787797807817827837847857867877887897907917927937947957967977987998008018028038048058068078088098108118128138148158168178188198208218228238248258268278288298308318328338348358368378388398408418428438448458468478488498508518528538548558568578588598608618628638648658668678688698708718728738748758768778788798808818828838848858868878888898908918928938948958968978988999009019029039049059069079089099109119129139149159169179189199209219229239249259269279289299309319329339349359369379389399409419429439449459469479489499509519529539549559569579589599609619629639649659669679689699709719729739749759769779789799809819829839849859869879889899909919929939949959969979989991000100110021003100410051006100710081009101010111012101310141015101610171018101910201021102210231024102510261027102810291030103110321033103410351036103710381039104010411042104310441045104610471048104910501051105210531054105510561057105810591060106110621063106410651066106710681069107010711072107310741075107610771078107910801081108210831084108510861087108810891090109110921093109410951096109710981099110011011102110311041105110611071108110911101111111211131114111511161117111811191120112111221123112411251126112711281129113011311132113311341135113611371138113911401141114211431144114511461147114811491150115111521153115411551156115711581159116011611162116311641165116611671168116911701171
  1. <?xml version="1.0" encoding="UTF-8"?>
  2. <!DOCTYPE html
  3. PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
  4. <html lang="en-us" xml:lang="en-us">
  5. <head>
  6. <meta http-equiv="Content-Type" content="text/html; charset=utf-8"/>
  7. <link rel="stylesheet" type="text/css" href="commonltr.css"/>
  8. <title>Job Designer</title>
  9. </head>
  10. <body id="topic_8"><a name="topic_8"><!-- --></a>
  11. <h1 class="title topictitle1">Job Designer </h1>
  12. <div class="body conbody">
  13. <p class="p">The Job Designer application enables you to create and submit jobs to the
  14. Hadoop cluster. You can include variables with your jobs to enable you and other users
  15. to enter values for the variables when they run your job. The Job Designer supports the
  16. actions supported by <a class="xref" href="http://archive.cloudera.com/cdh4/cdh/4/oozie/" target="_blank">Oozie</a>: <a class="xref" href="../../../../content/cloudera-content/cloudera-docs/HadoopTutorial/CDH4/index.html" target="_blank">MapReduce</a>, Streaming, Java, Pig, Hive, Sqoop, Shell, Ssh, DistCp, Fs, and
  17. Email. </p>
  18. </div>
  19. <div class="topic concept nested1" xml:lang="en-US" lang="en-US" id="topic_8_1"><a name="topic_8_1"><!-- --></a>
  20. <h2 class="title topictitle2">Job Designer Installation and Configuration </h2>
  21. <div class="body conbody">
  22. <p class="p">Job Designer is one of the applications installed as part of Hue. <span class="ph">For information about installing and configuring Hue,
  23. see Hue Installation in <a class="xref" href="http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH4/latest/CDH4-Installation-Guide/CDH4-Installation-Guide.html" target="_blank">http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH4/latest/CDH4-Installation-Guide/CDH4-Installation-Guide.html</a>.</span></p>
  24. <p class="p">In order to run DistCp, Streaming, Pig, Sqoop, and Hive
  25. jobs, Oozie must be configured to use the Oozie ShareLib. See Oozie Installation in <a class="xref" href="http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH4/latest/CDH4-Installation-Guide/CDH4-Installation-Guide.html" target="_blank">http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH4/latest/CDH4-Installation-Guide/CDH4-Installation-Guide.html</a>. </p>
  26. </div>
  27. </div>
  28. <div class="topic concept nested1" xml:lang="en-US" lang="en-US" id="topic_8_2"><a name="topic_8_2"><!-- --></a>
  29. <h2 class="title topictitle2">Starting Job Designer </h2>
  30. <div class="body conbody">
  31. <p class="p">Click the <strong class="ph b">Job Designer</strong> icon (<img class="image" src="/static/art/help/icon_jobsub_24.png"/>) in the navigation bar at the top of the Hue web page.
  32. The <strong class="ph b">Job Designs</strong> page opens in the browser. </p>
  33. </div>
  34. </div>
  35. <div class="topic concept nested1" xml:lang="en-US" lang="en-US" id="topic_8_3"><a name="topic_8_3"><!-- --></a>
  36. <h2 class="title topictitle2">Installing the Example Job Designs </h2>
  37. <div class="body conbody">
  38. <div class="note note"><span class="notetitle"><img src="/static/art/help/note.jpg"/> 
  39. <b>Note</b>:</span> You must be a superuser to perform this task.</div>
  40. <a name="topic_8_3__ol_ebx_xng_dk"><!-- --></a><ol class="ol" id="topic_8_3__ol_ebx_xng_dk">
  41. <li class="li">Click <a name="topic_8_3__d104e102"><!-- --></a><img class="image" id="topic_8_3__d104e102" src="/static/art/help/quick_start.png"/>. The Quick Start Wizard opens.</li>
  42. <li class="li">Click <strong class="ph b">Step 2:
  43. Examples</strong>.</li>
  44. <li class="li">Click <strong class="ph b">Job Designer</strong>.</li>
  45. </ol>
  46. </div>
  47. </div>
  48. <div class="topic concept nested1" xml:lang="en-US" lang="en-US" id="topic_8_4"><a name="topic_8_4"><!-- --></a>
  49. <h2 class="title topictitle2">Job Designs </h2>
  50. <div class="body conbody">
  51. <p class="p">A job design specifies several meta-level properties of a job, including
  52. the job design name, description, the executable scripts or classes, and any
  53. parameters for those scripts or classes. </p>
  54. </div>
  55. <div class="topic concept nested2" xml:lang="en-US" lang="en-US" id="topic_8_4_1"><a name="topic_8_4_1"><!-- --></a>
  56. <h3 class="title topictitle3">Filtering Job Designs </h3>
  57. <div class="body conbody">
  58. <p class="p">You can filter the job designs that appear in the list by owner, name, type, and
  59. description.  </p>
  60. <p class="p">
  61. <strong class="ph b">To filter the Job Designs list:</strong>
  62. </p>
  63. <ol class="ol">
  64. <li class="li">In the <strong class="ph b">Job Designs</strong> window, click <strong class="ph b">Designs</strong>.</li>
  65. <li class="li" id="topic_8_4_1__li_81"><a name="topic_8_4_1__li_81"><!-- --></a>Enter text in the Filter text box at the top of the <strong class="ph b">Job
  66. Designs</strong> window. When you type in the Filter field, the designs are
  67. dynamically filtered to display only those rows containing text that matches
  68. the specified substring.</li>
  69. </ol>
  70. </div>
  71. </div>
  72. <div class="topic concept nested2" id="concept_jkv_qf3_zj"><a name="concept_jkv_qf3_zj"><!-- --></a>
  73. <h3 class="title topictitle3">Creating a Job Design</h3>
  74. <div class="body conbody">
  75. <a name="concept_jkv_qf3_zj__ol_xmj_5f3_zj"><!-- --></a><ol class="ol" id="concept_jkv_qf3_zj__ol_xmj_5f3_zj">
  76. <li class="li">In the <strong class="ph b">Job Designs</strong>
  77. window, click <span class="ph menucascade"><span class="ph uicontrol">New Action</span> &gt; <span class="ph uicontrol"><var class="keyword varname">Action</var></span></span>, where <var class="keyword varname">Action</var> is MapReduce, Streaming,
  78. Java, Pig, Hive, Sqoop, Shell, Ssh, DistCp, Fs, or Email.</li>
  79. <li class="li">In the <strong class="ph b">Job Design
  80. (<var class="keyword varname">Action</var> type)</strong> window, specify the common and
  81. job type specific information. </li>
  82. <li class="li">Click <strong class="ph b">Save</strong> to save the
  83. job settings.</li>
  84. </ol>
  85. </div>
  86. </div>
  87. <div class="topic concept nested2" id="concept_rfg_wfr_2k"><a name="concept_rfg_wfr_2k"><!-- --></a>
  88. <h3 class="title topictitle3">Deleting and Restoring Job Designs</h3>
  89. <div class="body conbody">
  90. <p class="p">You can move job designs to the trash and later restore or permanently delete
  91. them.</p>
  92. <div class="section" id="concept_rfg_wfr_2k__section_xny_zfr_2k"><a name="concept_rfg_wfr_2k__section_xny_zfr_2k"><!-- --></a><h4 class="title sectiontitle">Deleting Job Designs</h4>
  93. <a name="concept_rfg_wfr_2k__ol_rk2_fgr_2k"><!-- --></a><ol class="ol" id="concept_rfg_wfr_2k__ol_rk2_fgr_2k">
  94. <li class="li">In a Manager screen, check the checkbox next to one or more job
  95. designs.</li>
  96. <li class="li">Choose one of the following:<ul class="ul">
  97. <li class="li"><span class="ph menucascade"><span class="ph uicontrol">Delete</span> &gt; <span class="ph uicontrol">Move to trash</span></span></li>
  98. <li class="li"><span class="ph menucascade"><span class="ph uicontrol">Delete</span> &gt; <span class="ph uicontrol">Delete forever</span></span></li>
  99. </ul>
  100. </li>
  101. </ol>
  102. </div>
  103. <div class="section" id="concept_rfg_wfr_2k__section_i5h_1gr_2k"><a name="concept_rfg_wfr_2k__section_i5h_1gr_2k"><!-- --></a><h4 class="title sectiontitle">Restoring Job Designs</h4>
  104. <a name="concept_rfg_wfr_2k__ol_rrt_kgr_2k"><!-- --></a><ol class="ol" id="concept_rfg_wfr_2k__ol_rrt_kgr_2k">
  105. <li class="li">In a Manager screen, click <a name="concept_rfg_wfr_2k__d238e349"><!-- --></a><img class="image" id="concept_rfg_wfr_2k__d238e349" src="/static/art/help/trash.png"/>
  106. <strong class="ph b">Trash</strong>.</li>
  107. <li class="li">Check the checkbox next to one or more job designs.</li>
  108. <li class="li">Click <span class="ph uicontrol">Restore</span>.</li>
  109. </ol>
  110. </div>
  111. </div>
  112. </div>
  113. <div class="topic concept nested2" id="concept_gt5_bh3_zj"><a name="concept_gt5_bh3_zj"><!-- --></a>
  114. <h3 class="title topictitle3">Job Design Settings</h3>
  115. <div class="body conbody">
  116. <div class="section" id="concept_gt5_bh3_zj__section_zt2_w33_zj"><a name="concept_gt5_bh3_zj__section_zt2_w33_zj"><!-- --></a><h4 class="title sectiontitle">Job Design Common
  117. Settings </h4>
  118. <p class="p">Most job design types support all the settings listed in the following
  119. table.  For job type specific settings, see: <a class="xref" href="#concept_gt5_bh3_zj__section_lvq_ch3_zj">MapReduce</a>, <a class="xref" href="#concept_gt5_bh3_zj__section_zrd_gh3_zj">Streaming</a>, <a class="xref" href="#concept_gt5_bh3_zj__section_abl_hh3_zj">Java</a>, <a class="xref" href="#concept_gt5_bh3_zj__section_tvm_3h3_zj">Pig</a>, <a class="xref" href="#concept_gt5_bh3_zj__section_lxq_3h3_zj">Hive</a>, <a class="xref" href="#concept_gt5_bh3_zj__section_xb5_3h3_zj">Sqoop</a>, <a class="xref" href="#concept_gt5_bh3_zj__section_xvw_3h3_zj">Shell</a>, <a class="xref" href="#concept_gt5_bh3_zj__section_tnz_3h3_zj">Ssh</a>, <a class="xref" href="#concept_gt5_bh3_zj__section_qsc_jh3_zj">DistCp</a>, <a class="xref" href="#concept_gt5_bh3_zj__section_hx4_lh3_zj">Fs</a>, and <a class="xref" href="#concept_gt5_bh3_zj__section_qjt_lh3_zj">Email</a>. </p>
  120. <p class="p">All job design settings except Name and Description
  121. support the use of variables of the form <samp class="ph codeph">$</samp><var class="keyword varname">variable_name</var>. When you run the job, a
  122. dialog box will appear to enable you to specify the values of the variables. </p>
  123. <div class="tablenoborder"><a name="concept_gt5_bh3_zj__table_skf_x33_zj"><!-- --></a><table cellpadding="4" cellspacing="0" summary="" id="concept_gt5_bh3_zj__table_skf_x33_zj" class="table" frame="hsides" border="1" rules="all">
  124. <tbody class="tbody">
  125. <tr class="row">
  126. <td class="entry" valign="top" width="25%">
  127. <p class="p">
  128. <strong class="ph b">Name</strong>
  129. </p>
  130. </td>
  131. <td class="entry" valign="top" width="75%">
  132. <p class="p">Identifies the job and its collection
  133. of properties and parameters. </p>
  134. </td>
  135. </tr>
  136. <tr class="row">
  137. <td class="entry" valign="top" width="25%">
  138. <p class="p">
  139. <strong class="ph b">Description</strong>
  140. </p>
  141. </td>
  142. <td class="entry" valign="top" width="75%">
  143. <p class="p">A description of the job. The
  144. description is displayed in the dialog box that appears
  145. if you specify variables for the job. </p>
  146. </td>
  147. </tr>
  148. <tr class="row">
  149. <td class="entry" valign="top" width="25%">
  150. <p class="p">
  151. <strong class="ph b">Advanced</strong>
  152. </p>
  153. </td>
  154. <td class="entry" valign="top" width="75%">
  155. <a name="concept_gt5_bh3_zj__ul_pyd_nf3_zj"><!-- --></a><ul class="ul" id="concept_gt5_bh3_zj__ul_pyd_nf3_zj">
  156. <li class="li"><strong class="ph b">Is shared</strong> -
  157. Indicate whether to share the action with all
  158. users.</li>
  159. <li class="li"><strong class="ph b">Oozie parameters</strong> - </li>
  160. </ul>
  161. </td>
  162. </tr>
  163. <tr class="row">
  164. <td class="entry" valign="top" width="25%">
  165. <p class="p">
  166. <strong class="ph b">Prepare</strong>
  167. </p>
  168. </td>
  169. <td class="entry" valign="top" width="75%">Specifies paths to create or delete before starting the
  170. workflow job. </td>
  171. </tr>
  172. <tr class="row">
  173. <td class="entry" valign="top" width="25%">
  174. <p class="p">
  175. <strong class="ph b">Params</strong>
  176. </p>
  177. </td>
  178. <td class="entry" valign="top" width="75%">Parameters to pass to a script or command. The parameters
  179. are expressed using the  <a class="xref" href="http://jcp.org/aboutJava/communityprocess/final/jsr152/" target="_blank">JSP
  180. 2.0 Specification (JSP.2.3) Expression Language</a>,
  181. allowing variables, functions, and complex expressions as
  182. parameters. </td>
  183. </tr>
  184. <tr class="row">
  185. <td class="entry" valign="top" width="25%">
  186. <p class="p">
  187. <strong class="ph b">Job Properties</strong>
  188. </p>
  189. </td>
  190. <td class="entry" valign="top" width="75%">
  191. <p class="p">Job properties. To set a property
  192. value, click <strong class="ph b">Add
  193. Property</strong>.   </p>
  194. <a name="concept_gt5_bh3_zj__ul_jlf_x33_zj"><!-- --></a><ul class="ul" id="concept_gt5_bh3_zj__ul_jlf_x33_zj">
  195. <li class="li"><strong class="ph b">Property name -</strong> a configuration
  196. property name. This field provides autocompletion,
  197. so you can type the first few characters of a
  198. property name and then select the one you want from
  199. the drop-down list. </li>
  200. <li class="li"><strong class="ph b">Value -</strong> the property value.</li>
  201. </ul>
  202. </td>
  203. </tr>
  204. <tr class="row">
  205. <td class="entry" valign="top" width="25%">
  206. <p class="p">
  207. <strong class="ph b">Files</strong>
  208. </p>
  209. </td>
  210. <td class="entry" valign="top" width="75%">
  211. <p class="p">Files to pass to the job. Equivalent
  212. to the Hadoop <samp class="ph codeph">-files</samp> option.  </p>
  213. </td>
  214. </tr>
  215. <tr class="row">
  216. <td class="entry" valign="top" width="25%">
  217. <p class="p">
  218. <strong class="ph b">Archives</strong>
  219. </p>
  220. </td>
  221. <td class="entry" valign="top" width="75%">
  222. <p class="p">Archives to pass to the job.
  223. Equivalent to the Hadoop <samp class="ph codeph">-archives</samp>
  224. option. </p>
  225. </td>
  226. </tr>
  227. </tbody>
  228. </table>
  229. </div>
  230. </div>
  231. <div class="section" id="concept_gt5_bh3_zj__section_lvq_ch3_zj"><a name="concept_gt5_bh3_zj__section_lvq_ch3_zj"><!-- --></a><h4 class="title sectiontitle">MapReduce Job Design </h4>
  232. <div class="p">A MapReduce job design consists of MapReduce functions
  233. written in Java. You can create a MapReduce job design from existing mapper
  234. and reducer classes without having to write a main Java class. You must
  235. specify the mapper and reducer classes as well as other MapReduce properties
  236. in the Job Properties setting.
  237. <div class="tablenoborder"><a name="concept_gt5_bh3_zj__table_zcz_5g3_zj"><!-- --></a><table cellpadding="4" cellspacing="0" summary="" id="concept_gt5_bh3_zj__table_zcz_5g3_zj" class="table" frame="hsides" border="1" rules="all">
  238. <tbody class="tbody">
  239. <tr class="row">
  240. <td class="entry" valign="top" width="25%">
  241. <p class="p"><strong class="ph b">Jar
  242. path</strong>
  243. </p>
  244. </td>
  245. <td class="entry" valign="top" width="75%">
  246. <p class="p">The fully-qualified path to a JAR
  247. file containing the classes that implement the
  248. Mapper and Reducer functions. </p>
  249. </td>
  250. </tr>
  251. </tbody>
  252. </table>
  253. </div>
  254. </div>
  255. </div>
  256. <div class="section" id="concept_gt5_bh3_zj__section_zrd_gh3_zj"><a name="concept_gt5_bh3_zj__section_zrd_gh3_zj"><!-- --></a><h4 class="title sectiontitle">Streaming Job Design </h4>
  257. <p class="p">Hadoop streaming jobs enable you to create MapReduce
  258. functions in any non-Java language that reads standard Unix input and writes
  259. standard Unix output. For more information about Hadoop streaming jobs, see
  260. <a class="xref" href="http://archive.cloudera.com/cdh/3/hadoop-0.20.2+320/streaming.html" target="_blank">Hadoop Streaming</a>. </p>
  261. <div class="tablenoborder"><a name="concept_gt5_bh3_zj__table_jnj_vg3_zj"><!-- --></a><table cellpadding="4" cellspacing="0" summary="" id="concept_gt5_bh3_zj__table_jnj_vg3_zj" class="table" frame="hsides" border="1" rules="all">
  262. <tbody class="tbody">
  263. <tr class="row">
  264. <td class="entry" valign="top" width="25%">
  265. <p class="p"><strong class="ph b">Mapper</strong>
  266. </p>
  267. </td>
  268. <td class="entry" valign="top" width="75%">
  269. <p class="p">The path to the mapper script or
  270. class. If the mapper file is not on the machines on the
  271. cluster, use the <strong class="ph b">Files</strong>
  272. option to pass it as a part of job submission.
  273. Equivalent to the Hadoop <samp class="ph codeph">-mapper</samp>
  274. option. </p>
  275. </td>
  276. </tr>
  277. <tr class="row">
  278. <td class="entry" valign="top" width="25%">
  279. <p class="p"><strong class="ph b">Reducer</strong>
  280. </p>
  281. </td>
  282. <td class="entry" valign="top" width="75%">
  283. <p class="p">The path to the reducer script or
  284. class. If the reducer file is not on the machines on the
  285. cluster, use the <strong class="ph b">Files</strong>
  286. option to pass it as a part of job submission.
  287. Equivalent to the Hadoop <samp class="ph codeph">-reducer</samp>
  288. option. </p>
  289. </td>
  290. </tr>
  291. </tbody>
  292. </table>
  293. </div>
  294. </div>
  295. <div class="section" id="concept_gt5_bh3_zj__section_abl_hh3_zj"><a name="concept_gt5_bh3_zj__section_abl_hh3_zj"><!-- --></a><h4 class="title sectiontitle">Java Job Design </h4>
  296. <p class="p">A Java job design consists of a main class written in
  297. Java. </p>
  298. <div class="tablenoborder"><a name="concept_gt5_bh3_zj__table_odm_wg3_zj"><!-- --></a><table cellpadding="4" cellspacing="0" summary="" id="concept_gt5_bh3_zj__table_odm_wg3_zj" class="table" frame="hsides" border="1" rules="all">
  299. <tbody class="tbody">
  300. <tr class="row">
  301. <td class="entry" valign="top" width="25%">
  302. <p class="p"><strong class="ph b">Jar
  303. path</strong>
  304. </p>
  305. </td>
  306. <td class="entry" valign="top" width="75%">
  307. <p class="p">The fully-qualified path to a JAR
  308. file containing the main class. </p>
  309. </td>
  310. </tr>
  311. <tr class="row">
  312. <td class="entry" valign="top" width="25%">
  313. <p class="p"><strong class="ph b">Main
  314. class</strong>
  315. </p>
  316. </td>
  317. <td class="entry" valign="top" width="75%">
  318. <p class="p">The main class to invoke the program.
  319. </p>
  320. </td>
  321. </tr>
  322. <tr class="row">
  323. <td class="entry" valign="top" width="25%">
  324. <p class="p"><strong class="ph b">Args</strong>
  325. </p>
  326. </td>
  327. <td class="entry" valign="top" width="75%">
  328. <p class="p">The arguments to pass to the main
  329. class. </p>
  330. </td>
  331. </tr>
  332. <tr class="row">
  333. <td class="entry" valign="top" width="25%">
  334. <p class="p"><strong class="ph b">Java
  335. opts</strong>
  336. </p>
  337. </td>
  338. <td class="entry" valign="top" width="75%">
  339. <p class="p">The options to pass to the JVM. </p>
  340. </td>
  341. </tr>
  342. </tbody>
  343. </table>
  344. </div>
  345. </div>
  346. <div class="section" id="concept_gt5_bh3_zj__section_tvm_3h3_zj"><a name="concept_gt5_bh3_zj__section_tvm_3h3_zj"><!-- --></a><h4 class="title sectiontitle">Pig Job Design</h4>
  347. <p class="p">A Pig job design consists of a Pig script. </p>
  348. <div class="tablenoborder"><a name="concept_gt5_bh3_zj__table_tck_4h3_zj"><!-- --></a><table cellpadding="4" cellspacing="0" summary="" id="concept_gt5_bh3_zj__table_tck_4h3_zj" class="table" frame="hsides" border="1" rules="all">
  349. <tbody class="tbody">
  350. <tr class="row">
  351. <td class="entry" valign="top" width="50%">
  352. <p class="p"><strong class="ph b">Script
  353. name</strong>
  354. </p>
  355. </td>
  356. <td class="entry" valign="top" width="50%">
  357. <p class="p">Script name or path to the Pig script.</p>
  358. </td>
  359. </tr>
  360. </tbody>
  361. </table>
  362. </div>
  363. </div>
  364. <div class="section" id="concept_gt5_bh3_zj__section_lxq_3h3_zj"><a name="concept_gt5_bh3_zj__section_lxq_3h3_zj"><!-- --></a><h4 class="title sectiontitle">Hive Job Design </h4>
  365. <p class="p">A Hive job design consists of a Hive script. </p>
  366. <div class="tablenoborder"><a name="concept_gt5_bh3_zj__table_mzv_ph3_zj"><!-- --></a><table cellpadding="4" cellspacing="0" summary="" id="concept_gt5_bh3_zj__table_mzv_ph3_zj" class="table" frame="hsides" border="1" rules="all">
  367. <tbody class="tbody">
  368. <tr class="row">
  369. <td class="entry" valign="top" width="50%">
  370. <p class="p"><strong class="ph b">Script
  371. name</strong>
  372. </p>
  373. </td>
  374. <td class="entry" valign="top" width="50%">
  375. <p class="p">Script name or path to the Hive script. </p>
  376. </td>
  377. </tr>
  378. </tbody>
  379. </table>
  380. </div>
  381. </div>
  382. <div class="section" id="concept_gt5_bh3_zj__section_xb5_3h3_zj"><a name="concept_gt5_bh3_zj__section_xb5_3h3_zj"><!-- --></a><h4 class="title sectiontitle">Sqoop Job Design </h4>
  383. <p class="p">A Sqoop job design consists of a Sqoop command. </p>
  384. <div class="tablenoborder"><a name="concept_gt5_bh3_zj__table_enb_qh3_zj"><!-- --></a><table cellpadding="4" cellspacing="0" summary="" id="concept_gt5_bh3_zj__table_enb_qh3_zj" class="table" frame="hsides" border="1" rules="all">
  385. <tbody class="tbody">
  386. <tr class="row">
  387. <td class="entry" valign="top" width="50%">
  388. <p class="p"><strong class="ph b">Command</strong>
  389. </p>
  390. </td>
  391. <td class="entry" valign="top" width="50%">
  392. <p class="p">The Sqoop command.</p>
  393. </td>
  394. </tr>
  395. </tbody>
  396. </table>
  397. </div>
  398. </div>
  399. <div class="section" id="concept_gt5_bh3_zj__section_xvw_3h3_zj"><a name="concept_gt5_bh3_zj__section_xvw_3h3_zj"><!-- --></a><h4 class="title sectiontitle">Shell Job Design </h4>
  400. <p class="p">A Shell job design consists of a shell command. </p>
  401. <div class="tablenoborder"><a name="concept_gt5_bh3_zj__table_mn2_qh3_zj"><!-- --></a><table cellpadding="4" cellspacing="0" summary="" id="concept_gt5_bh3_zj__table_mn2_qh3_zj" class="table" frame="hsides" border="1" rules="all">
  402. <tbody class="tbody">
  403. <tr class="row">
  404. <td class="entry" valign="top" width="50%">
  405. <p class="p"><strong class="ph b">Command</strong>
  406. </p>
  407. </td>
  408. <td class="entry" valign="top" width="50%">
  409. <p class="p">The shell command.</p>
  410. </td>
  411. </tr>
  412. <tr class="row">
  413. <td class="entry" valign="top" width="50%">
  414. <p class="p"><strong class="ph b">Capture
  415. output</strong>
  416. </p>
  417. </td>
  418. <td class="entry" valign="top" width="50%">
  419. <p class="p">Indicate whether to capture the output
  420. of the command.</p>
  421. </td>
  422. </tr>
  423. </tbody>
  424. </table>
  425. </div>
  426. </div>
  427. <div class="section" id="concept_gt5_bh3_zj__section_tnz_3h3_zj"><a name="concept_gt5_bh3_zj__section_tnz_3h3_zj"><!-- --></a><h4 class="title sectiontitle">Ssh Job Design </h4>
  428. <p class="p">A Ssh job design consists of an ssh command. </p>
  429. <div class="tablenoborder"><a name="concept_gt5_bh3_zj__table_ysk_qh3_zj"><!-- --></a><table cellpadding="4" cellspacing="0" summary="" id="concept_gt5_bh3_zj__table_ysk_qh3_zj" class="table" frame="hsides" border="1" rules="all">
  430. <tbody class="tbody">
  431. <tr class="row">
  432. <td class="entry" valign="top" width="50%">
  433. <p class="p"><strong class="ph b">User</strong>
  434. </p>
  435. </td>
  436. <td class="entry" valign="top" width="50%">
  437. <p class="p">The name of the user to run the command as. </p>
  438. </td>
  439. </tr>
  440. <tr class="row">
  441. <td class="entry" valign="top" width="50%">
  442. <p class="p"><strong class="ph b">Host</strong>
  443. </p>
  444. </td>
  445. <td class="entry" valign="top" width="50%">
  446. <p class="p">The name of the host to run the command on.</p>
  447. </td>
  448. </tr>
  449. <tr class="row">
  450. <td class="entry" valign="top" width="50%">
  451. <p class="p"><strong class="ph b">Command</strong>
  452. </p>
  453. </td>
  454. <td class="entry" valign="top" width="50%">
  455. <p class="p">The ssh command.</p>
  456. </td>
  457. </tr>
  458. <tr class="row">
  459. <td class="entry" valign="top" width="50%">
  460. <p class="p"><strong class="ph b">Capture
  461. output</strong>
  462. </p>
  463. </td>
  464. <td class="entry" valign="top" width="50%">
  465. <p class="p">Indicate whether to capture the output of the command.</p>
  466. </td>
  467. </tr>
  468. </tbody>
  469. </table>
  470. </div>
  471. </div>
  472. <div class="section" id="concept_gt5_bh3_zj__section_qsc_jh3_zj"><a name="concept_gt5_bh3_zj__section_qsc_jh3_zj"><!-- --></a><h4 class="title sectiontitle">DistCp Job Design </h4>
  473. <p class="p">A DistCp job design consists of a . </p>
  474. </div>
  475. <div class="section" id="concept_gt5_bh3_zj__section_hx4_lh3_zj"><a name="concept_gt5_bh3_zj__section_hx4_lh3_zj"><!-- --></a><h4 class="title sectiontitle">Fs Job Design</h4>
  476. <p class="p">A Fs job design consists of a command that operates on HDFS. </p>
  477. <div class="tablenoborder"><a name="concept_gt5_bh3_zj__table_szs_qh3_zj"><!-- --></a><table cellpadding="4" cellspacing="0" summary="" id="concept_gt5_bh3_zj__table_szs_qh3_zj" class="table" frame="hsides" border="1" rules="all">
  478. <tbody class="tbody">
  479. <tr class="row">
  480. <td class="entry" valign="top" width="33.33333333333333%">
  481. <p class="p"><strong class="ph b">Delete
  482. path</strong>
  483. </p>
  484. </td>
  485. <td class="entry" valign="top" width="66.66666666666666%">
  486. <p class="p">The path to delete. If it is a directory, it deletes recursively
  487. all its content and then deletes the directory. </p>
  488. </td>
  489. </tr>
  490. <tr class="row">
  491. <td class="entry" valign="top" width="33.33333333333333%">
  492. <p class="p"><strong class="ph b">Create
  493. directory</strong>
  494. </p>
  495. </td>
  496. <td class="entry" valign="top" width="66.66666666666666%">
  497. <p class="p">The path of a directory to create. </p>
  498. </td>
  499. </tr>
  500. <tr class="row">
  501. <td class="entry" valign="top" width="33.33333333333333%">
  502. <p class="p"><strong class="ph b">Move
  503. file</strong>
  504. </p>
  505. </td>
  506. <td class="entry" valign="top" width="66.66666666666666%">
  507. <p class="p">The source and destination paths to the file to be moved.</p>
  508. </td>
  509. </tr>
  510. <tr class="row">
  511. <td class="entry" valign="top" width="33.33333333333333%">
  512. <p class="p"><strong class="ph b">Change
  513. permissions</strong>
  514. </p>
  515. </td>
  516. <td class="entry" valign="top" width="66.66666666666666%">
  517. <p class="p">The path whose permissions are to be changed, the permissions, and
  518. an indicator of whether to change permission
  519. recursively.</p>
  520. </td>
  521. </tr>
  522. </tbody>
  523. </table>
  524. </div>
  525. </div>
  526. <div class="section" id="concept_gt5_bh3_zj__section_qjt_lh3_zj"><a name="concept_gt5_bh3_zj__section_qjt_lh3_zj"><!-- --></a><h4 class="title sectiontitle">Email Job Design </h4>
  527. <p class="p">A Email job design consists of an email message. </p>
  528. <div class="tablenoborder"><a name="concept_gt5_bh3_zj__table_yyw_qh3_zj"><!-- --></a><table cellpadding="4" cellspacing="0" summary="" id="concept_gt5_bh3_zj__table_yyw_qh3_zj" class="table" frame="hsides" border="1" rules="all">
  529. <tbody class="tbody">
  530. <tr class="row">
  531. <td class="entry" valign="top" width="50%">
  532. <p class="p"><strong class="ph b">To
  533. addresses</strong>
  534. </p>
  535. </td>
  536. <td class="entry" valign="top" width="50%">
  537. <p class="p">The recipient of the email message.
  538. </p>
  539. </td>
  540. </tr>
  541. <tr class="row">
  542. <td class="entry" valign="top" width="50%">
  543. <p class="p"><strong class="ph b">CC addresses (optional)</strong>
  544. </p>
  545. </td>
  546. <td class="entry" valign="top" width="50%">
  547. <p class="p">The cc recipients of the email
  548. message. </p>
  549. </td>
  550. </tr>
  551. <tr class="row">
  552. <td class="entry" valign="top" width="50%">
  553. <p class="p"><strong class="ph b">Subject</strong>
  554. </p>
  555. </td>
  556. <td class="entry" valign="top" width="50%">
  557. <p class="p">The subject of the email message.</p>
  558. </td>
  559. </tr>
  560. <tr class="row">
  561. <td class="entry" valign="top" width="50%">
  562. <p class="p"><strong class="ph b">Body</strong>
  563. </p>
  564. </td>
  565. <td class="entry" valign="top" width="50%">
  566. <p class="p">The body of the email message.</p>
  567. </td>
  568. </tr>
  569. </tbody>
  570. </table>
  571. </div>
  572. </div>
  573. </div>
  574. </div>
  575. <div class="topic concept nested2" xml:lang="en-US" lang="en-US" id="topic_8_4_6"><a name="topic_8_4_6"><!-- --></a>
  576. <h3 class="title topictitle3">Submitting a Job Design </h3>
  577. <div class="body conbody">
  578. <div class="note note"><span class="notetitle"><img src="/static/art/help/note.jpg"/> 
  579. <b>Note</b>:</span>
  580. <p class="p">A job's input files must be uploaded to the cluster before you can submit the
  581. job.</p>
  582. </div>
  583. <p class="p">
  584. <strong class="ph b">To submit a job design:</strong>
  585. </p>
  586. <ol class="ol">
  587. <li class="li">In the <strong class="ph b">Job Designs</strong> window, click <strong class="ph b">Designs</strong> in the upper left
  588. corner. Your jobs and other users' jobs are displayed in the <strong class="ph b">Job
  589. Designs</strong> window.</li>
  590. <li class="li">Check the checkbox next to the job you want to submit.</li>
  591. <li class="li">Click the <strong class="ph b">Submit</strong> button. <a name="topic_8_4_6__ol_apj_lnt_4j"><!-- --></a><ol class="ol" type="a" id="topic_8_4_6__ol_apj_lnt_4j"> <li class="li">If the job
  592. contains variables, enter the information requested in the dialog
  593. box that appears. For example, the sample grep MapReduce design
  594. displays a dialog where you specify the output directory.</li>
  595. <li class="li">Click <strong class="ph b">Submit</strong> to submit the job.</li>
  596. </ol>
  597. </li>
  598. </ol>
  599. <p class="p" id="topic_8_4_6__p_87"><a name="topic_8_4_6__p_87"><!-- --></a> After the job is complete, the Job Designer displays the results of
  600. the job. For information about displaying job results, see <a class="xref" href="#topic_8_5">Displaying the Results of Submitting a
  601. Job</a>. </p>
  602. </div>
  603. </div>
  604. <div class="topic concept nested2" xml:lang="en-US" lang="en-US" id="topic_8_4_7"><a name="topic_8_4_7"><!-- --></a>
  605. <h3 class="title topictitle3">Copying, Editing, and Deleting a Job Design </h3>
  606. <div class="body conbody">
  607. <p class="p">If you want to edit and use a job but you don't own it, you can make a copy of
  608. it and then edit and use the copied job. </p>
  609. <div class="tablenoborder"><a name="topic_8_4_7__table_rxy_gdh_b3"><!-- --></a><table cellpadding="4" cellspacing="0" summary="" id="topic_8_4_7__table_rxy_gdh_b3" class="table" frame="hsides" border="1" rules="all">
  610. <thead class="thead" align="left">
  611. <tr class="row">
  612. <th class="entry" valign="top" width="20%" id="d11788e1268">Action</th>
  613. <th class="entry" valign="top" width="80%" id="d11788e1271">Procedure</th>
  614. </tr>
  615. </thead>
  616. <tbody class="tbody">
  617. <tr class="row">
  618. <td class="entry" valign="top" width="20%" headers="d11788e1268 ">
  619. <p class="p">
  620. <strong class="ph b">Copy</strong>
  621. </p>
  622. </td>
  623. <td class="entry" valign="top" width="80%" headers="d11788e1271 ">
  624. <div class="p">
  625. <a name="topic_8_4_7__ol_vtf_hch_dk"><!-- --></a><ol class="ol" id="topic_8_4_7__ol_vtf_hch_dk">
  626. <li class="li">In the <strong class="ph b">Job Designs</strong> window,
  627. click <strong class="ph b">Designs</strong>. The
  628. jobs are displayed in the <strong class="ph b">Job Designs</strong>
  629. window.</li>
  630. <li class="li">Check the checkbox next to the
  631. job you want to copy.</li>
  632. <li class="li">Click the <strong class="ph b">Copy</strong> button.</li>
  633. <li class="li">In the <strong class="ph b">Job Design Editor</strong>
  634. window, change the settings and then click <strong class="ph b">Save</strong> to save the
  635. job settings.</li>
  636. </ol>
  637. </div>
  638. </td>
  639. </tr>
  640. <tr class="row">
  641. <td class="entry" valign="top" width="20%" headers="d11788e1268 ">
  642. <p class="p">
  643. <strong class="ph b">Edit</strong>
  644. </p>
  645. </td>
  646. <td class="entry" valign="top" width="80%" headers="d11788e1271 ">
  647. <div class="p">
  648. <a name="topic_8_4_7__ol_xxr_hch_dk"><!-- --></a><ol class="ol" id="topic_8_4_7__ol_xxr_hch_dk">
  649. <li class="li">In the <strong class="ph b">Job Designs</strong> window,
  650. click <strong class="ph b">Designs</strong>. The
  651. jobs are displayed in the <strong class="ph b">Job Designs</strong>
  652. window.</li>
  653. <li class="li">Check the checkbox next to the
  654. job you want to edit.</li>
  655. <li class="li">Click the <strong class="ph b">Edit</strong> button.</li>
  656. <li class="li">In the <strong class="ph b">Job Design</strong> window,
  657. change the settings and then click <strong class="ph b">Save</strong> to save the
  658. job settings.</li>
  659. </ol>
  660. </div>
  661. </td>
  662. </tr>
  663. <tr class="row">
  664. <td class="entry" valign="top" width="20%" headers="d11788e1268 ">Delete</td>
  665. <td class="entry" valign="top" width="80%" headers="d11788e1271 ">
  666. <div class="p">
  667. <a name="topic_8_4_7__ol_hjf_3ch_dk"><!-- --></a><ol class="ol" id="topic_8_4_7__ol_hjf_3ch_dk">
  668. <li class="li">In the <strong class="ph b">Job Designs</strong> window,
  669. click <strong class="ph b">Designs</strong>. The
  670. jobs are displayed in the <strong class="ph b">Job Designs</strong>
  671. window.</li>
  672. <li class="li">Check the checkbox next to the
  673. job you want to delete.</li>
  674. <li class="li">Click the <strong class="ph b">Delete</strong> button.</li>
  675. <li class="li" id="topic_8_4_7__li_88"><a name="topic_8_4_7__li_88"><!-- --></a>Click <strong class="ph b">OK</strong> to confirm the
  676. deletion.</li>
  677. </ol>
  678. </div>
  679. </td>
  680. </tr>
  681. </tbody>
  682. </table>
  683. </div>
  684. </div>
  685. </div>
  686. </div>
  687. <div class="topic concept nested1" xml:lang="en-US" lang="en-US" id="topic_8_5"><a name="topic_8_5"><!-- --></a>
  688. <h2 class="title topictitle2">Displaying Results of Submitting a Job </h2>
  689. <div class="body conbody">
  690. <p class="p">
  691. <strong class="ph b">To display the Job Submission History:</strong>
  692. </p>
  693. <p class="p">In the <strong class="ph b">Job Designs</strong> window, click the <strong class="ph b">History</strong> tab. The jobs are
  694. displayed in the <strong class="ph b">Job Submissions History</strong> listed by Oozie job ID. </p>
  695. <p class="p">
  696. <strong class="ph b">To display Job Details:</strong>
  697. </p>
  698. <p class="p">In the <strong class="ph b">Job Submission History</strong> window, click an Oozie Job ID. The results of
  699. the job display: </p>
  700. <ul class="ul">
  701. <li class="li">Actions - a list of actions in the job.</li>
  702. <li class="li">Click <img class="image" src="/static/art/help/gear.png"/> to display the action configuration. In the action configuration for a
  703. MapReduce action, click the value of the <samp class="ph codeph">mapred.output.dir</samp> property to display
  704. the job output.</li>
  705. <li class="li">In the root-node row, click the Id in the External Id column to view the job in
  706. the Job Browser.</li>
  707. <li class="li">Details - the job details. Click <img class="image" src="/static/art/help/gear.png"/> to display the Oozie application configuration.</li>
  708. <li class="li">Definition - the Oozie application definition.</li>
  709. <li class="li">Log - the output log.</li>
  710. </ul>
  711. </div>
  712. </div>
  713. </body>
  714. </html>