index.html 8.0 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150
  1. <h1><a name="JobBrowser-IntroducingJobBrowser"></a>Introducing Job Browser</h1>
  2. <p>The Job Browser application lets you to examine the Hadoop MapReduce jobs running on your Hadoop cluster. Job Browser presents the job and tasks in layers. The top layer is a list of jobs, and you can link to a list of that job's tasks. You can then view a task's attempts and the properties of each attempt, such as state, start and end time, and output size. To troubleshoot failed jobs, you can also view the logs of each attempt.</p>
  3. <h2><a name="JobBrowser-Contents"></a>Contents</h2>
  4. <style type='text/css'>/*<![CDATA[*/
  5. div.rbtoc1359395622915 {margin-left: 1.5em;padding: 0px;}
  6. div.rbtoc1359395622915 ul {margin-left: 0px;padding-left: 20px;}
  7. div.rbtoc1359395622915 li {margin-left: 0px;padding-left: 0px;}
  8. /*]]>*/</style><div class='rbtoc1359395622915'>
  9. <ul>
  10. <li><a href='#JobBrowser-IntroducingJobBrowser'>Introducing Job Browser</a></li>
  11. <li><a href='#JobBrowser-JobBrowserInstallationandConfiguration'>Job Browser Installation and Configuration</a></li>
  12. <li><a href='#JobBrowser-StartingJobBrowser'>Starting Job Browser</a></li>
  13. <li><a href='#JobBrowser-FilteringtheJobBrowserList'>Filtering the Job Browser List</a></li>
  14. <li><a href='#JobBrowser-ViewingJobInformationandLogs'>Viewing Job Information and Logs</a></li>
  15. <li><a href='#JobBrowser-ViewingJobOutput'>Viewing Job Output</a></li>
  16. </ul></div>
  17. <p><br class="atl-forced-newline" />
  18. <a name="JobBrowser-JobBrowserInstallationandConfiguration"></a></p>
  19. <h1><a name="JobBrowser-JobBrowserInstallationandConfiguration"></a>Job Browser Installation and Configuration</h1>
  20. <p>Job Browser is one of the applications that is installed as part of Hue. For information about installing and configuring Hue, see <a href="https://ccp.cloudera.com/display/CDHDOC/Hue+Installation">Hue Installation</a>.</p>
  21. <p>Job Browser can display both MRv1 and MRv2 jobs, but must be configured to display one type at a time in the <tt>[mapred_clusters]</tt> and <tt>[yarn_clusters]</tt> sections in the Hue configuration file.</p>
  22. <p>By default, a JobBrowser user can see submitted job information for all users &#8211; both his/her own jobs and those of other users. To restrict viewing of submitted jobs to the job submitter and Hue administrators, set the <tt>share_jobs</tt> property under the <tt>[jobbrowser]</tt> section in the Hue configuration file to <tt>false</tt>.
  23. <br class="atl-forced-newline" />
  24. <br class="atl-forced-newline" /></p>
  25. <p><a name="JobBrowser-StartingJobBrowser"></a></p>
  26. <h1><a name="JobBrowser-StartingJobBrowser"></a>Starting Job Browser</h1>
  27. <p>To start Job Browser, click the <b>Job Browser</b> icon (<span class="image-wrap" style=""><img src="/jobbrowser/static/help/images/23888158.png" height="26" style="border: 0px solid black"/></span>) in the navigation bar at the top of the Hue web page.</p>
  28. <p>If there are no jobs that have been run, the <b>Welcome to the Job Browser</b> page opens, with links to the Job Designer and Beeswax.</p>
  29. <p>If there are jobs running, then the Job Browser list appears.
  30. <br class="atl-forced-newline" />
  31. <br class="atl-forced-newline" /></p>
  32. <p><a name="JobBrowser-FilteringtheJobBrowserList"></a></p>
  33. <h1><a name="JobBrowser-FilteringtheJobBrowserList"></a>Filtering the Job Browser List</h1>
  34. <p><b>To filter the jobs displayed in the Job Browser list:</b></p>
  35. <ul>
  36. <li>To filter the jobs by their state (such as <b>Running</b> or <b>Completed</b>), choose a state from the <b>Job status</b> drop-down menu.</li>
  37. <li>To filter by a user who ran the jobs, enter the user's name in the <b>User Name</b> query box.</li>
  38. <li>To filter by job name, enter the name in the <b>Text</b> query box.</li>
  39. <li>To clear the filters, choose <b>All States</b> from the <b>Job status</b> drop-down menu and delete any text in the <b>User Name</b> and <b>Text</b> query boxes.</li>
  40. <li>To display retired jobs, check the <b>Show retired jobs</b> checkbox. Retired jobs show somewhat limited information &#8211; for example, information on maps and reduces and job duration is not available. Jobs are designated as&nbsp;Retired by the JobTracker based on the value of <tt>mapred.jobtracker.retirejob.interval</tt>. The retired jobs no longer display after the JobTracker is restarted.</li>
  41. </ul>
  42. <p><a name="JobBrowser-ViewingJobInformationandLogs"></a></p>
  43. <h1><a name="JobBrowser-ViewingJobInformationandLogs"></a>Viewing Job Information and Logs</h1>
  44. <div class='panelMacro'><table class='noteMacro'><colgroup><col width='24'><col></colgroup><tr><td valign='top'><img src="/static/art/help/warning.gif" width="16" height="16" align="absmiddle" alt="" border="0"></td><td>At any level you can view the log for an object by click the <span class="image-wrap" style=""><img src="/oozie/static/help/images/23888324.png" style="border: 0px solid black"/></span> icon in the Logs column.</td></tr></table></div>
  45. <p><b>To view job information for an individual job:</b></p>
  46. <ol>
  47. <li>In the <b>Job Browser</b> window, click <b>View</b> at the right of the job you want to view.<br/>
  48. This shows the <b>Job</b> page for the job, with the recent tasks associated with the job are displayed in the <b>Tasks</b> tab.
  49. <br class="atl-forced-newline" />
  50. <br class="atl-forced-newline" /></li>
  51. <li>Click the <b>Metadata</b> tab to view the metadata for this job.</li>
  52. <li>Click the <b>Counters</b> tab to view the counter metrics for the job.</li>
  53. </ol>
  54. <p><b>To view details about the tasks associated with the job:</b></p>
  55. <ol>
  56. <li>In the <b>Job</b> window, click the <b>View All Tasks</b> link at the right just above the <b>Recent Tasks</b> list.<br/>
  57. This lists all the tasks associated with the job.
  58. <br class="atl-forced-newline" />
  59. <br class="atl-forced-newline" /></li>
  60. <li>Click <b>Attempts</b> to the right of a task to view the attempts for that task.</li>
  61. </ol>
  62. <p><b>To view information about an individual task:</b></p>
  63. <ol>
  64. <li>in the <b>Job</b> window, click the <b>View</b> link to the right of the task.<br/>
  65. The attempts associated with the task are displayed.
  66. <br class="atl-forced-newline" />
  67. <br class="atl-forced-newline" /></li>
  68. <li>Click the <b>Metadata</b> tab to view metadata for this task.<br/>
  69. The metadata associated with the task is displayed.
  70. <br class="atl-forced-newline" />
  71. <br class="atl-forced-newline" /></li>
  72. <li>To view the Hadoop counters for a task, click the <b>Counters</b> tab.<br/>
  73. The counters associated with the task are displayed.
  74. <br class="atl-forced-newline" />
  75. <br class="atl-forced-newline" /></li>
  76. <li>To return to the <b>Job</b> window for this job, click the job number in the status panel at the left of the window.</li>
  77. </ol>
  78. <p><b>To view details about a task attempt:</b></p>
  79. <ol>
  80. <li>In the <b>Job Task</b> window, click the <b>View</b> link to the right of the task attempt.<br/>
  81. The metadata associated with the attempt is displayed under the <b>Metadata</b> tab.
  82. <br class="atl-forced-newline" />
  83. <br class="atl-forced-newline" /></li>
  84. <li>To view the Hadoop counters for the task attempt, click the <b>Counters</b> tab.<br/>
  85. The counters associated with the attempt are displayed.
  86. <br class="atl-forced-newline" />
  87. <br class="atl-forced-newline" /></li>
  88. <li>To view the logs associated with the task attempt, click the <b>Logs</b> tab.<br/>
  89. The logs associated with the task attempt are displayed.
  90. <br class="atl-forced-newline" />
  91. <br class="atl-forced-newline" /></li>
  92. <li>To return to the list of tasks for the current job, click the task number in the status panel at the left of the window.</li>
  93. </ol>
  94. <p><a name="JobBrowser-ViewingJobOutput"></a></p>
  95. <h1><a name="JobBrowser-ViewingJobOutput"></a>Viewing Job Output</h1>
  96. <p><b>To view job output:</b></p>
  97. <ol>
  98. <li>In the <b>Job Browser</b> window, click the link in the ID column.</li>
  99. <li>To view the output of the job, click the link under <b>OUTPUT</b> in the panel at the left of the window.<br/>
  100. This takes you to the job output directory in the <b>File Browser</b>.</li>
  101. </ol>
  102. <br/>
  103. </td>
  104. </tr>
  105. </table>
  106. </body>
  107. </html>