2016-12-22-extract-archives-as-oozie-job.md 2.4 KB


title: Upload large archive files to HDFS and extract them in the background author: admin type: post date: 2016-12-22T00:38:34+00:00 url: /extract-archives-as-oozie-job/ sf_thumbnail_type:

  • none sf_thumbnail_link_type:
  • link_to_post sf_detail_type:
  • none sf_page_title:
  • 1 sf_page_title_style:
  • standard sf_no_breadcrumbs:
  • 1 sf_page_title_bg:
  • none sf_page_title_text_style:
  • light sf_background_image_size:
  • cover sf_social_sharing:
  • 1 sf_sidebar_config:
  • left-sidebar sf_left_sidebar:
  • Sidebar-2 sf_right_sidebar:
  • Sidebar-1 sf_caption_position:
  • caption-right categories:
  • Browsing
  • Scheduling

Hello Hue users,

Hue supports extraction of Zip, Tgz and Bz2 archives via File Browser app. With this improvement, you will be able to perform the archive extraction as an external Oozie job that has no performance impact on Hue. Here are the steps to achieve this.

First, upload the archive as a file using the File Browser app.

Select the archive you want to extract and you will notice that Submit button appear besides the Trash button.

After clicking the Submit button and confirming the job submission, you can go to the Oozie dashboard page to check the progress of the job. In the next release, we will show how to monitor the progress of the job without even going to the Oozie dashboard and be notified of the completion by email.

Once the job finishes, you can find the extracted contents in the same HDFS folder.

Note

Flag to enable this feature until Hue 4:



[filebrowser]

\# enable_extract_uploaded_archive=true

 

As always, feel free to suggest new improvements or comments on the hue-user list or @gethue!