--- title: 'Big Data Scala by the Bay: Interactive Spark in your Browser' author: admin type: post date: 2015-08-19T15:46:13+00:00 url: /big-data-scala-by-the-bay-interactive-spark-in-your-browser/ sf_thumbnail_type: - none sf_thumbnail_link_type: - link_to_post sf_detail_type: - none sf_page_title: - 1 sf_page_title_style: - standard sf_no_breadcrumbs: - 1 sf_page_title_bg: - none sf_page_title_text_style: - light sf_background_image_size: - cover sf_social_sharing: - 1 sf_sidebar_config: - left-sidebar sf_left_sidebar: - Sidebar-2 sf_right_sidebar: - Sidebar-1 sf_caption_position: - caption-right sf_remove_promo_bar: - 1 categories: # - News --- ## [Interactive Spark in your Browser - Scala by the Bay][1] Supporting running Spark scripts directly from a browser would bring the user experience up. Indeed, everybody has a Web navigator, the command line can be avoided, built-in graphing and visualization make it easy to explore and understand data with just a few clicks. This also simplifies the administration as now everything becomes centralized in a service and is accessible by non native clients. For this purpose, an open source Spark Job Server was developed in order to provide Scala, SQL and Python in a Web shell. The main Hadoop components of the platform are also integrated in the same interface. This talk describes the architecture of the Spark Server and its main features: # Scala, Python, SQL submissions # Impersonation # Security # Job progress / canceling # YARN / HDFS / Hive integration The server also ships with a friendly user interface built as a Hue app. We will focus on explaining how they were built, how to use the API and which lessons were learned. The final end user interaction will be live demoed.
[
][2]
[1]: http://scalabythebay2015.sched.org/event/4bf6a78140acedd2cf122c085f77f5ca?iframe=no&w=&sidebar=yes&bg=no#.VdSignUVhBe
[2]: https://cdn.gethue.com/uploads/2015/08/notebook-aug.png