--- title: 'Big Data Scala by the Bay: Interactive Spark in your Browser' author: admin type: post date: 2015-08-19T15:46:13+00:00 url: /big-data-scala-by-the-bay-interactive-spark-in-your-browser/ sf_thumbnail_type: - none sf_thumbnail_link_type: - link_to_post sf_detail_type: - none sf_page_title: - 1 sf_page_title_style: - standard sf_no_breadcrumbs: - 1 sf_page_title_bg: - none sf_page_title_text_style: - light sf_background_image_size: - cover sf_social_sharing: - 1 sf_sidebar_config: - left-sidebar sf_left_sidebar: - Sidebar-2 sf_right_sidebar: - Sidebar-1 sf_caption_position: - caption-right sf_remove_promo_bar: - 1 categories: - News --- ## [Interactive Spark in your Browser - Scala by the Bay][1] Supporting running Spark scripts directly from a browser would bring the user experience up. Indeed, everybody has a Web navigator, the command line can be avoided, built-in graphing and visualization make it easy to explore and understand data with just a few clicks. This also simplifies the administration as now everything becomes centralized in a service and is accessible by non native clients. For this purpose, an open source Spark Job Server was developed in order to provide Scala, SQL and Python in a Web shell. The main Hadoop components of the platform are also integrated in the same interface. This talk describes the architecture of the Spark Server and its main features: # Scala, Python, SQL submissions # Impersonation # Security # Job progress / canceling # YARN / HDFS / Hive integration The server also ships with a friendly user interface built as a Hue app. We will focus on explaining how they were built, how to use the API and which lessons were learned. The final end user interaction will be live demoed.
Big Data Scala by the Bay: Interactive Spark in your Browser from gethue
    [][2]   [1]: http://scalabythebay2015.sched.org/event/4bf6a78140acedd2cf122c085f77f5ca?iframe=no&w=&sidebar=yes&bg=no#.VdSignUVhBe [2]: https://cdn.gethue.com/uploads/2015/08/notebook-aug.png