Harsh Gupta ccecafa513 [core][cleanup] Refactor and remove old Py2 code checks and methods (#3683) 1 vuosi sitten
..
lib ccecafa513 [core][cleanup] Refactor and remove old Py2 code checks and methods (#3683) 1 vuosi sitten
patches 60c1d75b0b Added hue scripts to the Cloudera/hue repo (#1784) 4 vuotta sitten
README.md 7f1227fd42 [commands] Remove promote_to_superuser Hue command (#3715) 1 vuosi sitten
extract_archive_in_hdfs.sh 60c1d75b0b Added hue scripts to the Cloudera/hue repo (#1784) 4 vuotta sitten
get_hue_version.sh 60c1d75b0b Added hue scripts to the Cloudera/hue repo (#1784) 4 vuotta sitten
hue_change_dashboard_owner.sh 60c1d75b0b Added hue scripts to the Cloudera/hue repo (#1784) 4 vuotta sitten
hue_clean_duplicate_permissions.sh 60c1d75b0b Added hue scripts to the Cloudera/hue repo (#1784) 4 vuotta sitten
hue_create_db.sh 60c1d75b0b Added hue scripts to the Cloudera/hue repo (#1784) 4 vuotta sitten
hue_download_watcher.sh 60c1d75b0b Added hue scripts to the Cloudera/hue repo (#1784) 4 vuotta sitten
hue_dump_user.sh 60c1d75b0b Added hue scripts to the Cloudera/hue repo (#1784) 4 vuotta sitten
hue_history_cron.sh 60c1d75b0b Added hue scripts to the Cloudera/hue repo (#1784) 4 vuotta sitten
hue_multiple_home_cleanup.sh 60c1d75b0b Added hue scripts to the Cloudera/hue repo (#1784) 4 vuotta sitten
hue_restart_cm.sh 60c1d75b0b Added hue scripts to the Cloudera/hue repo (#1784) 4 vuotta sitten
queries.txt 60c1d75b0b Added hue scripts to the Cloudera/hue repo (#1784) 4 vuotta sitten
script_runner 60c1d75b0b Added hue scripts to the Cloudera/hue repo (#1784) 4 vuotta sitten

README.md

Ops Scripts

This is a set of scripts that you can use to manage Hue. While some of these are self contained, the most important ones have library calls to the lib directory. You must download the entire "script_runner" directory for these to work. Also note, they all make use of Hue's configuration and the /proc directory. This means these scripts must be run as ROOT.

Clone the script_runner directory to the /opt/cloudera/hue_scripts directory:

git clone https://github.com/cloudera/hue/tree/master/tools/ops/script_runner /opt/cloudera/hue_scripts

The following commands show the available scripts in [custom_scripts] section, the rest are normal Hue commands:

cd /opt/cloudera/hue_scripts
[root@nightly516-1 hue_scripts]# ./script_runner

Usage

script_runner sub-command [options] [args]

Options

|Option|Description| |--|--| |-v VERBOSITY, --verbosity=VERBOSITY|Verbosity level; 0=minimal output, 1=normal output, 2=verbose output, 3=very verbose output | |--settings=SETTINGS|The Python path to a settings module, e.g. "myproject.settings.main". If this isn't provided, the DJANGO_SETTINGS_MODULE environment variable is used.| |--pythonpath=PYTHONPATH|A directory to add to the Python path, e.g. "/home/djangoprojects/myproject".| |--traceback|Raise on exception.| |--version|Show program's version number and exit.| |-h, --help|Show this help message and exit.|

Type script_runner help <sub-command> for help on a specific subcommand.

Sub-commands

[auth] changepassword

[custom_commands] backend_test_curl change_owner_of_docs delete_user estimate_concurrent_users hue_desktop_document_cleanup list_groups emove_doc2_without_content_object remove_duplicate_user_preferences remove_orphaned_docs rename_duplicate_users run_hive_impala_query share_all_workflows

Commands

  • script_runner backend_test_curl This tests all of the REST API backend services to make sure they are running. This includes HTTPFS, Resource Manager, Job History Server, Oozie, Solr. Then outputs the matching curl commands to test outside of Hue.

  • script_runner change_owner_of_docs --olduser cconner --newuser cconner1 This changes the owner of any documents owned by oldusuer to newuser.

  • script_runner delete_user --username cconner This deletes the user specified by --username.

  • script_runner estimate_concurrent_users --last1h This checks the access logs and try to estimate the number of active users over the last hour or given timeframe.

  • script_runner list_groups This shows all of the groups that exist in Hue.

  • script_runner remove_doc2_without_content_object This removes bad doc2 objects that do not have the content object.

  • script_runner remove_duplicate_user_preferences This removes duplicate entries in the table "desktop_userpreferences".

  • script_runner remove_orphaned_docs This removes broken docs that do not have an owner.

  • script_runner rename_duplicate_users If you end up with duplicate usernames somehow, then this renames the most recently created one to prevent data loss, but fix errors.

  • script_runner run_hive_impala_query --impala --user cconner --query "select * from sample_07" This runs a query against Hive or Impala using Hue code, but outside the Hue process. It impersonates the specified user. This is good for determining if an issue is caused by Hue or the backend service.

  • script_runner share_all_workflows --owner cconner --sharegroups test1,test2 --permissioins read,write This shares workflows from --owner to a comma-separated list of shareusers or sharegroups and a list of permissions specified by --permissions.

  • hue_download_watcher.sh This script can be used to capture info surrounding downloads from Hue.

  • hue_clean_duplicate_permissions.sh This script is old, but it would have cleaned up duplicate entries for HuePermission objects.

  • extract_archive_in_hdfs.sh Debug version of the same extraction script in Hue source.

License

Apache License, Version 2.0