Explorar el Código

HUE-6660 [optimizer] Limit the number of columns we send stats for

It is one call by column with Hive so far, which is too much with hundreds of columns, several tables
Romain Rigaux hace 8 años
padre
commit
d3c3eab9f3
Se han modificado 1 ficheros con 1 adiciones y 1 borrados
  1. 1 1
      desktop/libs/metadata/src/metadata/optimizer_api.py

+ 1 - 1
desktop/libs/metadata/src/metadata/optimizer_api.py

@@ -423,7 +423,7 @@ def upload_table_stats(request):
       })
 
       if with_columns:
-        for col in full_table_stats['columns']:
+        for col in full_table_stats['columns'][:25]:
           col_stats = json.loads(get_table_stats(request, database=path['database'], table=path['table'], column=col).content)['stats']
           col_stats = dict([(key, val) for col_stat in col_stats for key, val in col_stat.iteritems()])