What is the table format? Different table formats require different amounts of memory to create the output HDFS file. Text and Sequencefiles need very little memory.
Hive copies data from table2 to a local files on some of the servers, then copies from those local files to the HDFS files in the output table. Hive stores nothing in memory.
I have never used Oozie. Does the Hive script do this when you run it from the HiveServer2 command line? Or from a JDBC client?
Follow. I have the similar issue
Posted 1 March 2021
© 2021 TechTarget, Inc.
Powered by
Badges | Report an Issue | Privacy Policy | Terms of Service
Most Popular Content on DSC
To not miss this type of content in the future, subscribe to our newsletter.
Other popular resources
Archives: 2008-2014 | 2015-2016 | 2017-2019 | Book 1 | Book 2 | More
Most popular articles