Bigdata notes

From raju

sqoop

  • sample command
    sqoop import -Dorg.apache.sqoop.splitter.allow_text_splitter=true --username $USER --password PASSWD --options-file options_file |& tee log.txt
    

The -Dorg.apache.sqoop.splitter.allow_text_splitter option allows to split on strings.

See:- https://community.hortonworks.com/questions/26961/sqoop-split-by-on-a-string-varchar-column.html