首页 > 编程知识 正文

mysql 创建外部表_Alex 的 Hadoop 菜鸟教程: 第9课 Sqoop1 从Hbase或者Hive导出mysql

时间:2023-05-03 13:13:06 阅读:28759 作者:1641

$ sqoopexport---connect JDBC : MySQL ://localhost 33603306/sq OOP _ test---username root-- password root

warning :/usr/lib/sq OOP/./hive-hcatalogdoesnotexist! hcatalog jobs will故障。

pleaseset $ hcat _ hometotherootofyourhcataloginstallation。

warning :/usr/lib/sq OOP/./accumulodoesnotexist! Ac Cumulo导入will故障。

pleaseset $ AC cumulo _ hometotherootofyouraccumuloinstallation。

14/12/0508336049336035 infos qoop.sq OOP 3360 runningsqoopversion 33601.4.4-CDH5.0. 1

14/12/0508336049336035 warn tool.basesqooptool : settingyourpasswordonthecommand-lineisinsecure.consider using-ping

14/12/0508336049336035 info manager.MySQL manager : preparingtouseamysqlstreamingresultset。

14/12/0508336049336035 infotool.codegen tool : beginningcodegeneration

14/12/0508336049336036 info manager.SQL manager : executing SQL statement : select.* from ` employee ` ast limit 1

14/12/0508336049336036 info manager.SQL manager : executing SQL statement : select.* from ` employee ` ast limit 1

14/12/0508336049336036 infoorm.kq dhb : Hadoop _ mapred _ home is/usr/lib/Hadoop-MapReduce

note :/tmp/sq OOP-WLS user/compile/d 16 EB 4166 BAF 6a1e 885 df0e 2638685/employee.javausesoroverrrridesadeprecatedapi

note : recompile with-xlint : deprecationfordetails。

14/12/0508336049336039 infoorm.kq dhb : writing jarfile :/tmp/sq OOP-WLS user/compile/d 16 EB 4166 BAF 6a1e 885 D7 DDD

14/12/0508336049336039 info MapReduce .强大的棒棒糖: Beginning export of employee

14/12/0508336049336041 info configuration.deprecation : mapred.jarisdeprecated.instead,use mapreduce.job.jar

14/12/0508336049336043 info configuration.deprecation : mapred.reduce.tasks.speculative.executionisdeprecated

14/12/0508336049336043 info configuration.deprecation : mapred.map.tasks.speculative.executionisdeprecated.iii

14/12/0508336049336043 info configuration.deprecation : mapred.map.tasksisdeprecated.instead,usemapreduce.Jood

14/12/0508336049336043 info客户端. RM proxy : connectingtoresourcemanagerathadoop 01/192.111.78.1133608032

14/12/0508336049336045 info input.fileinputformat 3360 totalinputpathstoprocess 3360

14/12/0508336049336045 info input.fileinputformat 3360 totalinputpathstoprocess 3360

14/12/0508336049336045 info MapReduce.xx dlh : number of splits :1

14/12/0508336049336046 info MapReduce.xx dlh : submittingtokensforjob _ 1406097234796 _ 0037

14/12/0508336049336046 info impl.yarnclientimpl : submittedapplicationapplication _ 1406097234796 _ 037

14/12/0508336049336046 info MapReduce.job : theurltotrackthejob :3358 Hadoop 0133608088/proxy/application _ 1448

14/12/0508336049336046 info MapReduce.job : running job : job _ 1406097234796 _ 0037

14/12/0508336049336059 info MapReduce.job : job job _ 1406097234796 _ 0037 runninginubermode : false

14/12/0508336049336059 info MapReduce.job : map0% reduce0%

14/12/0508336050336010 info MapReduce.job : map 100 % reduce0%

14/12/0508336050336010 info MapReduce.job : job job _ 1406097234796 _ 0037 completed successfully

14/12/0508336050336010 info MapReduce.job : counters :30

文件系统计数器

FILE: Number of bytes read=0

file : numberofbyteswritten=99761

file : numberofreadoperations=0

file : numberoflargereadoperations=0

file : numberofwriteoperations=0

工作变更

Launched map tasks=1

数据本地映射任务=1

totaltimespentbyallmapsinoccupiedslots (ms )=8805

totaltimespentbyallreducesinoccupiedslots (ms )=0

totaltimespentbyallmaptasks(ms )=8805

total vcore-secondstakenbyallmaptasks=8805

total megabyte-secondstakenbyallmaptasks=9016320

地图生产框架

映射输入记录=2

映射输出记录=2

输入剥离字节=144

Spilled记录=0

故障缓冲器=0

合并映射输出=0

CPU时间间隔(ms )=1360

物理内存(字节)快照=167555072

虚拟内存(字节)快照=684212224

totalcommittedheapusage(bytes )=148897792

文件输入格式计数器

Bytes Read=0

文件输出格式计数器

Bytes Written=0

14/12/0508336050336010 info MapReduce .强力棒棒糖: transferred 166 bytesin 27.0676 seconds (6.1328 bytes/sec )。

14/12/0508336050336010 info MapReduce .强力棒棒糖: Exported 2 records。

版权声明:该文观点仅代表作者本人。处理文章:请发送邮件至 三1五14八八95#扣扣.com 举报,一经查实,本站将立刻删除。