标签：数仓 21 f1 column timestamp Hadoop value 1638117612278 实时
[BigDataHadoop：Hadoop&实时数仓.V03] [BigDataHadoop.电商行业实时数仓项目][|章节五|Hadoop|实时数仓|实时数仓：实时数仓$在Hadoop集群环境运行实时数仓程序.V3|]
一、运行OrderStatistics
### --- 复制类的绝对路径
~~~ # 选中类名：Copy Reference
dw.dws.OrderStatistics### --- 运行类
~~~ # 运行主类：OrderStatistics
[root@hadoop02 ~]# /opt/yanqi/servers/flink-1.11.1/bin/flink run -m yarn-cluster -c dw.dws.OrderStatistics /root/README/myjar/ebProject/EbProject-1.0-SNAPSHOT.jar
~~~输出参数
[] - Submitting application master application_1638525439341_0003
[] - Submitted application application_1638525439341_0003
[] - Waiting for the cluster to be allocated
[] - Deploying cluster, current state ACCEPTED
[] - YARN application has been deployed successfully.
[] - Found Web Interface hadoop03:42209 of application 'application_1638525439341_000
Job has been submitted with JobID b7ed68c9d77f357b7cb75da37951a2f1 ### --- 向mysql下插入数据：yanqi_trade_orders
~~~ # 在MySQL中插入数据：yanqi_trade_orders表插入数据
mysql> USE dwshow;
mysql> INSERT INTO `yanqi_trade_orders` VALUES ('21', '23a0b124546', '70', '2', '0.12', '20792.00', '1', '0', '370211', '0', '0', '0', '1', '2020-06-28 18:15:02', '2020-06-28 18:15:02', '2020-10-21 22:56:37');### --- kafka消费者消费到数据
~~~ # kafka中消费到数据
[root@hadoop02 ~]# kafka-console-consumer.sh --zookeeper hadoop02:2181/myKafka --topic canal --from-beginning
~~~等待消费数据
{"data":[{"orderId":"21","orderNo":"23a0b124546","userId":"70","status":"2","productMoney":"0.12","totalMoney":"20792.0","payMethod":"1","isPay":"0","areaId":"370211","tradeSrc":"0","tradeType":"0","isRefund":"0","dataFlag":"1","createTime":"2020-06-28 18:15:02","payTime":"2020-06-28 18:15:02","modifiedTime":"2020-10-21 22:56:37"}],"database":"dwshow","es":1638117602000,"id":38,"isDdl":false,"mysqlType":{"orderId":"bigint(11)","orderNo":"varchar(20)","userId":"bigint(11)","status":"tinyint(4)","productMoney":"decimal(11,2)","totalMoney":"decimal(11,2)","payMethod":"tinyint(4)","isPay":"tinyint(4)","areaId":"int(11)","tradeSrc":"tinyint(4)","tradeType":"int(11)","isRefund":"tinyint(4)","dataFlag":"tinyint(4)","createTime":"varchar(25)","payTime":"varchar(25)","modifiedTime":"timestamp"},"old":null,"pkNames":["orderId"],"sql":"","sqlType":{"orderId":-5,"orderNo":12,"userId":-5,"status":-6,"productMoney":3,"totalMoney":3,"payMethod":-6,"isPay":-6,"areaId":4,"tradeSrc":-6,"tradeType":4,"isRefund":-6,"dataFlag":-6,"createTime":12,"payTime":12,"modifiedTime":93},"table":"yanqi_trade_orders","ts":1638117602172,"type":"INSERT"}### --- 查看hbash下：yanqi_trade_orders下沉数据
~~~ # hbash表中获取到数据
[root@hadoop02 ~]# /opt/yanqi/servers/hbase-1.3.1/bin/hbase shell
hbase(main):017:0> scan 'yanqi_trade_orders'
ROW COLUMN+CELL
21 column=f1:areaId, timestamp=1638117612278, value=370211
21 column=f1:createTime, timestamp=1638117612278, value=2020-06-28 18:15:02
21 column=f1:dataFlag, timestamp=1638117612278, value=1
21 column=f1:isPay, timestamp=1638117612278, value=0
21 column=f1:isRefund, timestamp=1638117612278, value=0
21 column=f1:modifiedTime, timestamp=1638117612278, value=2020-10-21 22:56:37
21 column=f1:orderId, timestamp=1638117612278, value=21
21 column=f1:orderNo, timestamp=1638117612278, value=23a0b124546
21 column=f1:payMethod, timestamp=1638117612278, value=1
21 column=f1:payTime, timestamp=1638117612278, value=2020-06-28 18:15:02
21 column=f1:productMoney, timestamp=1638117612278, value=0.12
21 column=f1:status, timestamp=1638117612278, value=2
21 column=f1:totalMoney, timestamp=1638117612278, value=20792.0
21 column=f1:tradeSrc, timestamp=1638117612278, value=0
21 column=f1:tradeType, timestamp=1638117612278, value=0
21 column=f1:userId, timestamp=1638117612278, value=70 
查看redis下是否获取到数据
查看prometheus下是否监控到数据
===============================END===============================
Walter Savage Landor:strove with none,for none was worth my strife.Nature I loved and, next to Nature, Art:I warm'd both hands before the fire of life.It sinks, and I am ready to depart ——W.S.Landor
来自为知笔记(Wiz)
标签：数仓,21,f1,column,timestamp,Hadoop,value,1638117612278,实时 来源： https://www.cnblogs.com/yanqivip/p/16152712.html
本站声明： 1. iCode9 技术分享网（下文简称本站）提供的所有内容，仅供技术学习、探讨和分享； 2. 关于本站的所有留言、评论、转载及引用，纯属内容发起人的个人观点，与本站观点和立场无关； 3. 关于本站的所有言论和文字，纯属内容发起人的个人观点，与本站观点和立场无关； 4. 本站文章均是网友提供，不完全保证技术分享内容的完整性、准确性、时效性、风险性和版权归属；如您发现该文章侵犯了您的权益，可联系我们第一时间进行删除； 5. 本站为非盈利性的个人网站，所有内容不会用来进行牟利，也不会利用任何形式的广告来间接获益，纯粹是为了广大技术爱好者提供技术内容和技术思想的分享性交流网站。