flume系列之：处理flume 678M损毁文件
- 一、查看损毁文件
- 二、删除损毁文件
一、查看损毁文件
hdu -h /com-nio-insight-cn-prod/raw/kafka/*/*/*/1h/20230202/19/* | awk '$3 ~ "^768$" && $4 ~ "^M$" {print $3$4 " " $5}'二、删除损毁文件
hdfs dfs -rm /com-nio-insight-cn-prod/raw/kafka/debezium-prod-dd_ods_rvs_data_prod_1h/rvs_data_prod/vehicle_trip_history_1h_a/1h/20230202/20/p-qcbj6-dd-hadoop-debezium-flume-001.prod-qcloud-dd-insight.net-flumedata.1675339201874.gz
