uniq 去除重复行或统计
来源:互联网 发布:汽车虚拟仿真软件 编辑:程序博客网 时间:2024/06/06 00:50
uniq 去除重复行或统计
主要选项
-u (唯一)和 -d (重复) -c (统计) -f (跳过字段数,默认tab标示) -s (同f,单位字符)
1.同样记录打印一次(必须是排好序)
sort a.txt |uniq 或
sort -u a.txt -o b.txt
主要选项
-u (唯一)和 -d (重复) -c (统计) -f (跳过字段数,默认tab标示) -s (同f,单位字符)
1.同样记录打印一次(必须是排好序)
sort a.txt |uniq 或
sort -u a.txt -o b.txt
[root@M165 root]# cat a.txt
a b 2
a b 4
a b 2
a d 4
a b 4
统计重复行
[root@M165 root]# sort a.txt |uniq -dc
2 a b 2
2 a b 4
统计单独行,不懂为什么有uniq -uc
[root@M165 root]# sort a.txt |uniq -uc
1 a d 4
分别统计
[root@M165 root]# sort a.txt |uniq -c
2 a b 2
2 a b 4
1 a d 4
[root@M165 root]# sort a.txt |uniq -c
2 a b 2
2 a b 4
1 a d 4
[root@M165 root]# tail -5 install.log.syslog
<13>Aug 21 16:01:28 kudzu: aliased usb-controller1 as ehci-hcd
<13>Aug 21 16:01:29 kudzu: aliased usb-controller1 as ehci-hcd
<13>Aug 21 16:01:20 kudzu: aliased usb-controller1 as ehci-hcd
<13>Aug 22 16:01:20 kudzu: aliased usb-controller1 as ehci-hcd
<14>Aug 22 16:01:20 kudzu: aliased usb-controller1 as ehci-hcd
不对比第一字段<13>Aug
[root@M165 root]# tail -5 install.log.syslog |uniq -f 1
<13>Aug 21 16:01:28 kudzu: aliased usb-controller1 as ehci-hcd
<13>Aug 21 16:01:29 kudzu: aliased usb-controller1 as ehci-hcd
<13>Aug 21 16:01:20 kudzu: aliased usb-controller1 as ehci-hcd
<13>Aug 22 16:01:20 kudzu: aliased usb-controller1 as ehci-hcd
不对比第二字段21
[root@M165 root]# tail -5 install.log.syslog |uniq -f 2
<13>Aug 21 16:01:28 kudzu: aliased usb-controller1 as ehci-hcd
<13>Aug 21 16:01:29 kudzu: aliased usb-controller1 as ehci-hcd
<13>Aug 21 16:01:20 kudzu: aliased usb-controller1 as ehci-hcd
不对比第二字段 16:01:28
[root@M165 root]# tail -5 install.log.syslog |uniq -f 3
<13>Aug 21 16:01:28 kudzu: aliased usb-controller1 as ehci-hcd
[root@M165 root]# tail -5 install.log.syslog |uniq -f 4
<13>Aug 21 16:01:28 kudzu: aliased usb-controller1 as ehci-hcd
[root@M165 root]# tail -5 install.log.syslog |uniq -f 1
<13>Aug 21 16:01:28 kudzu: aliased usb-controller1 as ehci-hcd
<13>Aug 21 16:01:29 kudzu: aliased usb-controller1 as ehci-hcd
<13>Aug 21 16:01:20 kudzu: aliased usb-controller1 as ehci-hcd
<13>Aug 22 16:01:20 kudzu: aliased usb-controller1 as ehci-hcd
不对比第二字段21
[root@M165 root]# tail -5 install.log.syslog |uniq -f 2
<13>Aug 21 16:01:28 kudzu: aliased usb-controller1 as ehci-hcd
<13>Aug 21 16:01:29 kudzu: aliased usb-controller1 as ehci-hcd
<13>Aug 21 16:01:20 kudzu: aliased usb-controller1 as ehci-hcd
不对比第二字段 16:01:28
[root@M165 root]# tail -5 install.log.syslog |uniq -f 3
<13>Aug 21 16:01:28 kudzu: aliased usb-controller1 as ehci-hcd
[root@M165 root]# tail -5 install.log.syslog |uniq -f 4
<13>Aug 21 16:01:28 kudzu: aliased usb-controller1 as ehci-hcd
用字符作单位
[root@M165 root]# tail -5 install.log.syslog |uniq -s 9
<13>Aug 21 16:01:28 kudzu: aliased usb-controller1 as ehci-hcd
<13>Aug 21 16:01:29 kudzu: aliased usb-controller1 as ehci-hcd
<13>Aug 21 16:01:20 kudzu: aliased usb-controller1 as ehci-hcd
<13>Aug 22 16:01:20 kudzu: aliased usb-controller1 as ehci-hcd
[root@M165 root]# tail -5 install.log.syslog |uniq -s 10
<13>Aug 21 16:01:28 kudzu: aliased usb-controller1 as ehci-hcd
<13>Aug 21 16:01:29 kudzu: aliased usb-controller1 as ehci-hcd
<13>Aug 21 16:01:20 kudzu: aliased usb-controller1 as ehci-hcd
[root@M165 root]# tail -5 install.log.syslog |uniq -s 9
<13>Aug 21 16:01:28 kudzu: aliased usb-controller1 as ehci-hcd
<13>Aug 21 16:01:29 kudzu: aliased usb-controller1 as ehci-hcd
<13>Aug 21 16:01:20 kudzu: aliased usb-controller1 as ehci-hcd
<13>Aug 22 16:01:20 kudzu: aliased usb-controller1 as ehci-hcd
[root@M165 root]# tail -5 install.log.syslog |uniq -s 10
<13>Aug 21 16:01:28 kudzu: aliased usb-controller1 as ehci-hcd
<13>Aug 21 16:01:29 kudzu: aliased usb-controller1 as ehci-hcd
<13>Aug 21 16:01:20 kudzu: aliased usb-controller1 as ehci-hcd
- uniq 去除重复行或统计
- linux 去除重复行 uniq
- Sort, + uniq用来从一个文本文件中去除或禁止重复行,
- Linux 命令行去除重复 uniq
- Linux uniq --去除排序过的文件中的重复行
- linux用uniq命令----过滤、统计、删除重复行
- uniq 去除重复命令使用方法介绍
- 如何运用Sort+Uniq或Sort -u删除重复行
- 如何运用Sort+Uniq或Sort -u删除重复行
- uniq 去重复行
- 用 uniq 除去重复行
- sort uniq 除去重复行
- 用 uniq 除去重复行
- 用 uniq 除去重复行
- linux uniq命令(去除排序之后的重复)
- linux shell脚本查找重复行/查找非重复行/去除重复行/重复行统计
- 去除重复行或列的一些sql语句
- 技巧: 用 uniq 除去重复行
- null, message from server: "Host ***" is not allowed to connect to this MySQL server"
- 请教LINUX初学问题
- [转]根据指定的信息,调用远程WebService方法 - 强人经典
- 编程实现过滤文件传输
- 北京赛区复活赛归来(2006-11-14 00:21)
- uniq 去除重复行或统计
- GR量与订单交货量不一致
- 1000内的素数表(2007-01-25 22:55)
- JBOSS get 方式乱码解决
- 儿时回忆完整版
- POJ 200AC(2007-02-06 22:36)
- IBM服务器不能识别阵列柜磁盘的解决方法
- POJ warmup 6 15th(2007-02-08 19:38)
- linux系统环境下轻松搭建CVS服务器