[ILUG] duplicate lines in a file

[Padraig Brady]

bryan hunt wrote:
> I've just added this to my bash profile ....
> 
> export HISTIGNORE="&:ls:ls *:[bf]g:exit"
> from http://www.caliban.org/bash/

Why would you ever want duplicates in the history?
export HISTCONTROL=ignoredups

> Now I want to remove all the duplicates from the history file 
> is there a command that will take in standard input,remove
> duplicate lines and output to standard out ? 
> 
> I've been doing this but it sucks ...
> 
> cat ~/.bash_history  | egrep -v "shorewall|ls|rm\./|chmod"
> 
> I'm sure theres something in the toolbox for this ....

sort ~/.bash_history | uniq

Padraig.