[ILUG] duplicate lines in a file

[Declan Houlihan]

I don't know if it's what you're looking for but...

sort -u


On Thu, Dec 05, 2002 at 06:42:39PM +0000, bryan hunt wrote:
> 
> 
> I've just added this to my bash profile ....
> 
> export HISTIGNORE="&:ls:ls *:[bf]g:exit"
> from http://www.caliban.org/bash/
> 
> Now I want to remove all the duplicates from the history file
> is there a command that will take in standard input,remove
> duplicate lines and output to standard out ?
> 
> I've been doing this but it sucks ...
> 
> cat ~/.bash_history  | egrep -v "shorewall|ls|rm\./|chmod"
> 
> I'm sure theres something in the toolbox for this ....
> 
> --B
> 
> --
> Bryan Hunt
> Systems Enginering Manager
> Ossidian Technologies  Ltd
> Blackrock
> Co Dublin
> IRELAND
> 
> Tel +353-1-2787111 Fax +353-1-2787136
> 
> See us at :-
> 
> 18-21 February 2003
> Palais des Festivals
> Cannes, France
> Ireland Stand No: B22, Hall 1
> 
> IMPORTANT :- The contents of this email are confidential and may contain
> legally privileged information. If you are not a named addressee, please
> notify the sender. We take reasonable precautions using Sophos antu-virus
> software to ensure that all data generated by us has been checked for viruses
> and accept no responsibility in this regard
> 
> -------------------------------------------------------
> 
> -- 
> Bryan Hunt
> Systems Enginering Manager 
> Ossidian Technologies  Ltd  
> Blackrock
> Co Dublin
> IRELAND 
> 
> Tel +353-1-2787111 Fax +353-1-2787136
> 
> See us at :-
> 
> 18-21 February 2003
> Palais des Festivals
> Cannes, France
> Ireland Stand No: B22, Hall 1
> 
> IMPORTANT :- The contents of this email are confidential and may contain 
> legally privileged information. If you are not a named addressee, please 
> notify the sender. We take reasonable precautions using Sophos antu-virus 
> software to ensure that all data generated by us has been checked for viruses 
> and accept no responsibility in this regard
> --
> Irish Linux Users' Group: ilug at linux.ie
> http://www.linux.ie/mailman/listinfo/ilug for (un)subscription information.
> List maintainer: listmaster at linux.ie

-- 
---------------------------------------
Declan Houlihan
deccy at csn.ul.ie
http://deccy.csn.ul.ie/
---------------------------------------