I had to cat 8-9 seperate quote files, compare each line in each of them to make sure there weren't any duplicates then sort I wrote a nasty perl script to get it donw and it didn't work very well cat quote*.txt |sort |uniq