shell replace cr\lf by comma

BashShellNewlineText Processing

Bash Problem Overview


I have input.txt

1
2
3
4
5

I need to get such output.txt

1,2,3,4,5

How to do it?

Bash Solutions


Solution 1 - Bash

Try this:

tr '\n' ',' < input.txt > output.txt

Solution 2 - Bash

With sed, you could use:

sed -e 'H;${x;s/\n/,/g;s/^,//;p;};d'

The H appends the pattern space to the hold space (saving the current line in the hold space). The ${...} surrounds actions that apply to the last line only. Those actions are: x swap hold and pattern space; s/\n/,/g substitute embedded newlines with commas; s/^,// delete the leading comma (there's a newline at the start of the hold space); and p print. The d deletes the pattern space - no printing.

You could also use, therefore:

sed -n -e 'H;${x;s/\n/,/g;s/^,//;p;}'

The -n suppresses default printing so the final d is no longer needed.

This solution assumes that the CRLF line endings are the local native line ending (so you are working on DOS) and that sed will therefore generate the local native line ending in the print operation. If you have DOS-format input but want Unix-format (LF only) output, then you have to work a bit harder - but you also need to stipulate this explicitly in the question.

It worked OK for me on MacOS X 10.6.5 with the numbers 1..5, and 1..50, and 1..5000 (23,893 characters in the single line of output); I'm not sure that I'd want to push it any harder than that.

Solution 3 - Bash

In response to @Jonathan's comment to @eumiro's answer:

tr -s '\r\n' ',' < input.txt | sed -e 's/,$/\n/' > output.txt

Solution 4 - Bash

tr and sed used be very good but when it comes to file parsing and regex you can't beat perl (Not sure why people think that sed and tr are closer to shell than perl... )

perl -pe 's/\n/$1,/' your_file

if you want pure shell to do it then look at string matching

${string/#substring/replacement}

Solution 5 - Bash

Use paste command. Here is using pipes:

echo "1\n2\n3\n4\n5" | paste -s -d, /dev/stdin

Here is using a file:

echo "1\n2\n3\n4\n5" > /tmp/input.txt
paste -s -d, /tmp/input.txt

Per man pages the s concatenates all lines and d allows to define the delimiter character.

Solution 6 - Bash

  • Awk versions:
  • awk '{printf("%s,",$0)}' input.txt
  • awk 'BEGIN{ORS=","} {print $0}' input.txt
  • Output - 1,2,3,4,5,

Since you asked for 1,2,3,4,5, as compared to 1,2,3,4,5, (note the comma after 5, most of the solutions above also include the trailing comma), here are two more versions with Awk (with wc and sed) to get rid of the last comma:

  • i='input.txt'; awk -v c=$(wc -l $i | cut -d' ' -f1) '{printf("%s",$0);if(NR<c){printf(",")}}' $i

  • awk '{printf("%s,",$0)}' input.txt | sed 's/,\s*$//'

Solution 7 - Bash

  • python version:

    python -c 'import sys; print(",".join(sys.stdin.read().splitlines()))'

Doesn't have the trailing comma problem (because join works that way), and splitlines splits data on native line endings (and removes them).

Solution 8 - Bash

printf "1\n2\n3" | tr '\n' ','

if you want to output that to a file just do

printf "1\n2\n3" | tr '\n' ',' > myFile

if you have the content in a file do

cat myInput.txt | tr '\n' ',' > myOutput.txt

Solution 9 - Bash

cat input.txt | sed -e 's|$|,|' | xargs -i echo "{}"

Attributions

All content for this solution is sourced from the original question on Stackoverflow.

The content on this page is licensed under the Attribution-ShareAlike 4.0 International (CC BY-SA 4.0) license.

Content TypeOriginal AuthorOriginal Content on Stackoverflow
QuestionvinnituView Question on Stackoverflow
Solution 1 - BasheumiroView Answer on Stackoverflow
Solution 2 - BashJonathan LefflerView Answer on Stackoverflow
Solution 3 - Bashglenn jackmanView Answer on Stackoverflow
Solution 4 - BashArnaudView Answer on Stackoverflow
Solution 5 - BashNestor UrquizaView Answer on Stackoverflow
Solution 6 - BashgsbabilView Answer on Stackoverflow
Solution 7 - BashqneillView Answer on Stackoverflow
Solution 8 - BashTono NamView Answer on Stackoverflow
Solution 9 - BashNoel YapView Answer on Stackoverflow