Using iconv to convert from UTF-16LE to UTF-8

LinuxUtf 16le

Linux Problem Overview

Hi I am trying to convert some log files from a Microsoft SQL server, but the files are encoded using UTf-16LE and iconv does not seem to be able to convert them.

I am doing:

iconv -f UTF-16LE -t UTF-8 <filename>

I also tried to delete any carriage returns from the end of the line if there are any, but that did not fix it either. If I save it using gedit that works, but this is not a viable solution since I have hundreds of those files.

EDIT: Please see the new answer for the missing option

Linux Solutions

Solution 1 - Linux

I forgot the -o switch!

The final command is :

iconv -f UTF-16LE -t UTF-8 <filename> -o <new-filename>

Solution 2 - Linux

The command you specified will output to stdout. You can either use the -o parameter, or redirect your output:

with -o:

iconv -f UTF-16LE -t UTF-8 infile -o outfile

with piping:

iconv -f UTF-16LE -t UTF-8 infile > outfile

Both will yield the desired result.

However some versions of iconv (v1 on macOS for example) do not support the -o parameter and you will see that the converted text is echoed to stdout. In that case, use the piping option.

Categories
Recommended Linux Solutions

Previous Solution:

Generate all combinations from multiple lists

JavaListAlgorithmCombinationsCartesian Product

Next Solution:

angularjs to output plain text instead of html

JavascriptHtmlAngularjs

Attributions

All content for this solution is sourced from the original question on Stackoverflow.

The content on this page is licensed under the Attribution-ShareAlike 4.0 International (CC BY-SA 4.0) license.

Content TypeOriginal AuthorOriginal Content on Stackoverflow
Questionlaitha0View Question on Stackoverflow
Solution 1 - Linuxlaitha0View Answer on Stackoverflow
Solution 2 - LinuxA. BlesiusView Answer on Stackoverflow