How can I merge TypedArrays in JavaScript?

JavascriptTyped Arrays

Javascript Problem Overview


I'd like to merge multiple arraybuffers to create a Blob. however, as you know, TypedArray dosen't have "push" or useful methods...

E.g.:

var a = new Int8Array( [ 1, 2, 3 ] );
var b = new Int8Array( [ 4, 5, 6 ] );

As a result, I'd like to get [ 1, 2, 3, 4, 5, 6 ].

Javascript Solutions


Solution 1 - Javascript

Use the set method. But note, that you now need twice the memory!

var a = new Int8Array( [ 1, 2, 3 ] );
var b = new Int8Array( [ 4, 5, 6 ] );

var c = new Int8Array(a.length + b.length);
c.set(a);
c.set(b, a.length);

console.log(a);
console.log(b);
console.log(c);

Solution 2 - Javascript

for client-side ~ok solution:

const a = new Int8Array( [ 1, 2, 3 ] )
const b = new Int8Array( [ 4, 5, 6 ] )
const c = Int8Array.from([...a, ...b])

Solution 3 - Javascript

I always use this function:

function mergeTypedArrays(a, b) {
    // Checks for truthy values on both arrays
    if(!a && !b) throw 'Please specify valid arguments for parameters a and b.';  
    
    // Checks for truthy values or empty arrays on each argument
    // to avoid the unnecessary construction of a new array and
    // the type comparison
    if(!b || b.length === 0) return a;
    if(!a || a.length === 0) return b;
    
    // Make sure that both typed arrays are of the same type
    if(Object.prototype.toString.call(a) !== Object.prototype.toString.call(b))
        throw 'The types of the two arguments passed for parameters a and b do not match.';
    
    var c = new a.constructor(a.length + b.length);
    c.set(a);
    c.set(b, a.length);
    
    return c;
}

The original function without checking for null or types

function mergeTypedArraysUnsafe(a, b) {
    var c = new a.constructor(a.length + b.length);
    c.set(a);
    c.set(b, a.length);
    
    return c;
}

Solution 4 - Javascript

if I have multiple typed arrays

            arrays = [ typed_array1, typed_array2,..... typed_array100]

I want concat all 1 to 100 sub array into single 'result' this function works for me.

  single_array = concat(arrays)
          

function concat(arrays) {
  // sum of individual array lengths
  let totalLength = arrays.reduce((acc, value) => acc + value.length, 0);

  if (!arrays.length) return null;

   let result = new Uint8Array(totalLength);

      // for each array - copy it over result
      // next array is copied right after the previous one
      let length = 0;
      for(let array of arrays) {
            result.set(array, length);
            length += array.length;
      }

      return result;
   }



         

Solution 5 - Javascript

As a one-liner, which will take an arbitrary number of arrays (myArrays here) and of mixed types so long as the result type takes them all (Int8Array here):

let combined = Int8Array.from(Array.prototype.concat(...myArrays.map(a => Array.from(a))));

Solution 6 - Javascript

For people who love one-liners:

  const binaryData = [
    new Uint8Array([1, 2, 3]),
    new Int16Array([4, 5, 6]),
    new Int32Array([7, 8, 9])
  ];

  const mergedUint8Array = new Uint8Array(binaryData.map(typedArray => [...new Uint8Array(typedArray.buffer)]).flat());

Solution 7 - Javascript

function concat (views: ArrayBufferView[]) {
    let length = 0
    for (const v of views)
        length += v.byteLength
        
    let buf = new Uint8Array(length)
    let offset = 0
    for (const v of views) {
        const uint8view = new Uint8Array(v.buffer, v.byteOffset, v.byteLength)
        buf.set(uint8view, offset)
        offset += uint8view.byteLength
    }
    
    return buf
}

Solution 8 - Javascript

I like @prinzhorn's answer but I wanted something a bit more flexible and compact:

var a = new Uint8Array( [ 1, 2, 3 ] );
var b = new Float32Array( [ 4.5, 5.5, 6.5 ] );

const merge = (tArrs, type = Uint8Array) => {
  const ret = new (type)(tArrs.reduce((acc, tArr) => acc + tArr.byteLength, 0))
  let off = 0
  tArrs.forEach((tArr, i) => {
    ret.set(tArr, off)
    off += tArr.byteLength
  })
  return ret
}

merge([a, b], Float32Array)

Attributions

All content for this solution is sourced from the original question on Stackoverflow.

The content on this page is licensed under the Attribution-ShareAlike 4.0 International (CC BY-SA 4.0) license.

Content TypeOriginal AuthorOriginal Content on Stackoverflow
QuestionyomotsuView Question on Stackoverflow
Solution 1 - JavascriptPrinzhornView Answer on Stackoverflow
Solution 2 - JavascriptJerryCauserView Answer on Stackoverflow
Solution 3 - JavascriptDänuView Answer on Stackoverflow
Solution 4 - JavascripthoogwView Answer on Stackoverflow
Solution 5 - JavascriptrandomsockView Answer on Stackoverflow
Solution 6 - JavascriptMaz TView Answer on Stackoverflow
Solution 7 - JavascriptHongfei ShenView Answer on Stackoverflow
Solution 8 - JavascriptmattdlockyerView Answer on Stackoverflow