Split an Array Into Smaller Array Chunks in JavaScript and Node.js

We recently ran into a problem with a large array. The number of items in the array was too large to process them at once. We wanted to offload smaller chunks of these items to a queue worker.

This tutorial shows you how to split an array into a list of smaller chunks.

Node.js Series Overview

  1. String Replace All Appearances
  2. Remove All Whitespace From a String in JavaScript
  3. Generate a Random ID or String in Node.js or JavaScript
  4. Remove Extra Spaces From a String in JavaScript or Node.js
  5. Remove Numbers From a String in JavaScript or Node.js
  6. Get the Part Before a Character in a String in JavaScript or Node.js
  7. Get the Part After a Character in a String in JavaScript or Node.js
  8. How to Check if a Value is a String in JavaScript or Node.js
  9. Check If a String Includes All Strings in JavaScript/Node.js/TypeScript
  10. Check if a Value is a String in JavaScript and Node.js
  11. Limit and Truncate a String to a Given Length in JavaScript and Node.js
  12. Split a String into a List of Characters in JavaScript and Node.js
  13. How to Generage a UUID in Node.js
  14. Reverse a String in JavaScript or Node.js
  15. Split a String into a List of Lines in JavaScript or Node.js
  16. Split a String into a List of Words in JavaScript or Node.js
  17. Detect if a String is in camelCase Format in Javascript or Node.js
  18. Check If a String Is in Lowercase in JavaScript or Node.js
  19. Check If a String is in Uppercase in JavaScript or Node.js
  20. Get the Part After First Occurrence in a String in JavaScript or Node.js
  21. Get the Part Before First Occurrence in a String in JavaScript or Node.js
  22. Get the Part Before Last Occurrence in a String in JavaScript or Node.js
  23. Get the Part After Last Occurrence in a String in JavaScript or Node.js
  24. How to Count Words in a File
  25. How to Shuffle the Characters of a String in JavaScript or Node.js
  26. Append Characters or Words to a String in JavaScript or Node.js (Coming soon)
  27. Check if a String is Empty in JavaScript or Node.js (Coming soon)
  28. Ensure a String Ends with a Given Character in JavaScript or Node.js (Coming soon)
  29. Left-Trim Characters Off a String in JavaScript or Node.js (Coming soon)
  30. Right-Trim Characters Off a String in JavaScript or Node.js (Coming soon)
  31. Lowercase the First Character of a String in JavaScript or Node.js (Coming soon)
  32. Uppercase the First Character of a String in JavaScript or Node.js (Coming soon)
  33. Prepend Characters or Words to a String in JavaScript or Node.js (Coming soon)
  1. Get Number of Seconds Since Epoch in JavaScript
  2. Get Tomorrow’s Date in JavaScript
  3. Increase a Date in JavaScript by One Week
  4. Add Seconds to a Date in Node.js and JavaScript
  5. Add Month(s) to a Date in JavaScript or Node.js
  6. Add Week(s) to a Date in JavaScript or Node.js
  7. Get the Current Year in JavaScript or Node.js
  8. How to Get a UNIX Timestamp in JavaScript or Node.js
  9. How to Convert a UNIX Timestamp to a Date in JavaScript or Node.js
  10. Add Days to a Date in JavaScript or Node.js
  11. Get Yesterday's Date in JavaScript or Node.js
  12. Add Minutes to a Date in JavaScript or Node.js (Coming soon)
  13. Add Hours to a Date in JavaScript or Node.js (Coming soon)
  14. Check If a Date Is Today in JavaScript or Node.js (Coming soon)
  15. Check If a Date is Tomorrow in JavaScript or Node.js (Coming soon)
  16. Check If a Date is Yesterday in JavaScript or Node.js (Coming soon)
  17. How to Format a Date YYYY-MM-DD in JavaScript or Node.js (Coming soon)

Divide and Chunk an Array Into Smaller Arrays

This approach of dividing an array into smaller chunks assumes a fixed chunk size. For example, we want to split the array [1, 2, 3, 4, 5, 6, 7, 8] into chunks of three items. The result of chunking the source array should look like this:

[
  [1, 2, 3],
  [4, 5, 6],
  [7, 8]
]

JavaScript comes with the Array#splice method. The splice method removes items from an array and returns them as a new array. This way, you can remove the number of items from the source array until it’s empty.

Here’s a sample implementation for a chunk(items, size) function:

/**
 * Split the `items` array into multiple, smaller arrays of the given `size`.
 *
 * @param {Array} items
 * @param {Number} size
 *
 * @returns {Array[]}
 */
function chunk (items, size) {  
  const chunks = []
  items = [].concat(...items)

  while (items.length) {
    chunks.push(
      items.splice(0, size)
    )
  }

  return chunks
}

// Example

const items = [1, 2, 3, 4, 5, 6, 7, 8]

chunk(items, 3)  
// [ [1, 2, 3], [4, 5, 6], [7, 8] ]

The basic idea of this function is to remove items from the source array and push the removed elements array to the result array. The result contains all smaller chunks for further processing.

Use the @supercharge/collections Package

I’m the maintainer of the @supercharge/collections package providing convenient array utilities. This package comes with the .chunk(<size>) method splitting the given array into arrays of the given size.

Wrapping an array using the @supercharge/collections package creates a collection instance. You must end the chain with .all() to retrieve the underlying JavaScript array:

const Collect = require('@supercharge/collections')

Collect([1, 2, 3, 4, 5, 6, 7, 8]).chunk(3).all()  
// [ [1, 2, 3], [4, 5, 6], [7, 8] ]

Collect([1, 2, 3, 4, 5, 6, 7, 8]).chunk(15).all()  
// [ [1, 2, 3, 4, 5, 6, 7, 8] ]

Enjoy!


Mentioned Resources

Explore the Library

Find interesting tutorials and solutions for your problems.