Reducing and accumulating numpy arrays


Martin McBride, 2021-02-27
Tags arrays data types vectorisation
Categories numpy

A reducing function takes a collection of values and calculates a single representative value. Standard Pythion has a number of built-in reducing functions that work with lists and other sequences:

  • sum calculates the sum of all the elements (ie adds them all together).
  • max gives the largest element.
  • all is true if every element is true, false if one or more are false.

NumPy allows to reduce using any binary ufunc.

Reducing

To explain how reduce works, we will take the example of calculating the sum of all elements in an array. To calculate this, you would add the first two numbers, then add the third number to the total, then the fourth number and so on.

Here is how we do this in NumPy:

a = np.array([1, 2, 3, 4])
b = np.add.reduce(a)

In this case, reduce is actually a method of the np.add function. That might seem odd at first, but remember that in Python, functions are objects, and a function object can have methods of its own.

The reduce method of the add function start with the value 0 and adds each element of the array, one by one. This calculates 0 + 1 + 2 + 3 + 4, the sum of all elements.

You can use reduce with many other ufuncs. For example, this code calculates the product of all the elements:

a = np.array([1, 2, 3, 4])
b = np.mul.reduce(a)

mul.reduce start with 1 and multiples the elements one by one, giving 1 * 1 * 2 * 3 * 4.

Some reductions are so commonly used that NumPy provides short names that you can use instead:

  • sum for add.reduce.
  • product for mul.reduce.
  • alltrue for and.reduce.
  • sometrue for or.reduce.

5.4.2 Accumulation

Accumulation is a bit like reduction, but the result is a running total array, rather than a single value. For example:

a = np.array([1, 2, 3, 4])
b = np.add.accumulate(a)

Gives:

b = [ 1  3  6 10]

The values in the array are 1, 1+2, 1+2+3, 1+2+3+4.

You can use the short name cumsum for add.accumulate, and cumproduct for product.accumulate.

Visit the PythonInformer Discussion Forum for numeric Python.

If you found this article useful, you might be interested in the book NumPy Recipes or other books by the same author.

Prev
Next

Popular tags

2d arrays abstract data type alignment and animation arc array arrays bezier curve built-in function callable object circle classes close closure cmyk colour comparison operator comprehension context context manager conversion creational pattern data types design pattern device space dictionary drawing duck typing efficiency else encryption enumerate fill filter font font style for loop function function composition function plot functools game development generativepy tutorial generator geometry gif gradient greyscale higher order function hsl html image image processing imagesurface immutable object index inner function input installing iter iterable iterator itertools l system lambda function len line linspace list list comprehension logical operator lru_cache magic method mandelbrot mandelbrot set map monad mutability named parameter numeric python numpy object open operator optional parameter or partial application path polygon positional parameter print pure function pycairo radial gradient range recipes rectangle recursion reduce rgb rotation scaling sector segment sequence singleton slice slicing sound spirograph sprite square str stream string stroke subpath symmetric encryption template text text metrics tinkerbell fractal transform translation transparency tuple turtle unpacking user space vectorisation webserver website while loop zip