Java 8: Parallel FOR loop

JavaFor LoopConcurrencyjava.util.concurrentConcurrent Programming

Java Problem Overview


I have heard Java 8 provides a lot of utilities regarding concurrent computing. Therefore I am wondering what is the simplest way to parallelise the given for loop?

public static void main(String[] args)
{
	Set<Server> servers = getServers();
	Map<String, String> serverData = new ConcurrentHashMap<>();
	
	for (Server server : servers)
	{
		String serverId = server.getIdentifier(); 
		String data = server.fetchData();
		
		serverData.put(serverId, data);
	}
}

Java Solutions


Solution 1 - Java

Read up on streams, they're all the new rage.

Pay especially close attention to the bit about parallelism:

>"Processing elements with an explicit for-loop is inherently serial. Streams facilitate parallel execution by reframing the computation as a pipeline of aggregate operations, rather than as imperative operations on each individual element. All streams operations can execute either in serial or in parallel."

So to recap, there are no parallel for-loops, they're inherently serial. Streams however can do the job. Take a look at the following code:

    Set<Server> servers = getServers();
    Map<String, String> serverData = new ConcurrentHashMap<>();

    servers.parallelStream().forEach((server) -> {
        serverData.put(server.getIdentifier(), server.fetchData());
    });

Solution 2 - Java

That would be using a Stream:

servers.parallelStream().forEach(server -> {
    serverData.put(server.getIdentifier(), server.fetchData());
});

I suspect a Collector can be used to greater effect here, since you use a concurrent collection.

Solution 3 - Java

More elegant or functional solution will be just using Collectors toMap or toConcurrentMap function, which avoid maintaining another stateful variable for ConcurrentHashMap, as following example:

final Set<Server> servers = getServers();
Map<String, String> serverData = servers.parallelStream().collect(
    toConcurrentMap(Server::getIdentifier, Server::fetchData));

Note:

  1. Those functional interfaces (Server::getIdentifier or Server::fetchData) doesn't allow throw checked exception here,
  2. To get the full benefits of parallel stream, the number of servers would be large and there is no I/O involved, purely data processing in those functions(getIdentifier, fetchData)

Please refer to Collectors javadoc at http://docs.oracle.com/javase/8/docs/api/java/util/stream/Collectors.html#toConcurrentMap

Solution 4 - Java

Simple example to copy'n'paste (the examples above use the class Server which is a custom class written by the OP):

import java.io.Console;
import java.util.ArrayList;

ArrayList<String> list = new ArrayList<>();
list.add("Item1");
list.add("Item2");
list.parallelStream().forEach((o) -> {
    System.out.print(o);
});

Console output. The order could possibly vary as everything executes in parallel:

Item1
Item2

The .parallelStream() method was introduced in Java v8. This example was tested with JDK v1.8.0_181.

Solution 5 - Java

using my Parallel.For, your code might look like the following,

public staic void main(String[] args)
{
    Set<Server> servers = getServers();
    Map<String, String> serverData = new ConcurrentHashMap<>();

    Parallel.ForEach(servers, new LoopBody<Server>()
    {
        public void run(Server server)
        {
             String serverId = server.getIdentifier(); 
             String data = server.fetchData();

             serverData.put(serverId, data);
        }
    });
}     

Attributions

All content for this solution is sourced from the original question on Stackoverflow.

The content on this page is licensed under the Attribution-ShareAlike 4.0 International (CC BY-SA 4.0) license.

Content TypeOriginal AuthorOriginal Content on Stackoverflow
QuestionJoe InnerView Question on Stackoverflow
Solution 1 - JavaReinstate MonicaView Answer on Stackoverflow
Solution 2 - JavafgeView Answer on Stackoverflow
Solution 3 - Javazd333View Answer on Stackoverflow
Solution 4 - JavaContangoView Answer on Stackoverflow
Solution 5 - JavaWeimin XiaoView Answer on Stackoverflow