How to solve circular reference in json serializer caused by hibernate bidirectional mapping?

JavaHibernateJsonSerialization

Java Problem Overview


I am writing a serializer to serialize POJO to JSON but stuck in circular reference problem. In hibernate bidirectional one-to-many relation, parent references child and child references back to parent and here my serializer dies. (see example code below)
How to break this cycle? Can we get owner tree of an object to see whether object itself exists somewhere in its own owner hierarchy? Any other way to find if the reference is going to be circular? or any other idea to resolve this problem?

Java Solutions


Solution 1 - Java

I rely on Google JSON To handle this kind of issue by using The feature

> Excluding Fields From Serialization and Deserialization

Suppose a bi-directional relationship between A and B class as follows

public class A implements Serializable {

    private B b;

}

And B

public class B implements Serializable {

    private A a;

}

Now use GsonBuilder To get a custom Gson object as follows (Notice setExclusionStrategies method)

Gson gson = new GsonBuilder()
    .setExclusionStrategies(new ExclusionStrategy() {

        public boolean shouldSkipClass(Class<?> clazz) {
            return (clazz == B.class);
        }

        /**
          * Custom field exclusion goes here
          */
        public boolean shouldSkipField(FieldAttributes f) {
            return false;
        }

     })
    /**
      * Use serializeNulls method if you want To serialize null values 
      * By default, Gson does not serialize null values
      */
    .serializeNulls()
    .create();

Now our circular reference

A a = new A();
B b = new B();

a.setB(b);
b.setA(a);

String json = gson.toJson(a);
System.out.println(json);

Take a look at GsonBuilder class

Solution 2 - Java

Jackson 1.6 (released september 2010) has specific annotation-based support for handling such parent/child linkage, see http://wiki.fasterxml.com/JacksonFeatureBiDirReferences. (Wayback Snapshot)

You can of course already exclude serialization of parent link already using most JSON processing packages (jackson, gson and flex-json at least support it), but the real trick is in how to deserialize it back (re-create parent link), not just handle serialization side. Although sounds like for now just exclusion might work for you.

EDIT (April 2012): Jackson 2.0 now supports true identity references (Wayback Snapshot), so you can solve it this way also.

Solution 3 - Java

Can a bi-directional relationship even be represented in JSON? Some data formats are not good fits for some types of data modelling.

One method for dealing with cycles when dealing with traversing object graphs is to keep track of which objects you've seen so far (using identity comparisons), to prevent yourself from traversing down an infinite cycle.

Solution 4 - Java

In addressing this problem, I took the following approach (standardizing the process across my application, making the code clear and reusable):

  1. Create an annotation class to be used on fields you'd like excluded
  2. Define a class which implements Google's ExclusionStrategy interface
  3. Create a simple method to generate the GSON object using the GsonBuilder (similar to Arthur's explanation)
  4. Annotate the fields to be excluded as needed
  5. Apply the serialization rules to your com.google.gson.Gson object
  6. Serialize your object

Here's the code:

import java.lang.annotation.ElementType;
import java.lang.annotation.Retention;
import java.lang.annotation.RetentionPolicy;
import java.lang.annotation.Target;

@Retention(RetentionPolicy.RUNTIME)
@Target({ElementType.FIELD, ElementType.METHOD})
public @interface GsonExclude {

}

2)

import com.google.gson.ExclusionStrategy;
import com.google.gson.FieldAttributes;

public class GsonExclusionStrategy implements ExclusionStrategy{

	private final Class<?> typeToExclude;
	
	public GsonExclusionStrategy(Class<?> clazz){
		this.typeToExclude = clazz;
	}
	
	@Override
	public boolean shouldSkipClass(Class<?> clazz) {
		return ( this.typeToExclude != null && this.typeToExclude == clazz )
					|| clazz.getAnnotation(GsonExclude.class) != null;
	}

	@Override
	public boolean shouldSkipField(FieldAttributes f) {
		return f.getAnnotation(GsonExclude.class) != null;
	}

}

3)

static Gson createGsonFromBuilder( ExclusionStrategy exs ){
	GsonBuilder gsonbuilder = new GsonBuilder();
	gsonbuilder.setExclusionStrategies(exs);
	return gsonbuilder.serializeNulls().create();
}

4)

public class MyObjectToBeSerialized implements Serializable{

    private static final long serialVersionID = 123L;

    Integer serializeThis;
    String serializeThisToo;
    Date optionalSerialize;

    @GsonExclude
    @ManyToOne(fetch=FetchType.LAZY, optional=false)
    @JoinColumn(name="refobj_id", insertable=false, updatable=false, nullable=false)
    private MyObjectThatGetsCircular dontSerializeMe;

    ...GETTERS AND SETTERS...
}

5)

In the first case, null is supplied to the constructor, you can specify another class to be excluded - both options are added below

Gson gsonObj = createGsonFromBuilder( new GsonExclusionStrategy(null) );
Gson _gsonObj = createGsonFromBuilder( new GsonExclusionStrategy(Date.class) );

6)

MyObjectToBeSerialized _myobject = someMethodThatGetsMyObject();
String jsonRepresentation = gsonObj.toJson(_myobject);

or, to exclude the Date object

String jsonRepresentation = _gsonObj.toJson(_myobject);

Solution 5 - Java

If you are using Jackon to serialize, just apply @JsonBackReference to your bi-directinal mapping It will solve the circular reference problem.

Note : @JsonBackReference is used to solve the Infinite recursion (StackOverflowError)

Solution 6 - Java

Used a solution similar to Arthur's but instead of setExclusionStrategies I used

Gson gson = new GsonBuilder()
				.excludeFieldsWithoutExposeAnnotation()
				.create();

and used @Expose gson annotation for fields which I need in the json, other fields are excluded.

Solution 7 - Java

if you are using spring boot,Jackson throws error while creating response from circular/bidirectional data, so use

> @JsonIgnoreProperties

to ignore circularity

At Parent:
@OneToMany(mappedBy="dbApp")
@JsonIgnoreProperties("dbApp")
private Set<DBQuery> queries;

At child:
@ManyToOne
@JoinColumn(name = "db_app_id")
@JsonIgnoreProperties("queries")
private DBApp dbApp;

Solution 8 - Java

If you are using Javascript, there's a very easy solution to that using the replacer parameter of JSON.stringify() method where you can pass a function to modify the default serialization behavior.

Here's how you can use it. Consider the below example with 4 nodes in a cyclic graph.

// node constructor
function Node(key, value) {
	this.name = key;
	this.value = value;
	this.next = null;
}

//create some nodes
var n1 = new Node("A", 1);
var n2 = new Node("B", 2);
var n3 = new Node("C", 3);
var n4 = new Node("D", 4);

// setup some cyclic references
n1.next = n2;
n2.next = n3;
n3.next = n4;
n4.next = n1;

function normalStringify(jsonObject) {
	// this will generate an error when trying to serialize
	// an object with cyclic references
	console.log(JSON.stringify(jsonObject));
}

function cyclicStringify(jsonObject) {
	// this will successfully serialize objects with cyclic
	// references by supplying @name for an object already
	// serialized instead of passing the actual object again,
    // thus breaking the vicious circle :)
	var alreadyVisited = [];
    var serializedData = JSON.stringify(jsonObject, function(key, value) {
        if (typeof value == "object") {
            if (alreadyVisited.indexOf(value.name) >= 0) {
                // do something other that putting the reference, like 
                // putting some name that you can use to build the 
                // reference again later, for eg.
                return "@" + value.name;
            }
            alreadyVisited.push(value.name);
        }
        return value;
    });
    console.log(serializedData);
}

Later, you can easily recreate the actual object with the cyclic references by parsing the serialized data and modifying the next property to point to the actual object if it's using a named reference with a @ like in this example.

Solution 9 - Java

This is how i finally solved it in my case. This works at least with Gson & Jackson.

private static final Gson gson = buildGson();
	
private static Gson buildGson() {
	return new GsonBuilder().addSerializationExclusionStrategy( getExclusionStrategy() ).create();	
}

private static ExclusionStrategy getExclusionStrategy() {
	ExclusionStrategy exlStrategy = new ExclusionStrategy() {
		@Override
		public boolean shouldSkipField(FieldAttributes fas) {
			return ( null != fas.getAnnotation(ManyToOne.class) );
		}
		@Override
		public boolean shouldSkipClass(Class<?> classO) {
			return ( null != classO.getAnnotation(ManyToOne.class) );
		}
	};
	return exlStrategy;
} 

Solution 10 - Java

This error can appened when you have two objects :

class object1{
    private object2 o2;
}

class object2{
    private object1 o1;
}

With using GSon for serialization, i have got this error :

java.lang.IllegalStateException: circular reference error

Offending field: o1

To solved this, just add key word transient :

class object1{
    private object2 o2;
}

class object2{
    transient private object1 o1;
}

As you can see here : https://stackoverflow.com/questions/910374/why-does-java-have-transient-fields

> The transient keyword in Java is used to indicate that a field should not be serialized.

Solution 11 - Java

Jackson provides JsonIdentityInfo annotation to prevent circular references. You can check the tutorial here.

Solution 12 - Java

If you use GSON to convert Java class in JSON you can avoid the fields that cause the circular reference and the infinitive loop, you only have to put the annotation @Expose in the fields that you want to appear in the JSON, and the fields without the annotation @Expose do not appear in the JSON.

The circular reference appears for example if we try to serialize the class User with the field routes of class Route, and the class Route have the field user of the class User, then GSON try to serialize the class User and when try to serialize routes, serialize the class Route and in the class Route try to serialize the field user, and again try to serialize the class User, there is a circular reference that provoke the infinitive loop. I show the class User and Route that mentioned.

import com.google.gson.annotations.Expose;

Class User

@Entity
@Table(name = "user")
public class User {
    
@Column(name = "name", nullable = false)
@Expose
private String name;

@OneToMany(mappedBy = "user", fetch = FetchType.EAGER)
@OnDelete(action = OnDeleteAction.CASCADE)
private Set<Route> routes;

@ManyToMany(fetch = FetchType.EAGER)
@OnDelete(action = OnDeleteAction.CASCADE)
@JoinTable(name = "like_", joinColumns = @JoinColumn(name = "id_user"),
        inverseJoinColumns = @JoinColumn(name = "id_route"),
        foreignKey = @ForeignKey(name = ""),
        inverseForeignKey = @ForeignKey(name = ""))
private Set<Route> likes;

Class Route

  @Entity
  @Table(name = "route")
  public class Route {
      
  @ManyToOne()
  @JoinColumn(nullable = false, name = "id_user", foreignKey = 
  @ForeignKey(name = "c"))    
  private User user;

To avoid the infinitive loop, we use the annotation @Expose that offer GSON.

I show in format JSON the result of serialize with GSON the class User.

{
    "name": "ignacio"  
}

We can see that the field route and likes do not exist in the format JSON, only the field name. Because of this, the circular reference is avoid.

If we want to use that, we have to create an object GSON on a specific way.

Gson converterJavaToJson = new GsonBuilder().setPrettyPrinting().excludeFieldsWithoutExposeAnnotation().create();

In the end, we transform the java class of the model of hibernate user using the conversor GSON created.

 User user = createUserWithHibernate();
 String json = converterJavaToJson.toJson(user);

Solution 13 - Java

the answer number 8 is the better, i think so if you know what field is throwing a error the you only set the fild in null and solved.

List<RequestMessage> requestMessages = lazyLoadPaginated(first, pageSize, sortField, sortOrder, filters, joinWith);
	for (RequestMessage requestMessage : requestMessages) {
		Hibernate.initialize(requestMessage.getService());
		Hibernate.initialize(requestMessage.getService().getGroupService());
		Hibernate.initialize(requestMessage.getRequestMessageProfessionals());
		for (RequestMessageProfessional rmp : requestMessage.getRequestMessageProfessionals()) {
			Hibernate.initialize(rmp.getProfessional());
			rmp.setRequestMessage(null); // **
		}
	}

To make the code readable a big comment is moved from the comment // ** to below.

> java.lang.StackOverflowError [Request processing failed; nested exception is org.springframework.http.converter.HttpMessageNotWritableException: Could not write JSON: Infinite recursion (StackOverflowError) (through reference chain: com.service.pegazo.bo.RequestMessageProfessional["requestMessage"]->com.service.pegazo.bo.RequestMessage["requestMessageProfessionals"]

Solution 14 - Java

For example, ProductBean has got serialBean. The mapping would be bi-directional relationship. If we now try to use gson.toJson(), it will end up with circular reference. In order to avoid that problem, you can follow these steps:

  1. Retrieve the results from datasource.
  2. Iterate the list and make sure the serialBean is not null, and then
  3. Set productBean.serialBean.productBean = null;
  4. Then try to use gson.toJson();

That should solve the problem

Attributions

All content for this solution is sourced from the original question on Stackoverflow.

The content on this page is licensed under the Attribution-ShareAlike 4.0 International (CC BY-SA 4.0) license.

Content TypeOriginal AuthorOriginal Content on Stackoverflow
QuestionWSKView Question on Stackoverflow
Solution 1 - JavaArthur RonaldView Answer on Stackoverflow
Solution 2 - JavaStaxManView Answer on Stackoverflow
Solution 3 - Javamatt bView Answer on Stackoverflow
Solution 4 - JavaeugeneView Answer on Stackoverflow
Solution 5 - JavaPraveen ShendgeView Answer on Stackoverflow
Solution 6 - JavagndpView Answer on Stackoverflow
Solution 7 - JavaU_R_Naveen UR_NaveenView Answer on Stackoverflow
Solution 8 - JavaabhishekcghoshView Answer on Stackoverflow
Solution 9 - JavapirhoView Answer on Stackoverflow
Solution 10 - JavaKevin ABRIOUXView Answer on Stackoverflow
Solution 11 - JavaAnkur MahajanView Answer on Stackoverflow
Solution 12 - JavaIgnacio Marín ReyesView Answer on Stackoverflow
Solution 13 - JavaMarcelCHView Answer on Stackoverflow
Solution 14 - JavaDon Bosco RView Answer on Stackoverflow