Paging library - Boundary callback for network + db with API taking page and size

AndroidAndroid RoomAndroid Architecture-ComponentsAndroid LivedataAndroid Paging

Android Problem Overview


Short question:

What is the correct way to handle database + network on the Paging library from Architecture components, using an API that uses page + size to load a new page and the BoundaryCallback class?

Research and explanation

Currently the class BoundaryCallback used in the paging library for architecture components, receives as parameter the instance of an element in the list without actual context of where this element is at. It happens in onItemAtFrontLoaded and onItemAtEndLoaded.

My Api is supposed to receive the page and the size of the page to load the next chunk of data. Boundary callback, added as part of the paged list builder, is supposed to tell you when to load the next page of data based on prefetch distance and page size.

Since the Api needs the page number and the size of the page to provide, I don't see a way to send that to the Api just by receiving one of the elements from the list as offered in onItemAtFrontLoaded and onItemAtEndLoaded. Checking the google examples in this link, they use the name of the last element to get the next one, but that doesn't fit an Api with page + size.

They also have another example with only network that uses PagedKeyedDatasource, but there is no sample or clue on how to mix that with the database and the BoundaryCallback.

Edit: Only solutions I have found so far is to store the last loaded page on the shared preferences, but that sounds like a dirty trick.

Refer to https://github.com/googlesamples/android-architecture-components/issues/252#issuecomment-392119468 for official input on it.

Android Solutions


Solution 1 - Android

The documentation has this to say on the issue:

> If you aren't using an item-keyed network API, you may be using > page-keyed, or page-indexed. If this is the case, the paging library > doesn't know about the page key or index used in the BoundaryCallback, > so you need to track it yourself. You can do this in one of two ways: > > Local storage Page key > >If you want to perfectly resume your query, > even if the app is killed and resumed, you can store the key on disk. > Note that with a positional/page index network API, there's a simple > way to do this, by using the listSize as an input to the next load (or > listSize / NETWORK_PAGE_SIZE, for page indexing). The current list > size isn't passed to the BoundaryCallback though. This is because the > PagedList doesn't necessarily know the number of items in local > storage. Placeholders may be disabled, or the DataSource may not count > total number of items. > > Instead, for these positional cases, you can query the database for > the number of items, and pass that to the network. > > In-Memory Page key > > Often it doesn't make sense to query the next page > from network if the last page you fetched was loaded many hours or > days before. If you keep the key in memory, you can refresh any time > you start paging from a network source. Store the next key in memory, > inside your BoundaryCallback. When you create a new BoundaryCallback > when creating a new LiveData/Observable of PagedList, refresh data. > For example, in the Paging Codelab, the GitHub network page index is > stored in memory.

And links to an example Codelab: https://codelabs.developers.google.com/codelabs/android-paging/index.html#8

Solution 2 - Android

I have a similar API (pageNum + size), I have 2 extra fields in my data class, pageNum and pageSize with defaults 1 and PAGE_SIZE respectively.

If you're using Network+DB then you'll have onZeroItemsLoaded and onItemAtEndLoaded, In onZeroItemsLoaded send pageNum and pageSize as it is, and in onItemAtEndLoaded increment pageSize by 1 and then send.

Let's say you have a method fetchData(pageNum, pageSize) when you receive result in this just update the pageNum and pageSize accordingly in each item of this page.

Solution 3 - Android

I implement this:

PagedList.BoundaryCallback<Produto> boundaryCallbackNovidades = new PagedList.BoundaryCallback<Produto>(){
    int proxPagina;
    boolean jaAtualizouInicio=false;

    public void onZeroItemsLoaded() {
        requestProdutos(
            webService.pesquisarNovidadesDepoisDe(LocalDateTime.now().format(Util.formatterDataTime), 0, 20));
    }

    public void onItemAtFrontLoaded(@NonNull Produto itemAtFront) {
        if(!jaAtualizouInicio)
            requestProdutos(
                webService.pesquisarNovidadesMaisRecentesQue(itemAtFront.data.format(Util.formatterDataTime)));
        jaAtualizouInicio=true;
    }

    public void onItemAtEndLoaded(@NonNull Produto itemAtEnd) {
        requestProdutos(
            webService.pesquisarNovidadesDepoisDe(LocalDateTime.now().format(Util.formatterDataTime), proxPagina++, 20));
    }
};


public LiveData<PagedList<Produto>> getNovidades(){
    if(novidades==null){
        novidades = new LivePagedListBuilder<>(produtoDao.produtosNovidades(),
                10)
                .setBoundaryCallback(boundaryCallbackNovidades)
                .build();
    }
    return novidades;
}

Solution 4 - Android

Lets say you always fetch N=10 items per page from the server & then store it in db. You can get the number of items in db using the sql query SELECT COUNT(*) FROM tbl & store it in variable count. Now to get the page number that should be requested next, use:

val nextPage: Int = (count / N) + 1

Attributions

All content for this solution is sourced from the original question on Stackoverflow.

The content on this page is licensed under the Attribution-ShareAlike 4.0 International (CC BY-SA 4.0) license.

Content TypeOriginal AuthorOriginal Content on Stackoverflow
QuestiondroidplView Question on Stackoverflow
Solution 1 - AndroidLukeView Answer on Stackoverflow
Solution 2 - AndroidKashish SharmaView Answer on Stackoverflow
Solution 3 - Androidd3roch4View Answer on Stackoverflow
Solution 4 - AndroidrealpacView Answer on Stackoverflow