nav[aria-label="Primary Navigation"] { padding: 0; & ul { list-style: none; width: 100%; display: flex; flex-direction: row; justify-content: start; align-items: start; gap: 30px; padding: 0; & li { margin: 0; } & ul li { list-style: none; } } }

As we transition to the new Hyland Community, some post links may be temporarily disrupted as we finalize redirects. We apologize for the inconvenience and are working to resolve this as quickly as possible. Details.

How to exceed Lucene Limit Search?

razieltd

Hi!

Is it possible with a ws java-backed research by lucene an unlimited number of nodes?
Now if i try to reseach in a store that contains 1100 nodes, the results list contains only 1000

I found this code:

SearchParameters sp = new SearchParameters();
sp.setLanguage(SearchService.LANGUAGE_LUCENE);
sp.setQuery("PATH:\"/*\"");
sp.addStore(StoreRef.STORE_REF_WORKSPACE_SPACESSTORE);
sp.setLimitBy(LimitBy.FINAL_SIZE);
sp.setLimit(1100);
rs=searchService.query(sp);

but nothing… if i try with sp.setLimit(10); work and my result list length is 10 but if i try with any value more higher then 1000 dont work…

why?

Find more posts tagged with

Comments

mrogers

Because the number of permission checks and the time to search are also limited. You will find other threads discussing how to change this if you search these forums.

razieltd

Thank you for the answare. But can i ask you a favor? can you post me some of these threads? Because when iam searching i found only solution that dont work (probably i did not understand :roll: ).

Now iam trying to implement in my webscript (java-baked) something like this

&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;int batchSize = 10;
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;QueryConfiguration queryCfg = new QueryConfiguration();
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;queryCfg.setFetchSize(batchSize);
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;RepositoryServiceSoapBindingStub repositoryService = WebServiceFactory.getRepositoryService();
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;repositoryService.setHeader(new RepositoryServiceLocator().getServiceName().getNamespaceURI(), "QueryHeader", queryCfg);
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Query query=new Query(SearchService.LANGUAGE_LUCENE,"PATH:\"/*\"");
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Store store=new Store();
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;store.setScheme("archive");
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;store.setAddress("SpacesStore");
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;QueryResult result =repositoryService.query(store, query, true);
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;//process the first query result
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;String querySession = result.getQuerySession();
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;while (querySession != null) {
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; result = repositoryService.fetchMore(querySession);
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; querySession = result.getQuerySession();
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;}
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;int size=(int)result.getResultSet().getTotalRowCount();
‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

but dont work.

Thx a lot

razieltd

???

darryl_staflund

Hi there,

Here is an example of how I disable this limit in Java:

package com.companyname.alfresco.common.daos.impl;

import static java.lang.String.format;

import java.util.List;

import org.alfresco.model.ContentModel;
import org.alfresco.service.cmr.repository.NodeRef;
import org.alfresco.service.cmr.repository.StoreRef;
import org.alfresco.service.cmr.search.LimitBy;
import org.alfresco.service.cmr.search.ResultSet;
import org.alfresco.service.cmr.search.SearchParameters;
import org.alfresco.service.cmr.search.SearchService;
import org.springframework.beans.factory.annotation.Required;
import org.springframework.stereotype.Component;

import com.companyname.alfresco.common.daos.SearchDao;

@Component
public final class SearchDaoImpl implements SearchDao {
   private SearchService searchService;

   @Required
   public void setSearchService(final SearchService service) {
      searchService = service;
   }

   @Override
   public List<NodeRef> searchForContentNode(final NodeRef nodeRef) {
      final SearchParameters params = getSearchParameters(nodeRef);

      ResultSet resultSet = null;

      try {
         resultSet = searchService.query(params);
         return resultSet.getNodeRefs();
      }

      finally {
         if (resultSet != null) {
            resultSet.close();
         }
      }
   }

   private SearchParameters getSearchParameters(final NodeRef nodeRef) {
      final SearchParameters params = new SearchParameters();
      params.addStore(StoreRef.STORE_REF_WORKSPACE_SPACESSTORE);
      params.setLanguage(SearchService.LANGUAGE_LUCENE);
      params.setQuery(format(QUERY_PATTERN, ContentModel.TYPE_CONTENT, nodeRef));
      params.setLimitBy(LimitBy.UNLIMITED);
      params.setLimit(0);
      params.setMaxPermissionChecks(100000);
      params.setMaxPermissionCheckTimeMillis(100000);
      params.setMaxItems(-1);
      return params;
   }
}


‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

I hope it's helpful.

Darryl

razieltd

Thank you so much!

but when i try to implement this code i receive this exception in my ws

Message:   org.alfresco.service.cmr.search.SearchParameters.setMaxPermissionChecks(I)V

Exception:   java.lang.NoSuchMethodError - org.alfresco.service.cmr.search.SearchParameters.setMaxPermissionChecks(I)V

:shock:   :shock:   :shock:

what can i do?

EDIT:

i receive this exception with these 3 methods:
            …
         params.setMaxPermissionChecks(100000);
         params.setMaxPermissionCheckTimeMillis(100000);
         params.setMaxItems(-1);

:shock:

mrogers

What version are you using?

razieltd

Alfresco 3.1

razieltd

No solutions for this problem?

There is another method that can i use for bypass the limit?

Thx :?

razieltd

Ehmmm… someone have the solution? or another way for this?

Thx

razieltd

Ok guys! if there is no way with this SearchParameters how can i fetch result set??

Thx

razieltd

i see that there is another method in the SearchParameters

.setBulkFetch(true);
i think in combination with this other
.setBulkFetchSize(1000);

but dont work :?

It is correct to use these methods for Alfresco 3.1 ? and How can i use it?

Pls Somebody can Helpme?

Thx

mrogers

You certainly don't want to play with bulk fetch size.

Have you tried setting
system.acl.maxPermissionCheckTimeMillis
system.acl.maxPermissionCheck

in your custom-repository.properties file?

And isn't it obvious that setMaxPermissionChecks does not exist on 3.1? What sort of development environment do you have that doesn't highlight that instantly? In particular make sure you are using the right version of the SDK for the code you are developing.

razieltd

Thank you for the answare

If is it possible i want to do it without modify any file.
and yes it is obvious that setMaxPermissionChecks does not exist on 3.1, iam sorry in the previous post i explained bad :roll: . iam using 3.1SDK with eclipse

but now want can i do for break this limit without modify the properties file?

Thx a lot

razieltd

So…. is it possible with 3.1??? and if yes how without modify any file?

mrogers

No I don't think its possible without modifying your configuration. What's your objection to changing config?

razieltd

Simple

- i cant! Because we have several webscript for searching nodes and a lot of these are used by our users and this limit (1000 record) is useful. But some ws in particular this i'm developing in only for powerUser (not many around 5-7) and we need some statistics for example, and i cant get all node with a query lucene but only 1000 and in some spece there are 20000-30000.

For example if i want to know the exact number of nodes in a particular space i do my query lucene and i obtain the resultSet.size(). but if i have this limit what kind of research i can do? or there is another way to know this information?

iam thinking if is it possible to operate with the native code of lucene and bypass SearchParameter, searchService ect..
because when i do my search with searchService, at some point, there is some use of lib lucene that execute the query… :roll:

however thx for your help

mrogers

It would probably be easier to upgrade to a more recent version of Alfresco

mrogers

To find the number of nodes in a space there's no need to touch lucene at all!

Use the FileFolderService or NodeService directly.

Or run a SQL query directly. Or CQL.

razieltd

:shock:

Thx!

I apologize for my ignorance

can you show me how to use a query sql (tables)? I did not know that i can use in alfresco

.

Thx so much

unknown

:shock:

Thx!

I apologize for my ignorance can you show me how to use a query sql (tables)? I did not know that i can use in alfresco .

Thx so much

I had the same question, Raziel. Never a stupid question! Well, maybe sometimes

Thanks for the tip!