As we transition to the new Hyland Community, some post links may be temporarily disrupted as we finalize redirects. We apologize for the inconvenience and are working to resolve this as quickly as possible. Details.
Are instructions/scripts available for running Nuxeo Navigation on large-scale storage Benchmark? How were the Funkload scripts configured? Also, was nuxeo-platform-importer used to load the data or was it loaded via SQL scripts? If nuxeo-platform-importer was used, how was it configured?
Hi,
Yes import was done using the nuxeo-platform-importer with file of 100k, you can find some more information on this report Navigation on large-scale storage.
The database was tuned for doing mass import and the import was done around 50 docs/s.
Using SQL injection you can do that much faster ~2000 docs/s, you can find some example of python script in my github gist.
Also all those numbers refer to old hardware (2006) and software, I bet that with PG 9.2 using SSD drive you can get at least one order of magnitude faster.
Specifically, how was the nuxeo-platform-importer configured/driven to accomplish the mass importation of 3m/10m documents?
