very slow importing via cifs

As we transition to the new Hyland Community, some post links may be temporarily disrupted as we finalize redirects. We apologize for the inconvenience and are working to resolve this as quickly as possible. Details.

stegbth

hi,

i upgraded an Alfresco Commuity 3.4b to 4.0e, still with lucene index.
The machine is a Ubuntu 10.04 with Mysql database.

i have to import about 20000PDF documents (each aboul 200kb).
This should (and is currently) run via cifs.

in the last 3hours it imported about 20files.

I already defined background indexing:

#
# Index Recovery Mode
#————-
index.recovery.mode=AUTO
#index.recovery.mode=FULL


### Solr indexing ###
#index.subsystem.name=solr
#dir.keystore=${dir.root}/keystore
#solr.port.ssl=8443

index.subsystem.name=lucene
dir.keystore=${dir.root}/keystore
# scaleup Bulkload, see: http://de.slideshare.net/alfresco/scale-your-alfresco-solutions
index.tracking.disableInTransactionIndexing=true
lucene.maxAtomicTransformationTime=0
index.tracking.cronExpression=0/5 * * * * ?
system.enableTimestampPropagation=false
‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

but after importing the load of mysql grows up and stays at 199% CPU usage and aboud 2GB VirtMemory usage.

But i assume there must be some Mysql performancetuning i forgot. here are some parts from my.cnf.

key_buffer              = 1024M
max_allowed_packet      = 32M 
thread_stack            = 256K
thread_cache_size       = 8
# This replaces the startup script and checks MyISAM tables if needed
# the first time they are touched
myisam-recover         = BACKUP
#max_connections        = 100
#table_cache            = 64
#thread_concurrency     = 10
#
# * Query Cache Configuration
#
query_cache_limit       = 192M
query_cache_size        = 768M

‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍

hopefully somebody can point me to my error.
thomas

stegbth

also monitoring the system with top
only one process is running (mysqld), also java is sleeping,

when running mysqladmin processlist -p i get

mysqladmin processlist -p
Enter password: 
+—–+———-+—————–+——————+———+——+————–+——————————————————————————————————+
| Id  | User     | Host            | db               | Command | Time | State        | Info                                                                                                 |
+—–+———-+—————–+——————+———+——+————–+——————————————————————————————————+
| 82  | alfresco | localhost:42514 | alfresco40e_lat1 | Query   | 646  | Sending data | select
            assoc.id                    as id,
            parentNode.id               as par |
| 83  | alfresco | localhost:42515 | alfresco40e_lat1 | Query   | 768  | Sending data | select
            assoc.id                    as id,
            parentNode.id               as par |
| 84  | alfresco | localhost:42516 | alfresco40e_lat1 | Query   | 970  | Sending data | select
            assoc.id                    as id,
            parentNode.id               as par |
| 85  | alfresco | localhost:42517 | alfresco40e_lat1 | Query   | 869  | Sending data | select
            assoc.id                    as id,
            parentNode.id               as par |
| 86  | alfresco | localhost:42518 | alfresco40e_lat1 | Query   | 21   | Sending data | select
            assoc.id                    as id,
            parentNode.id               as par |
| 87  | alfresco | localhost:42519 | alfresco40e_lat1 | Query   | 263  | Sending data | select
            assoc.id                    as id,
            parentNode.id               as par |
| 88  | alfresco | localhost:42520 | alfresco40e_lat1 | Query   | 528  | Sending data | select
            assoc.id                    as id,
            parentNode.id               as par |
| 89  | alfresco | localhost:42521 | alfresco40e_lat1 | Query   | 190  | Sending data | select
            assoc.id                    as id,
            parentNode.id               as par |
| 90  | alfresco | localhost:42522 | alfresco40e_lat1 | Query   | 994  | Sending data | select
            assoc.id                    as id,
            parentNode.id               as par |
| 92  | alfresco | localhost:42547 | alfresco40e_lat1 | Query   | 587  | Sending data | select
            assoc.id                    as id,
            parentNode.id               as par |
| 93  | alfresco | localhost:42552 | alfresco40e_lat1 | Query   | 475  | Sending data | select
            assoc.id                    as id,
            parentNode.id               as par |
| 94  | alfresco | localhost:42555 | alfresco40e_lat1 | Sleep   | 4    |              |                                                                                                      |
| 95  | alfresco | localhost:42556 | alfresco40e_lat1 | Query   | 354  | Sending data | select
            assoc.id                    as id,
            parentNode.id               as par |
| 96  | alfresco | localhost:42558 | alfresco40e_lat1 | Query   | 1015 | Sending data | select
            assoc.id                    as id,
            parentNode.id               as par |
| 97  | alfresco | localhost:42559 | alfresco40e_lat1 | Query   | 302  | Sending data | select
            assoc.id                    as id,
            parentNode.id               as par |
| 98  | alfresco | localhost:42560 | alfresco40e_lat1 | Sleep   | 64   |              |                                                                                                      |
| 99  | alfresco | localhost:42561 | alfresco40e_lat1 | Query   | 226  | Sending data | select
            assoc.id                    as id,
            parentNode.id               as par |
| 100 | alfresco | localhost:42567 | alfresco40e_lat1 | Query   | 163  | Sending data | select
            assoc.id                    as id,
            parentNode.id               as par |
| 101 | alfresco | localhost:42568 | alfresco40e_lat1 | Query   | 133  | Sending data | select
            assoc.id                    as id,
            parentNode.id               as par |
| 103 | alfresco | localhost:42574 | alfresco40e_lat1 | Query   | 104  | Sending data | select
            assoc.id                    as id,
            parentNode.id               as par |
| 104 | alfresco | localhost:42577 | alfresco40e_lat1 | Query   | 72   | Sending data | select
            assoc.id                    as id,
            parentNode.id               as par |
| 105 | alfresco | localhost:42578 | alfresco40e_lat1 | Query   | 45   | Sending data | select
            assoc.id                    as id,
            parentNode.id               as par |
| 106 | alfresco | localhost:42582 | alfresco40e_lat1 | Query   | 939  | Sending data | select
            assoc.id                    as id,
            parentNode.id               as par |
| 107 | alfresco | localhost:42584 | alfresco40e_lat1 | Sleep   | 64   |              |                                                                                                      |
| 108 | alfresco | localhost:42587 | alfresco40e_lat1 | Query   | 916  | Sending data | select
            assoc.id                    as id,
            parentNode.id               as par |
| 109 | alfresco | localhost:42589 | alfresco40e_lat1 | Sleep   | 1264 |              |                                                                                                      |
| 110 | alfresco | localhost:42591 | alfresco40e_lat1 | Sleep   | 3    |              |                                                                                                      |
| 111 | alfresco | localhost:42599 | alfresco40e_lat1 | Sleep   | 7878 |              |                                                                                                      |
| 114 | alfresco | localhost:42654 | alfresco40e_lat1 | Query   | 695  | Sending data | select
            assoc.id                    as id,
            parentNode.id               as par |
| 115 | alfresco | localhost:42655 | alfresco40e_lat1 | Sleep   | 7878 |              |                                                                                                      |
| 116 | alfresco | localhost:42656 | alfresco40e_lat1 | Query   | 375  | Sending data | select
            assoc.id                    as id,
            parentNode.id               as par |
| 117 | alfresco | localhost:42657 | alfresco40e_lat1 | Query   | 332  | Sending data | select
            assoc.id                    as id,
            parentNode.id               as par |
| 118 | alfresco | localhost:42663 | alfresco40e_lat1 | Sleep   | 7878 |              |                                                                                                      |
| 119 | alfresco | localhost:42664 | alfresco40e_lat1 | Sleep   | 7878 |              |                                                                                                      |
| 120 | alfresco | localhost:42665 | alfresco40e_lat1 | Sleep   | 7878 |              |                                                                                                      |
| 121 | alfresco | localhost:42666 | alfresco40e_lat1 | Sleep   | 7878 |              |                                                                                                      |
| 122 | alfresco | localhost:42667 | alfresco40e_lat1 | Sleep   | 7878 |              |                                                                                                      |
| 123 | alfresco | localhost:42668 | alfresco40e_lat1 | Sleep   | 7878 |              |                                                                                                      |
| 124 | alfresco | localhost:42669 | alfresco40e_lat1 | Sleep   | 7878 |              |                                                                                                      |
| 127 | root     | localhost       |                  | Query   | 0    |              | show processlist                                                                                     |
+—–+———-+—————–+——————+———+——+————–+——————————————————————————————————+
‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍