searching in mailcow

Hi,

does someone have any tips into solving search issues , or mailcow staff can indicate is fixable with a support contract ?

I import 1 mailbox into the cow. About 6 GB and 49k e-mails. Solr set to 6GB heap , the server has 16 GB and 6 cores (AMD EPYC 7282) hosted vps.

Searching in sogo i get different results almost every time, but most frustrating it seems to quit at random.
ui says : An error occured while communicating with the mail server
See logs below.

`mailcowdockerized-sogo-mailcow-1 | Dec 2 17:48:00 2dc78e2e56f1 sogod [58]: [ERROR] <0×0×55d364330070[NGImap4Connection]> could not select URL: imap://mayk%40mayk.org@172.22.1.250/INBOX/Archief/2010/?tls=NO&tlsVerifyMode=none: {RawResponse = "{ResponseResult = {description = \“Mailbox doesn’t exist: INBOXArchief2010 (0.001 + 0.001 secs).\”; result = no; tagId = 4; }; }"; reason = “Mailbox doesn’t exist: INBOXArchief2010 (0.001 + 0.001 secs).”; result = 0; }

mailcowdockerized-sogo-mailcow-1 | Dec 2 17:50:42 2dc78e2e56f1 sogod [58]: [ERROR] <0×0×55d367297910[NGImap4Connection]> could not select URL: imap://mayk%40mayk.org@172.22.1.250/INBOX/Archief/2004/?tls=NO&tlsVerifyMode=none: {RawResponse = "{ResponseResult = {description = \“Mailbox doesn’t exist: INBOXArchief2004 (0.002 + 0.000 + 0.001 secs).\”; result = no; tagId = 4; }; }"; reason = “Mailbox doesn’t exist: INBOXArchief2004 (0.002 + 0.000 + 0.001 secs).”; result = 0; }

mailcowdockerized-sogo-mailcow-1 | Dec 2 17:52:46 2dc78e2e56f1 sogod [58]: [ERROR] <0×0×55d363cc2650[NGImap4Connection]> could not select URL: imap://mayk%40mayk.org@172.22.1.250/INBOX/Archief/2015/?tls=NO&tlsVerifyMode=none: {RawResponse = "{ResponseResult = {description = \“Mailbox doesn’t exist: INBOXArchief2015 (0.002 + 0.000 + 0.001 secs).\”; result = no; tagId = 4; }; }"; reason = “Mailbox doesn’t exist: INBOXArchief2015 (0.002 + 0.000 + 0.001 secs).”; result = 0; }

mailcowdockerized-sogo-mailcow-1 | Dec 2 17:53:39 2dc78e2e56f1 sogod [58]: [ERROR] <0×0×55d363effa20[NGImap4Connection]> could not select URL: imap://mayk%40mayk.org@172.22.1.250/INBOX/Archief/2006/?tls=NO&tlsVerifyMode=none: {RawResponse = "{ResponseResult = {description = \“Mailbox doesn’t exist: INBOXArchief2006 (0.002 + 0.001 + 0.001 secs).\”; result = no; tagId = 4; }; }"; reason = “Mailbox doesn’t exist: INBOXArchief2006 (0.002 + 0.001 + 0.001 secs).”; result = 0; }`

I can open and read mails in these folders.. Sometimes the search finishes and maybe once in 20 - 30 attempts i get the same results as i get on the old kopano server (results vary based on search term).

Testing from iphone with imap connection results also seem to vary, again based on search term.

i tried rescanning and stuff
docker compose exec dovecot-mailcow doveadm fts rescan -A
docker-compose exec dovecot-mailcow doveadm -v index -A '*'

I pulled in a different account , same results.

I tried migrating the mailbox not by syncjob, but trough copy paste in Thunderbird, same results
I tried migrating the mailbox trough evolution mail (imap) , same results
This to eliminate maybe something funky with the imap gateway on the source maybe ?

To try and eliminate the vps, i also tried locally with a kvm on my laptop, set to 12 GB, 8 cores (i5-8265U) and 6 GB for solr. import syncjob , re indexed with the commands above, same results..
i tried on another hosted vps, less power , different underlying os but that’s not relevant i think, same results.

Some references i found, but not a working solution..

https://community.mailcow.email/d/1182-search-error-in-sogo
https://github.com/mailcow/mailcow-dockerized/issues/4488
https://github.com/mailcow/mailcow-dockerized/issues/2309

When doing initial tests with around 2-3 k e-mails, this worked good.

Testing with solr off, seems in lost connections much better, but speed is dreadful ( 50-60 seconds and sometimes more) and output results vary. I compare this , in speed to a kopano on a lesser powered system but the results on that system are presented in webui in 2-3 seconds.

anyone any tips , or if mailcow staff read this a possibility bootstrap 5 with xapian can be pretested ? Like i wrote as an question to the mailcow ticketsystem, if this is something a support-contract can fix , that works for me. I don’t expect everything to be free.

Thank you for reading trough this, i want to try and be as complete as possible and as i don’t understand why this fails drive me a bit crazy.

questions, shoot or hit me up op telegram.

lots of cow love
Mayk