dovecot continuously restarting when vmail is on NFS

MarcT

So, I’m new to setting this up, and trying to store my mail database on an NFS share.

Following a guide on how to mount an NFS share in docker compose I did just that.

volumes:
  vmail-vol-1:
    driver: local # Must be set to avoid issues.
    driver_opts:
      type: "nfs"
      o: "addr=192.168.1.20,rsize=65536,wsize=65536,timeo=14,tcp,rw,noatime"
      device: ":/mnt/Pool/mailcow_volumes"

The share mounted without issue and I was able to startup mailcow without any complaints. Volumes got created an everything..
The issue appears to be that there is a permissions issue that dovecot is attempting to resolve, fails and gets stuck in a restart loop.
Looking for help of anyone knows what I did wrong, or what I need to change.

Uptime: 2302  Threads: 13  Questions: 12793  Slow queries: 0  Opens: 129  Open tables: 61  Queries per second avg: 5.557
chown: /var/vmail/mailcowdockerized_redis-vol-1: Operation not permitted
chown: /var/vmail/mailcowdockerized_redis-vol-1: Operation not permitted
chown: /var/vmail/_garbage: Operation not permitted
chown: /var/vmail/_garbage: Operation not permitted
chown: /var/vmail/mailcowdockerized_postfix-vol-1: Operation not permitted
chown: /var/vmail/mailcowdockerized_postfix-vol-1: Operation not permitted
chown: /var/vmail/sieve/global_sieve_before.sieve: Operation not permitted
chown: /var/vmail/sieve/global_sieve_after.sieve: Operation not permitted
chown: /var/vmail/sieve: Operation not permitted
chown: /var/vmail/sieve: Operation not permitted
chown: /var/vmail: Operation not permitted
chown: /var/vmail: Operation not permitted
Uptime: 2363  Threads: 12  Questions: 12882  Slow queries: 0  Opens: 129  Open tables: 61  Queries per second avg: 5.451
chown: /var/vmail/mailcowdockerized_redis-vol-1: Operation not permitted
chown: /var/vmail/mailcowdockerized_redis-vol-1: Operation not permitted
chown: /var/vmail/_garbage: Operation not permitted
chown: /var/vmail/_garbage: Operation not permitted
chown: /var/vmail/mailcowdockerized_postfix-vol-1: Operation not permitted
chown: /var/vmail/mailcowdockerized_postfix-vol-1: Operation not permitted
chown: /var/vmail/sieve/global_sieve_before.sieve: Operation not permitted
chown: /var/vmail/sieve/global_sieve_after.sieve: Operation not permitted
chown: /var/vmail/sieve: Operation not permitted
chown: /var/vmail/sieve: Operation not permitted
chown: /var/vmail: Operation not permitted
chown: /var/vmail: Operation not permitted

esackbauer

I would just mount the whole /var/lib/docker/volumes to the NFS share.
Then you do not need to fiddle arount with docker compose, which would break/be overwritten with the next update.

MarcT

esackbauer I had tried that originally, but the redis-vol fails to load.

:/opt/mailcow-dockerized# docker-compose up -d
WARN[0000] /opt/mailcow-dockerized/docker-compose.yml: `version` is obsolete
[+] Running 2/2
 ✔ Network mailcowdockerized_mailcow-network  Created                                                                                                                                                                                                                                                                   0.1s
 ✘ Volume "mailcowdockerized_redis-vol-1"     Error                                                                                                                                                                                                                                                                     0.1s
Error response from daemon: create mailcowdockerized_redis-vol-1: error while creating volume data path '/var/lib/docker/volumes/mailcowdockerized_redis-vol-1/_data': mkdir /var/lib/docker/volumes/mailcowdockerized_redis-vol-1/_data: permission denied

I just deleted and recreated the NFS volume on the NAS and now I’m getting a different issue.. Apparently one of my earlier attempts allowed it to partially work..

WARN[0000] /opt/mailcow-dockerized/docker-compose.yml: `version` is obsolete
[+] Running 25/27
 ✔ Network mailcowdockerized_mailcow-network              Created                                                                                                                                                                                                                                                       0.1s
 ✔ Volume "mailcowdockerized_clamd-db-vol-1"              Created                                                                                                                                                                                                                                                       0.0s
 ✔ Volume "mailcowdockerized_redis-vol-1"                 Created                                                                                                                                                                                                                                                       0.0s
 ✔ Volume "mailcowdockerized_rspamd-vol-1"                Created                                                                                                                                                                                                                                                       0.0s
 ✔ Volume "mailcowdockerized_crypt-vol-1"                 Created                                                                                                                                                                                                                                                       0.0s
 ✔ Volume "mailcowdockerized_mysql-socket-vol-1"          Created                                                                                                                                                                                                                                                       0.0s
 ✔ Volume "mailcowdockerized_vmail-index-vol-1"           Created                                                                                                                                                                                                                                                       0.0s
 ✔ Volume "mailcowdockerized_sogo-web-vol-1"              Created                                                                                                                                                                                                                                                       0.0s
 ✔ Volume "mailcowdockerized_sogo-userdata-backup-vol-1"  Created                                                                                                                                                                                                                                                       0.0s
 ✔ Volume "mailcowdockerized_postfix-vol-1"               Created                                                                                                                                                                                                                                                       0.0s
 ✔ Volume "mailcowdockerized_solr-vol-1"                  Created                                                                                                                                                                                                                                                       0.0s
 ✔ Volume "mailcowdockerized_mysql-vol-1"                 Created                                                                                                                                                                                                                                                       0.0s
 ✔ Volume "mailcowdockerized_vmail-vol-1"                 Created                                                                                                                                                                                                                                                       0.0s
 ✔ Container mailcowdockerized-memcached-mailcow-1        Created                                                                                                                                                                                                                                                       0.4s
 ✔ Container mailcowdockerized-netfilter-mailcow-1        Created                                                                                                                                                                                                                                                       0.3s
 ✔ Container mailcowdockerized-unbound-mailcow-1          Created                                                                                                                                                                                                                                                       0.3s
 ✔ Container mailcowdockerized-olefy-mailcow-1            Created                                                                                                                                                                                                                                                       0.3s
 ✔ Container mailcowdockerized-sogo-mailcow-1             Created                                                                                                                                                                                                                                                       0.3s
 ✔ Container mailcowdockerized-dockerapi-mailcow-1        Created                                                                                                                                                                                                                                                       0.3s
 ✔ Container mailcowdockerized-clamd-mailcow-1            Created                                                                                                                                                                                                                                                       0.3s
 ✔ Container mailcowdockerized-redis-mailcow-1            Created                                                                                                                                                                                                                                                       0.3s
 ✔ Container mailcowdockerized-solr-mailcow-1             Created                                                                                                                                                                                                                                                       0.3s
 ✔ Container mailcowdockerized-mysql-mailcow-1            Created                                                                                                                                                                                                                                                       0.3s
 ✔ Container mailcowdockerized-php-fpm-mailcow-1          Created                                                                                                                                                                                                                                                       0.2s
 ⠸ Container mailcowdockerized-dovecot-mailcow-1          Creating                                                                                                                                                                                                                                                      0.4s
 ✔ Container mailcowdockerized-postfix-mailcow-1          Created                                                                                                                                                                                                                                                       0.2s
 ⠙ Container mailcowdockerized-nginx-mailcow-1            Creating                                                                                                                                                                                                                                                      0.1s
Error response from daemon: failed to chmod on /var/lib/docker/volumes/mailcowdockerized_vmail-vol-1/_data: chmod /var/lib/docker/volumes/mailcowdockerized_vmail-vol-1/_data: operation not permitted

At one point I had started mailcow, then stopped it, and moved the _data folder from vmail then replaced it with a mounted NFS.. but that also got me stuck in a restart loop..

esackbauer

You need to set the UID/GID accordingly in the mount options and make sure that all folders have the proper rights too.
And you are running mailcow and docker as root hopefully?
Sorry I am not an expert, I guess you will find more/better help in a Docker forum.

MarcT

esackbauer I’m running a debian VM on proxmox, and docker is running in the VM, and yes running as root.

mailcow is using a user/group of 5000 for both, so I created a mailcow user/group on the NAS with the same and gave it ownership on the share/folder. but that didnt seem to do anything.

It appears I just solved the issue after researching docker and chown issues with NFS.. I needed to set no_root_squash on the NFS share. This is not something you can “technically” do with TrueNAS however. But there is an alternate way of setting maproot user and maproot group in the advanced settings of the share.

Is there a way to mark this as solved? Still new here..