Yes, and I must admit I am also one of those who has not really dealt with IPv6, yet.. ;-)
Anyways: I wouldn’t go IPv6 only, unless your mail server has a very specific use case where you can say with certainty that it only needs to be able to communicate with IPv6 capable servers / domains.