Filter with From and regular expression (RE) not working

alexs77

Hello

I’ve got the following filter:

Rules
– Matches at least one of the following rules
– From, matches RE, [@quaeldich\.de|feedback@bergportal\.ch|noreply@garmin\.com|@velocity\.ch|hikingbuddiesteam@gmail\.com|craig@wandrer\.earth|q@squadrats\.com|noreply@spontacts\.com|no-reply@strava\.com|@update\.strava\.com|@freezetag\.com|@munzee\.com|@geocaching\.com|@komoot\.de]
– Recipient (To or CC), contains, [hiking-buddies@domain1\.rodeo|carving\.fleshed313@domain2\.vip|com+wandrer\.earth@skwar\.me|squadrats\.com@domain1\.rodeo]
Actions
– Move message to, 🏔️🚴 Draussen

I would expect that message from Strava would be filed to the folder named “🏔️🚴 Draussen”. But they aren’t. They are still in Inbox.

Headers of an email from strava:

message-headers.eml

5kB

Why did the filter not work?

DocFraggle

I never used a regex pattern in Sogo, but are you sure the brackets are needed?
Any reason why you want a regex and don’t use multiple From lines, each matching one of the domains, in your rule?

Edit: I just saw that you don’t use the “matches regex” but “contains” in your “Empfänger” line, but added a regex expression

alexs77

DocFraggle

Yeah, nevermind the “Empfänger” line. It’s wrong. But the RE should match on From anyway.

Regarding the “[” and “]” — maybe not. In the meantime, I modified it to:

From, match RE, @quaeldich\.de|feedback@bergportal\.ch|noreply@garmin\.com|@velocity\.ch|hikingbuddiesteam@gmail\.com|craig@wandrer\.earth|q@squadrats\.com|noreply@spontacts\.com|no-reply@strava\.com|@update\.strava\.com|@freezetag\.com|@munzee\.com|@geocaching\.com|@komoot\.de

That is, I dropped the brackets. No change — still no match.

Regarding the “why RE and not multiple lines”: Easier to maintain as far as I’m concerned. Way to cumbersome to keep on adding line after line. An RE is easier to read — especially if we’re considering easy RegExps like that one.

“Disclosure”: I’m trying to migrate away from Gmail and there I had a rule like that:

Übereinstimmung mit: (to:(hiking-buddies@domain1.rodeo OR carving.fleshed313@domain2.vip OR com+wandrer.earth@domain3.me OR squadrats.com@domain1.rodeo) OR from:(@quaeldich.de OR feedback@bergportal.ch OR noreply@garmin.com OR @velocity.ch OR hikingbuddiesteam@gmail.com OR craig@wandrer.earth OR q@squadrats.com OR noreply@spontacts.com OR no-reply@strava.com OR @update.strava.com OR @freezetag.com OR @munzee.com OR @geocaching.com OR @komoot.de))

Interestingly, in the Filter.json in a Takeout, they’ve got:

  }, {
    "query": "{to:hiking-buddies@domain1.rodeo to:carving.fleshed313@domain2.vip to:com+wandrer.earth@domain3.me to:squadrats.com@domain1.rodeo from:quaeldich.de from:feedback@bergportal.ch from:noreply@garmin.com from:velocity.ch from:hikingbuddiesteam@gmail.com from:craig@wandrer.earth from:q@squadrats.com from:noreply@spontacts.com from:no-reply@strava.com from:update.strava.com from:freezetag.com from:munzee.com from:geocaching.com from:komoot.de}",
    "labelsToAdd": ["Kategorie \"Soziale Medien\"", "Social Networks/🏔️🚴 Draussen"]
  }, {

Kinda also like multiple lines.

Are there maybe logs that would allow me to debug this?

DocFraggle

No idea, sorry… Maybe someone else in this forum uses regex expressions and can shed some light.
In my opinion you get a far better overview if every domain/email address is in a single line, but it depends on the taste I guess 🙂

alexs77

As it stands, it seems that filtering in SOGo is just not working at all. Dunno… Doesn’t make switching easier. I mean, first off, there’s the (TO ME!) extreme loss of functionality and comfort by having to use just folders instead of being able to use labels. Folders are just a PITA… And, no, that’s not open to debate, as that is the way it is for me and how I see it, just for me, personally. Folders will make email for me even less useful, as I will miss emails if they’re not in the Inbox.

And then the non working filters. Combined with no logs?

Dunno… I still really do want to make it work. But I’d need filtering.

Is there at least a way to “programmatically” create filters? Is there some sort of CLI or API which would allow me to do so?

DocFraggle

alexs77 extreme loss of functionality and comfort by having to use just folders instead of being able to use labels.

Well, you can use labels in the filters, or you you mean something different?

alexs77 And then the non working filters

My filters are working great, I just don’t use regex expressions.

alexs77 Is there at least a way to “programmatically” create filters?

You can create your own sieve filters and place them in your mailbox directory. Maybe before that have a look at the already generated sieve file and use some kind of sieve parser to see if it’s a valid regex expression

alexs77

DocFraggle Well, you can use labels in the filters, or you you mean something different?

Yes, I do. Labels on emails are not how labels work in gmail. They also have “markings” which would maybe mimic these IMAP labels. Labels on Gmail can be thought of as an improved way of folders.

I mean labels as they are in Gmail. That’s not identical to labels as they are implemented in IMAP folders. Main difference is, that with IMAP, flags are stored on the message. Hard to implement filtering on it. Just check out how GMail implemented flags and then you’ll see. Folders don’t cut it, flags in IMAP neither.

Example workflow: Filters are setup and assign one or multiple flags to it (“store it in one or multiple folders”). How would you even do that alone with old style folders? Now, after an email comes in, it’s still in the inbox. Once it gets read, the inbox label is removed (it’s archived). Email will then still have all the other flags. How do you replicate that with folders, without COPYING emails to multiple folders? A copy would be wrong, because then the email would exist multiple times.

But that’s just how it is. Still trying to come to terms with the reduction of usefulness of emails due to the lack of labels in the way Gmail improved it.

DocFraggle My filters are working great, I just don’t use regex expressions.

Ok. How do I check what’s the issue with the filter I’ve shown? The RE is extremely simple and should match.

DocFraggle You can create your own sieve filters and place them in your mailbox directory. Maybe before that have a look at the already generated sieve file and use some kind of sieve parser to see if it’s a valid regex expression

Thanks, will do. I don’t have shell access to the system where mailcow is running. Am I then out of luck?

DocFraggle

I just googled the issue, you have to use regex like this in SoGo/Sieve:

.*@(a\.de|b\.de)$

I created a rule:

Result:

alexs77 Yes, I do. Labels on emails are not how labels work in gmail. They also have “markings” which would maybe mimic these IMAP labels. Labels on Gmail can be thought of as an improved way of folders.

OK, that’s not possible with SoGo afaik

alexs77

DocFraggle I just googled the issue, you have to use regex like this in SoGo/Sieve:

.*@(a.de|b.de)$

Hmm…

How would I filter messages coming from

foo@bar.de
@baz.com
@example.net

Ie. only ONE specific sender (foo@bar.de) but all mails from some certain domains?

I tried:

foo@bar.de|.@baz.com|.@example.net

Seems that there are issues with RE if it’s to match also the localpart (ie. not just all emails from a domain).

That should match:

first rule: ALL emails coming from certain domains
second rule: emails with a certain local part (my name; let’s say alfoo.sbar) from certain domains (swbaz.com and gmx.ch)

Did not work. Strange.

Yes. Having something before the “@” throws off the “matches regex”. I tried:

From:, matches regex, .*name.*@.*$

(Yes, I’m aware that a simple “contains” would work in that case. I’m playing around ;-) )

How does “matches” (in contrast to “matches regex”) work? Is there documentation somewhere?

BTW: There’s no way to apply a new ruleset to existing emails, is there?

DocFraggle OK, that’s not possible with SoGo afaik

Yes, it is not. No other email server supports this ease of use. Which is why I have to come to terms with being unable to continue using emails in a (to me) useful way. However, I anyways reduced the use of emails drastically. I guess I just have to accept, that I won’t notice emails anymore. That’s how it is :/

Let’s not get into this, though 🙂