Support for 60,000+ domains

Problems/questions about hardware configurations and performances

Moderators: FlorianB, Pascal, bourgeois, mentor

Deehem
Posts: 2
Joined: Tue Jul 22, 2014 10:36 am
How did you hear about Mailcleaner: Google

Support for 60,000+ domains

Postby Deehem » Tue Jul 22, 2014 10:53 am

Hi,

We're looking to use MailCleaner as a replacement for Maia, our current clustered solution, since this is long gone and is no longer supported.

I was wondering whether MailCleaner would be happy handling 60,000-70,000 domains in the database well, and what implications (if any) this would have on performance? We have added the 60,000 domains to the database, however as you can imagine, loading of the UI and rendering of the domains page is incredibly slow (not that we would touch this section very often, but it's less than ideal at this stage).

We have no problems chucking $hardware++ at this, which would be the intention.

Is there a suggested limit to the amount of domains used in the MailCleaner system, and if so, what is this limit?

Thanks,
Dan
mbx
Posts: 118
Joined: Tue Sep 04, 2012 9:11 pm
How did you hear about Mailcleaner: Google

Re: Support for 60,000+ domains

Postby mbx » Tue Jul 22, 2014 8:12 pm

Hi Dan,

I cannot come close to your numbers, about 1000 here.. however we found the biggest problem was disk IO.

Anyway, we have been using it for a few years now and we are very happy.

Not sure that is of much help.

Cheers.
Deehem
Posts: 2
Joined: Tue Jul 22, 2014 10:36 am
How did you hear about Mailcleaner: Google

Re: Support for 60,000+ domains

Postby Deehem » Wed Jul 23, 2014 9:10 am

Hi Mbx,

Thank you for that. We have some large numbers to play with, and the post was definitely helpful with regards to Disk IO.

I'm wondering whether the IO would be able to spread out across a clustered solution, both for redundancy and performance purposes with round robin DNS, much like we have at the moment on our existing cluster.

I'm interested to see if anybody else uses MailCleaner to the scale we intend to, with about half a million to a million emails per day, it's important to get this right in advance. :)
mbx
Posts: 118
Joined: Tue Sep 04, 2012 9:11 pm
How did you hear about Mailcleaner: Google

Re: Support for 60,000+ domains

Postby mbx » Thu Jul 24, 2014 8:52 pm

Hi Dan,

We use three in a cluster with round robin DNS, we did this to spread the IO load and it worked well, we then moved to SSD and saw the biggest improvement as you can imagine.

I have attached disk IO and memory graphs for one of our VM's, this handles around 60K a day.

I would be happy to scale it up if we needed to, it clusters really well.

One point on clustering, if you intend to use different physical locations then the DB communication needs to be fast, you will see errors when you try to release messages and get other niggles otherwise, nothing that caused us a nightmare but the admin overhead went up. We now just use one DC and replicate in case of disaster.

Good luck :)
Attachments
count1.png
count1.png (29.24 KiB) Viewed 18901 times
count.png
count.png (44.74 KiB) Viewed 18901 times
Pentangle
Posts: 70
Joined: Thu Jan 31, 2013 1:20 am
How did you hear about Mailcleaner: Googling

Re: Support for 60,000+ domains

Postby Pentangle » Wed Oct 19, 2016 11:59 pm

I know this is a very old post, but I thought i'd just add one thing - if you're going to cluster, definitely definitely definitely do NOT attempt to filter ANY spam with your master. I know you CAN, but the disk IO when you get a backlog just makes life a LOT harder to fix things.

Return to “Hardware/performances”

Who is online

Users browsing this forum: Bing [Bot] and 1 guest