The next feature release 1.1.2 of rspamd is out. This release contains some important improvements:

• Add support for forged confirmation headers (by @AdUser)
• Improve multimap plugin: add filtering support
• Add rspamadm statconvert utility to convert statistical tokens and learn cache from sqlite3 to redis
• Add logging for slow rules and regexps
• Add mime_types plugin to check sanity of mime types in messages

Bugfixes and minor improvements in this version:

• Fix stat_cache closing
• Add checkpoints to sqlite3 learn cache
• Do not recompile lua generated headers all the time
• Increase number of messages learned
• Fix issues with dual stack and hfilter
• Disable MID checks for hfilter by default
• Fix cache definitions in multiple classifier and no type
• Don’t crash if learn cache failed to initialize
• Fix googlegroups support in maillist plugin
• Rework flags LUA API:
  • Allow to check for a specific flag
  • Add learn_spam, learn_ham and broken_headers flags
  • Unify internal functions
• Add BROKEN_HEADERS rule
• Allow any, mime and smtp for get_from/get_recipients
• Add rule to detect spammers attempts to cheat mime parsing
• Rework parsing of IP addresses in configuration (better IPv6 support)
• Add util.parse_mail_address function to LUA API
• Add lua sqlite3 module
• Implement synchronous redis call
• Ratelimit: avoid possible indexing of nil value (Fixes #498) (by @fatalbanana)
• Implement redis advanced lua api with pipelining
• Fix memory leak on redis stat (#500)
• Fix user/language learn count in sqlite statistics (#496) (by @fatalbanana)
• Fix build with custom pcre
• Fix fuzzy relearning (#498)
• Improve planning of asynchronous tasks
• Add base32 decode/encode routines to lua util
• Allow converting of learn cache from sqlite to redis
• Add methods to check if a messages has from/rcpts
• Disable reload command in rc scripts
• Improve runtime CPU dispatcher for libcryptobox
• Add preliminary support of digital signatures via ed25519
• Add detection for RDRAND support
• Print configuration of crypto on start
• A in SPF presumes AAAA lookup as well

This version has full backward compatibility with 1.1.0 preserved.

The next major release of rspamd: 1.1.0 is now released. In this version, I did another bunch of architectural rework. This time, I’ve refactored fuzzy storage, regular expressions processing and statistics primarily.

A number of features that I was asked constantly about have been added to rspamd, including such features as:

• Autolearning for BAYES: statistics can learn on good or bad messages automatically
• Redis backend for statistics to enable distributed and fast redis storage for rspamd cluster
• Scalable fuzzy storage: it is now possible to scale hashes storage across multiple processes to process thousands of requests per second

There is also major performance improvement: hyperscan engine support for optimizing regular expressiosn execution.

With this version, I have added a lot of documentation, including tutorials and improved quick start guide.

Here is the full changelog for this version available on GitHub: https://github.com/vstakhov/rspamd/blob/1.1.0/ChangeLog

The new version is almost 100% backward compatible with 1.0 branch but please check the migration document if you are using per-user statistics and rspamd-1.0.

Here are some graph of rspamd performance on scanning:

So you can see that rspamd can scan as much as 200 messages per second consuming less that 50% cpu of a typical scanner machine (Xeon E5405 single CPU).

Rmilter is also upgraded to the version 1.7.0 that brings full IPv6 support, redis cache support and major cleanup of unused and broken stuff. Rmilter changelog is available here: https://github.com/vstakhov/rmilter/blob/1.7.0/ChangeLog

The next bugfixes only release 1.0.11 of rspamd is out. This release contains the following changes:

• Fix spf redirects
• Fix domains when parsing mx/ptr/a records in includes/redirects
• Fix unfolded base64 encoding
• Fix GError use-after-free
• Do not rewrite the original url when using redirector
• Fix parsing of fragment in urls
• Fix processing of HTML tags
• Improve empty image rule
• Avoid long double type
• Fix tokens weights in OSB algorithm
• Improve debugging for bayes

This version has backward compatibility with 1.0.0 preserved.

The branch 1.0 is now considered as stable and all development has now been moved to the master branch which is going to be the next 1.1 major release.

The next bugfixes only release 1.0.10 of rspamd is out. This release contains the following changes:

• Fix settings application (#416)
• Fix another issue with fixed strings
• Fix hash function invocation
• Use the proper string for make_dns_request in lua_http
• Fix scan time output
• Update webui:
  • fix labels for greylisting
  • fix dimension of scan time

This version has backward compatibility with 1.0.0 preserved.

The branch 1.0 is now considered as stable and all development has now been moved to the master branch which is going to be the next 1.1 major release.

Recently, I gave a talk on a conference called highload-2015 about rspamd. This conference has been held in Moscow Russia and was related to high performance sollutions in both software and hardware. With 2000+ attendees, the conference was one of the largest events in the Russian IT community. My slides could be obtained from the following locations:

• Actual slides in Russian
• A bit outdated slides in English

The record of my talk will be available soon.