[dns-stats-users] DNS-STATS Compactor 1.2.1 release

Sara Dickinson sara at sinodun.com
Wed Mar 23 16:26:39 UTC 2022


Hi all,

We are pleased to announce the release of DNS-STATS Compactor version 1.2.1.

Full changelog since 1.2.0
-----------------------------------

* Updates:

    * New `sampling mode` option available when `compactor` is overloaded
      * Sampling of captured packets can be enabled at a specified rate for a 
        specified time when packet drops exceed a specified threshold 
        (see config options for more details). This option is disabled by default.
    * The behaviour of the internal sniffer channel is improved when `compactor` is 
       overloaded to provide better reporting and management of dropped/sampled of packets
      * This fixes a bug where the `Total Packets processed` statistic did not
        include any packets dropped during overload and so under reported load
    * Add new statistics to C-DNS: sniffer drops, matcher drops and sampling discards,
      and 3 libpcap stats. The libpcap stats should not be considered reliable and 
      provided for information only. 
    * Bump the private version because C-DNS schema extended with new statistics.
    * The behaviour of `compactor` is changed when an interrupt (SIGINT, SIGTERM)
      is received e.g. when the service is restarted or a user enters ^C.
      Previously all of the in progress C-DNS compression was aborted and all of
      the in progress output files (compressed and uncompressed) were removed. Now
      the `.raw` uncompressed output file is left on disk so it can be manually
      recovered (i.e. renamed and compressed). Users will now need to choose how to
      managed these uncompressed files. Behaviour on SIGHUP (re-reading of config
      file without affecting any in progress compression) is unchanged.

* Logging:

    * New `log-file-handing` option to log low level details of file
      processing on file rotation and compression. This aids with debugging of file
      processing problems and measurement of C-DNS file compression times.
    * New `-D` option (`relaxed-mode`). With this option a warning (not an error) is 
      issued for unrecognized command line and config file options. 
    * Additional default logging is added when file rotation occurs, when 
      compression is aborted, and to report the specific interrupt received by
      `compactor`.
    * Improve `log-interval` statistics output and add additional statistics.

* Minor updates/bug fixes:

    * Modify the format output by the debug option `--debug-qr` to be more human
      readable (`--debug-dns` output is left unchanged).
    * Fix file durations for files with more than one C-DNS block in them so high
      traffic rates can be correctly calculated from the statistics.
    * Constrain size of matcher queue to reduce memory consumption when 
      dropping/sampling.
    * Fix 2 minor bugs where an incorrect start time could be written to the CDNS
      file, resulting in a negative file duration.
    * Fix build issue when using `configure --disable-pseudo-anonymisation`. Thanks
      Sean Burford for reporting this.
    * Add example docker image as a submodule in `contrib/dns-stats-docker`. Thanks 
      to Sean Burford for providing this.

* Documentation: 
    * Minor documentation update to address https://github.com/dns-stats/compactor/issues/80
    * Text added in the documentation to clarify time patterns are needed in file
      output patterns for filename based file rotation to occur (based on the
      `rotation-period` option).
    * Correct the dependency list.


For more information, please see the project wiki:
https://github.com/dns-stats/compactor/wiki.

Packages available from: ppa:dns-stats/compactor
Source code available at: https://github.com/dns-stats/compactor
Documentation: https://github.com/dns-stats/compactor/wiki/user-guide-1.2.1.pdf


Sara Dickinson.


More information about the dns-stats-users mailing list