IPFIX

Internet Protocol Flow Information Export (IPFIX) is an IETF protocol, as well as the name of the IETF working group defining the protocol. It was created based on the need for a common, universal standard of export for Internet Protocol flow information from routers, probes and other devices that are used by mediation systems, accounting/billing systems and network management systems to facilitate services such as measurement, accounting and billing. The IPFIX standard defines how IP flow information is to be formatted and transferred from an exporter to a collector.[1] Previously many data network operators were relying on Cisco Systems' proprietary NetFlow technology for traffic flow information export.

quoted from wikipedia. I wanted to experiment a little with it and found the following library

https://github.com/DominoTree/rs-ipfix

I found it lacking some features from IPFIX RFC and it panicked on some tests, so I decided to contribute to the library and fork the code.

https://github.com/q6r/rs-ipfix

Did many changes to the library most notably

Support custom fields definitions

IPFIX supports custom fields such as when using Gigamon, nprobe, sonicwall, alcatel, ..etc these devices export custom fields, and the

spec defines how to handle those with the various cases they have, the library implements the ability to support any required types to

parse them correctly.

Can parse variable size fields

Some custom fields by the mentioned devices are exported with variable size such as HTTP_POST, and others by nprobe defined in spec section-7.

Minimal memory usage

I have minimized the memory usage by reusing memory instead of cloning unless necessary.

Major redesign and performance gains

Redesigned the code to be more performant, and minimized the code by using nom-derive and moving to a newer version of nom

Multi-threaded

Due to how the state is handled in the parser it can't be multi-threaded, mainly options template and templates states. They can be lifted outside of the paresr and wrapped in a RWLock, and other thread-friendly containers to then make the code threaded/concurrent/...etc and increase the performance.

Benchmarks

Benchmark done in Freebsd 13.0-Release, Intel(R) Core(TM) i5-10300H CPU @ 2.50GHz, 8 ncpu

Get

Crate can be found in

https://crates.io/crates/rsipfix

https://github.com/q6r/rs-ipfix

Proxied content from gemini://0x80.org/gemlog/2021-06-21-ipfix.gmi.
Get a proper gemini browser and visit!

Gemini request details:

Original URL
gemini://0x80.org/gemlog/2021-06-21-ipfix.gmi
Status code
20
Meta
text/gemini;lang=en-US