Description: Fast Web log analyzer using probabilistic data structures
web (36787) access (2055) log (391) analyzer (195) hyperloglog (1)
Fast Web log analyzer using probabilistic data structures.
Logswan is a fast Web log analyzer using probabilistic data structures. It is targeted at very large log files, typically APIs logs. It has constant memory usage regardless of the log file size, and takes approximatively 4MB of RAM.
Unique visitors counting is performed using two HyperLogLog counters (one for IPv4, and another one for IPv6), providing a relative accuracy of 0.10%. String representations of IP addresses are used and preferred as they offer better precision.