Skip to content
/ dirtyzipf Public

zipfian int distributions using a fast approximation for pow

License

Notifications You must be signed in to change notification settings

ekg/dirtyzipf

Repository files navigation

zipf and selfsimilar C++ Random Distributions using a fast approximate pow function

This repository provides header-only classes with additional statistical distributions to be used by C++11 random generators.

They have been modified from the source repo to use a fast approximate pow implementation.

Example:

#include <random>
#include "selfsimilar_int_distribution.h"

int main() {
    std::default_random_engine generator;
    selfsimilar_int_distribution<int> distribution(1, 10, 0.2);
    int i = distribution(generator);
}

Most formulas are taken from: "Quickly Generating Billion-Record Synthetic Databases", Jim Gray et al, SIGMOD 1994".

Self-Similar

The self-similar distribution has a skew factor h represented by a double in the range (0.0,1.0). For a domain of size N, the distribution of probability is such that the first (N*h) elements are generated (1-h) of the times. In other words, for a domain of 25 elements and skew of 0.2, the first 5 elements (20% of 25) will be generated 80% (1-0.2) of the times.

This distribution also has the property that the skew is the same within any region of the domain. Therefore, the first element (20% of 20% of 25) will be generated 64% (80% of 80%) of the times.

In the plots below we generate random integers in the range [1,25] (X axis) and plot the percentage of times they were generated (Y axis) with different skew factors.

Zipfian

The Zipfian distribution is a power law distribution. It has a parameter h indicating the skew factor (higher means more skew). Since the Zipfian distribution is based on the zeta distribution, it requires calculating the zeta value upon initialization. Calculating the zeta value can be unpractical for very large domains, therefore the user has the option of passing a pre-calculated zeta value to the distribution.

In the plots below we generate random integers in the range [1,25] (X axis) and plot the percentage of times they were generated (Y axis) with different skew factors. Note that the Zipfian distribution is less skewed than the self-similar one, as the percentages on the Y axis are lower.

About

zipfian int distributions using a fast approximation for pow

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages