bucket4j Java implementation of token-bucket a @codeKK AndroidOpen Source Website

bucket4j

Project Url: vladimir-bukhtoyarov/bucket4j

Introduction: Java implementation of token-bucket algorithm for rate-limiting(throttling)

Tags:

Get dependency

The Bucket4j is distributed through Maven Central:

<!-- For java 11+ -->
<dependency>
    <groupId>com.bucket4j</groupId>
    <artifactId>bucket4j-core</artifactId>
    <version>8.10.1</version>
</dependency>

<!-- For java 8 -->
<dependency>
    <groupId>com.bucket4j</groupId>
    <artifactId>bucket4j_jdk8-core</artifactId>
    <version>8.10.1</version>
</dependency>

Quick start

import io.github.bucket4j.Bucket;

...
// bucket with capacity 20 tokens and with refilling speed 1 token per each 6 second
private static Bucket bucket = Bucket.builder()
      .addLimit(limit -> limit.capacity(20).refillGreedy(10, Duration.ofMinutes(1)))
      .build();

private void doSomethingProtected() {
   if (bucket.tryConsume(1)) {
      doSomething();    
   } else {
      throw new SomeRateLimitingException();
   }
}

More examples can be found there

Bucket4j is not a framework, it is a library, with Bucket4j you need to write a code to achive your goals. For generic use-cases, try to look at powerfull Spring Boot Starter for Bucket4j, that allows you to set access limits on your API effortlessly. Its key advantage lies in the configuration via properties or yaml files, eliminating the need for manual code authoring.

Bucket4j basic features

Absolutely non-compromise precision - Bucket4j does not operate with floats or doubles, all calculation are performed in the integer arithmetic, this feature protects end users from calculation errors involved by rounding.
Effective implementation in terms of concurrency:
- Bucket4j is good scalable for multi-threading case it by defaults uses lock-free implementation.
- In same time, library provides different concurrency strategies that can be chosen when default lock-free strategy is not desired.
Effective API in terms of garbage collector footprint: Bucket4j API tries to use primitive types as much as it is possible in order to avoid boxing and other types of floating garbage.
Pluggable listener API that allows to implement monitoring and logging.
Rich diagnostic API that allows to investigate internal state.
Rich configuration management - configuration of the bucket can be changed on fly

Bucket4j distributed features

In additional to basic features described above, Bucket4j provides ability to implement rate-limiting in cluster of JVMs:

Bucket4j out of the box supports any GRID solution which compatible with JCache API (JSR 107) specification.
Bucket4j provides the framework that allows to quickly build integration with your own persistent technology like RDMS or a key-value storage.
For clustered usage scenarios Bucket4j supports asynchronous API that extremely matters when going to distribute world, because asynchronous API allows avoiding blocking your application threads each time when you need to execute Network request.

Supported JCache compatible(or similar) back-ends

In addition to local in-memory buckets, the Bucket4j supports clustered usage scenario on top of following back-ends:

Back-end	Async supported	Optimized serialization	Thin-client support	Documentation link
`JCache API (JSR 107)`	No	No	No	bucket4j-jcache
`Hazelcast`	Yes	Yes	No	bucket4j-hazelcast
`Apache Ignite`	Yes	n/a	Yes	bucket4j-ignite
`Inifinispan`	Yes	Yes	No	bucket4j-infinispan
`Oracle Coherence`	Yes	Yes	No	bucket4j-coherence

Redis back-ends

Back-end	Async supported	Redis cluster supported	Documentation link
`Redis/Redisson`	Yes	Yes	bucket4j-redis/Redisson
`Redis/Jedis`	No	Yes	bucket4j-redis/Jedis
`Redis/Lettuce`	Yes	Yes	bucket4j-redis/Lettuce

JDBC back-ends

Back-end	Documentation link
`MySQL`	bucket4j-mysql
`PostgreSQL`	bucket4j-postgresql
`Oracle`	bucket4j-oracle
`Microsoft SQL Server`	bucket4j-mssql
`MariaDB`	bucket4j-mariadb

Local caches support

Sometimes you are having deal with bucket per key scenarios but distributed synchronization is unnecessary, for example where request stickiness is provided by a load balancer, or other use-cases where stickiness can be achieved by the application itself, for example, Kafka consumer. For such scenarios Bucket4j provides support for following list of local caching libraries: | Back-end | Documentation link | | :--- | :---: | | Caffeine | bucket4j-caffeine |