Cache Rules Everything Around Me

cream is a an Erlang caching module backed by the performant Moka library.

Dependencies

Because this module is based on Rust NIFs, you need to have a Rust toolchain installed.

Cache options

Creating a cache is as simple as calling cream:new/1 with the max capacity of the cache. In addition to capacity, you can create a cache by calling cream:new/2 with a property list of advanced cache options.

Option	Type	Unit	Default	Description
bounding	items | memory		items	Whether to bound cache by item count or memory.
initial_capacity	positive integer	bounding	0	Size cache can grow to without reallocation.
seconds_to_live	positive integer	seconds	∞	How long until entries will be evicted after first caching.
seconds_to_idle	positive integer	seconds	∞	How long until entries will be evicted after last access.

Examples

Create a cache that can hold up 10 items:

MaxCapacity = 10,
{ok, Cache} = cream:new(MaxCapacity).

---

Create a cache that can hold up 62 items, where items are evicted 5 minutes after they are first cached:

MaxCapacity = 62,
TTLSeconds = 5 * 60,
{ok, Cache} = cream:new(MaxCapacity, [{seconds_to_live, TTLSeconds}]).

---

Create a cache that can hold up 10,000 items (without reallocation), where items are evicted 5 seconds after they are last accessed (written or read):

InitialCapacity = 10000,
MaxCapacity = 10000,
TTISeconds = 5,
{ok, Cache} = cream:new(MaxCapacity, [{initial_capacity, InitialCapacity}, {seconds_to_idle, TTISeconds}]).

---

Create a memory-bounded cache:

MaxCapacity_memory = 22,
{ok, Cache} = cream:new(MaxCapacity_memory, [{bounding, memory}]).

cream:cache(Cache, <<"hello">>, fun() -> <<"world">> end).

ok = cream:sync(Cache),
{cream:entry_count(Cache), cream:mem_used(Cache)}.

cream:cache(Cache, <<"foo">>, fun() -> <<"bar">> end).

ok = cream:sync(Cache),
{cream:entry_count(Cache), cream:mem_used(Cache)}.

% Cache is already at max capacity of 22 memory, so orignal entry for
% `<<"hello">>` has been evicted.
notfound = cream:get(Cache, <<"hello">>).

output:

1> MaxCapacity_memory = 22,
1> {ok, Cache} = cream:new(MaxCapacity_memory, [{bounding, memory}]).
{ok,#Ref<0.1353329680.1113980932.213153>}
2>
2> cream:cache(Cache, <<"hello">>, fun() -> <<"world">> end).
<<"world">>
3>
3> ok = cream:sync(Cache),
3> {cream:entry_count(Cache), cream:mem_used(Cache)}.
{1,{ok,22}}
4>
4> cream:cache(Cache, <<"foo">>, fun() -> <<"bar">> end).
<<"bar">>
5>
5> ok = cream:sync(Cache),
5> {cream:entry_count(Cache), cream:mem_used(Cache)}.
{1,{ok,18}}
6>
6> % Cache is already at max capacity of 22 memory, so orignal entry for
6> % `<<"hello">>` has been evicted.
6> notfound = cream:get(Cache, <<"hello">>).
notfound

---

Basic caching

MaxCapacity = 3,
{ok, Cache} = cream:new(MaxCapacity),
ExpensiveOperation = fun() -> io:format("value is not in cache, performing expensive operation\n"), 1 end,
1 = cream:cache(Cache, {my, key}, ExpensiveOperation).

1 = cream:cache(Cache, {my, key}, ExpensiveOperation).

output:

1> MaxCapacity = 3,
1> {ok, Cache} = cream:new(MaxCapacity),
1> ExpensiveOperation = fun() -> io:format("value is not in cache, performing expensive operation\n"), 1 end,
1> 1 = cream:cache(Cache, {my, key}, ExpensiveOperation).
value is not in cache, performing expensive operation
1
2> 1 = cream:cache(Cache, {my, key}, ExpensiveOperation).
1
3>