High-level interface for allocators. Implements bundled allocation/creation and destruction/deallocation of data including struct
s and class
es, and also array primitives related to allocation. This module is the entry point for both making use of allocators and for their documentation.
Category | Functions |
---|---|
Make | make makeArray makeMultidimensionalArray |
Dispose | dispose disposeMultidimensionalArray |
Modify | expandArray shrinkArray |
Global | processAllocator theAllocator |
Class interface | allocatorObject CAllocatorImpl IAllocator |
// Allocate an int, initialize it with 42 int* p = theAllocator.make!int(42); assert(*p == 42); // Destroy and deallocate it theAllocator.dispose(p); // Allocate using the global process allocator p = processAllocator.make!int(100); assert(*p == 100); // Destroy and deallocate processAllocator.dispose(p); // Create an array of 50 doubles initialized to -1.0 double[] arr = theAllocator.makeArray!double(50, -1.0); // Append two zeros to it theAllocator.expandArray(arr, 2, 0.0); // On second thought, take that back theAllocator.shrinkArray(arr, 2); // Destroy and deallocate theAllocator.dispose(arr);
IAllocator
, which concrete allocators need to implement. The interface primitives themselves are oblivious to the type of the objects being allocated; they only deal in void[]
, by necessity of the interface being dynamic (as opposed to type-parameterized). Each thread has a current allocator it uses by default, which is a thread-local variable theAllocator
of type IAllocator
. The process has a global allocator called processAllocator
, also of type IAllocator
. When a new thread is created, processAllocator
is copied into theAllocator
. An application can change the objects to which these references point. By default, at application startup, processAllocator
refers to an object that uses D's garbage collected heap. This layer also include high-level functions such as make
and dispose
that comfortably allocate/create and respectively destroy/deallocate objects. This layer is all needed for most casual uses of allocation primitives.std.experimental.allocator.typed
module. It allows an interested user to e.g. use different allocators for arrays versus fixed-sized objects, to the end of better overall performance.std.experimental.allocator.showcase
which defines a collection of frequently- used preassembled allocator objects. The implementation and documentation entry point is std.experimental.allocator.building_blocks
. By design, the primitives of the static interface have the same signatures as the IAllocator
primitives but are for the most part optional and driven by static introspection. The parameterized class CAllocatorImpl
offers an immediate and useful means to package a static low-level allocator into an implementation of IAllocator
.std.experimental.allocator.gc_allocator
), the C malloc
family (std.experimental.allocator.mallocator
), and the OS (std.experimental.allocator.mmap_allocator
). Most custom allocators would ultimately obtain memory from one of these core allocators.std.experimental.allocator
std.experimental.allocator
is not integrated with D's built-in operators that allocate memory, such as new
, array literals, or array concatenation operators. That means std.experimental.allocator
is opt-inmake
, dispose
, and the array-specific functions makeArray
, expandArray
, and shrinkArray
. These use by default D's garbage collected heap, but open the application to better configuration options. These primitives work either with theAllocator
but also with any allocator obtained by combining heap building blocks. For example: void fun(size_t n) { // Use the current allocator int[] a1 = theAllocator.makeArray!int(n); scope(exit) theAllocator.dispose(a1); ... }To experiment with alternative allocators, set
theAllocator
for the current thread. For example, consider an application that allocates many 8-byte objects. These are not well supported by the default allocator, so a free list allocator would be recommended. To install one in main
, the application would use: void main() { import std.experimental.allocator.building_blocks.free_list : FreeList; theAllocator = allocatorObject(FreeList!8()); ... }
IAllocator
Reference For Later UsetheAllocator
and processAllocator
should not be done often and casually. In particular, allocating memory with one allocator and deallocating with another causes undefined behavior. Typically, these variables are set during application initialization phase and last through the application. To avoid this, long-lived objects that need to perform allocations, reallocations, and deallocations relatively often may want to store a reference to the allocator object they use throughout their lifetime. Then, instead of using theAllocator
for internal allocation-related tasks, they'd use the internally held reference. For example, consider a user-defined hash table: struct HashTable { private IAllocator allocator; this(size_t buckets, IAllocator allocator = theAllocator) { this.allocator = allocator; ... } // Getter and setter IAllocator allocator() { return allocator; } void allocator(IAllocator a) { assert(empty); allocator = a; } }Following initialization, the
HashTable
object would consistently use its allocator
object for acquiring memory. Furthermore, setting HashTable.allocator
to point to a different allocator should be legal but only if the object is empty; otherwise, the object wouldn't be able to deallocate its existing state. IAllocator
IAllocator
to be usable. They have the same primitives as IAllocator
and they work with make
, makeArray
, dispose
etc. So it suffice to create allocator objects wherever fit and use them appropriately: void fun(size_t n) { // Use a stack-installed allocator for up to 64KB StackFront!65536 myAllocator; int[] a2 = myAllocator.makeArray!int(n); scope(exit) myAllocator.dispose(a2); ... }In this case,
myAllocator
does not obey the IAllocator
interface, but implements its primitives so it can work with makeArray
by means of duck typing. One important thing to note about this setup is that statically-typed assembled allocators are almost always faster than allocators that go through IAllocator
. An important rule of thumb is: "assemble allocator first, adapt to IAllocator
after". A good allocator implements intricate logic by means of template assembly, and gets wrapped with IAllocator
(usually by means of allocatorObject
) only once, at client level. Dynamic allocator interface. Code that defines allocators ultimately implements this interface. This should be used wherever a uniform type is required for encapsulating various allocator implementations.
Composition of allocators is not recommended at this level due to inflexibility of dynamic interfaces and inefficiencies caused by cascaded multiple calls. Instead, compose allocators using the static interface defined in std.experimental.allocator.building_blocks
, then adapt the composed allocator to IAllocator
(possibly by using CAllocatorImpl
below).
Methods returning Ternary
return Ternary.yes
upon success, Ternary.no
upon failure, and Ternary.unknown
if the primitive is not implemented by the allocator instance.
Returns the alignment offered.
Returns the good allocation size that guarantees zero internal fragmentation.
Allocates n
bytes of memory.
Allocates n
bytes of memory with specified alignment a
. Implementations that do not support this primitive should always return null
.
Allocates and returns all memory available to this allocator. Implementations that do not support this primitive should always return null
.
Expands a memory block in place and returns true
if successful. Implementations that don't support this primitive should always return false
.
Reallocates a memory block.
Reallocates a memory block with specified alignment.
Returns Ternary.yes
if the allocator owns b
, Ternary.no
if the allocator doesn't own b
, and Ternary.unknown
if ownership cannot be determined. Implementations that don't support this primitive should always return Ternary.unknown
.
Resolves an internal pointer to the full block allocated. Implementations that don't support this primitive should always return Ternary.unknown
.
Deallocates a memory block. Implementations that don't support this primitive should always return false
. A simple way to check that an allocator supports deallocation is to call deallocate(null)
.
Deallocates all memory. Implementations that don't support this primitive should always return false
.
Returns Ternary.yes
if no memory is currently allocated from this allocator, Ternary.no
if some allocations are currently active, or Ternary.unknown
if not supported.
Increases the reference count of the concrete class that implements this interface.
For stateless allocators, this does nothing.
Decreases the reference count of the concrete class that implements this interface. When the reference count is 0
, the object self-destructs.
true
if the reference count is greater than 0
and false
when it hits 0
. For stateless allocators, it always returns true
.A reference counted struct that wraps the dynamic allocator interface. This should be used wherever a uniform type is required for encapsulating various allocator implementations.
Code that defines allocators ultimately implements the IAllocator
interface, possibly by using CAllocatorImpl
below, and then build a RCIAllocator
out of this.
Composition of allocators is not recommended at this level due to inflexibility of dynamic interfaces and inefficiencies caused by cascaded multiple calls. Instead, compose allocators using the static interface defined in std.experimental.allocator.building_blocks
, then adapt the composed allocator to RCIAllocator
(possibly by using allocatorObject
below).
Dynamic shared allocator interface. Code that defines allocators shareable across threads ultimately implements this interface. This should be used wherever a uniform type is required for encapsulating various allocator implementations.
Composition of allocators is not recommended at this level due to inflexibility of dynamic interfaces and inefficiencies caused by cascaded multiple calls. Instead, compose allocators using the static interface defined in std.experimental.allocator.building_blocks
, then adapt the composed allocator to ISharedAllocator
(possibly by using CSharedAllocatorImpl
below).
Methods returning Ternary
return Ternary.yes
upon success, Ternary.no
upon failure, and Ternary.unknown
if the primitive is not implemented by the allocator instance.
Returns the alignment offered.
Returns the good allocation size that guarantees zero internal fragmentation.
Allocates n
bytes of memory.
Allocates n
bytes of memory with specified alignment a
. Implementations that do not support this primitive should always return null
.
Allocates and returns all memory available to this allocator. Implementations that do not support this primitive should always return null
.
Expands a memory block in place and returns true
if successful. Implementations that don't support this primitive should always return false
.
Reallocates a memory block.
Reallocates a memory block with specified alignment.
Returns Ternary.yes
if the allocator owns b
, Ternary.no
if the allocator doesn't own b
, and Ternary.unknown
if ownership cannot be determined. Implementations that don't support this primitive should always return Ternary.unknown
.
Resolves an internal pointer to the full block allocated. Implementations that don't support this primitive should always return Ternary.unknown
.
Deallocates a memory block. Implementations that don't support this primitive should always return false
. A simple way to check that an allocator supports deallocation is to call deallocate(null)
.
Deallocates all memory. Implementations that don't support this primitive should always return false
.
Returns Ternary.yes
if no memory is currently allocated from this allocator, Ternary.no
if some allocations are currently active, or Ternary.unknown
if not supported.
Increases the reference count of the concrete class that implements this interface.
For stateless allocators, this does nothing.
Decreases the reference count of the concrete class that implements this interface. When the reference count is 0
, the object self-destructs.
For stateless allocators, this does nothing.
true
if the reference count is greater than 0
and false
when it hits 0
. For stateless allocators, it always returns true
.A reference counted struct that wraps the dynamic shared allocator interface. This should be used wherever a uniform type is required for encapsulating various allocator implementations.
Code that defines allocators shareable across threads ultimately implements the ISharedAllocator
interface, possibly by using CSharedAllocatorImpl
below, and then build a RCISharedAllocator
out of this.
Composition of allocators is not recommended at this level due to inflexibility of dynamic interfaces and inefficiencies caused by cascaded multiple calls. Instead, compose allocators using the static interface defined in std.experimental.allocator.building_blocks
, then adapt the composed allocator to RCISharedAllocator
(possibly by using sharedAllocatorObject
below).
Gets/sets the allocator for the current thread. This is the default allocator that should be used for allocating thread-local memory. For allocating memory to be shared across threads, use processAllocator
(below). By default, theAllocator
ultimately fetches memory from processAllocator
, which in turn uses the garbage collected heap.
// Install a new allocator that is faster for 128-byte allocations. import std.experimental.allocator.building_blocks.free_list : FreeList; import std.experimental.allocator.gc_allocator : GCAllocator; auto oldAllocator = theAllocator; scope(exit) theAllocator = oldAllocator; theAllocator = allocatorObject(FreeList!(GCAllocator, 128)()); // Use the now changed allocator to allocate an array const ubyte[] arr = theAllocator.makeArray!ubyte(128); assert(arr.ptr); //...
Gets/sets the allocator for the current process. This allocator must be used for allocating memory shared across threads. Objects created using this allocator can be cast to shared
.
Dynamically allocates (using alloc
) and then creates in the memory allocated an object of type T
, using args
(if any) for its initialization. Initialization occurs in the memory allocated and is otherwise semantically the same as T(args)
. (Note that using alloc.make!(T[])
creates a pointer to an (empty) array of T
s, not an array. To use an allocator to allocate and initialize an array, use alloc.makeArray!T
described below.)
T | Type of the object being created. |
Allocator alloc
| The allocator used for getting the needed memory. It may be an object implementing the static interface for allocators, or an IAllocator reference. |
A args
| Optional arguments used for initializing the created object. If not present, the object is default constructed. |
T
is a class type, returns a reference to the created T
object. Otherwise, returns a T*
pointing to the created object. In all cases, returns null
if allocation failed. T
's constructor throws, deallocates the allocated memory and propagates the exception.// Dynamically allocate one integer const int* p1 = theAllocator.make!int; // It's implicitly initialized with its .init value writeln(*p1); // 0 // Dynamically allocate one double, initialize to 42.5 const double* p2 = theAllocator.make!double(42.5); writeln(*p2); // 42.5 // Dynamically allocate a struct static struct Point { int x, y, z; } // Use the generated constructor taking field values in order const Point* p = theAllocator.make!Point(1, 2); assert(p.x == 1 && p.y == 2 && p.z == 0); // Dynamically allocate a class object static class Customer { uint id = uint.max; this() {} this(uint id) { this.id = id; } // ... } Customer cust = theAllocator.make!Customer; assert(cust.id == uint.max); // default initialized cust = theAllocator.make!Customer(42); writeln(cust.id); // 42 // explicit passing of outer pointer static class Outer { int x = 3; class Inner { auto getX() { return x; } } } auto outer = theAllocator.make!Outer(); auto inner = theAllocator.make!(Outer.Inner)(outer); writeln(outer.x); // inner.getX
Create an array of T
with length
elements using alloc
. The array is either default-initialized, filled with copies of init
, or initialized with values fetched from range
.
T | element type of the array being created |
Allocator alloc
| the allocator used for getting memory |
size_t length
| length of the newly created array |
T init
| element used for filling the array |
R range
| range used for initializing the array elements |
null
if either length
was 0
or allocation failed. alloc
's primitives do. The overloads that involve copy initialization deallocate memory and propagate the exception if the copy operation throws.import std.algorithm.comparison : equal; static void test(T)() { T[] a = theAllocator.makeArray!T(2); assert(a.equal([0, 0])); a = theAllocator.makeArray!T(3, 42); assert(a.equal([42, 42, 42])); import std.range : only; a = theAllocator.makeArray!T(only(42, 43, 44)); assert(a.equal([42, 43, 44])); } test!int(); test!(shared int)(); test!(const int)(); test!(immutable int)();
Grows array
by appending delta
more elements. The needed memory is allocated using alloc
. The extra elements added are either default- initialized, filled with copies of init
, or initialized with values fetched from range
.
T | element type of the array being created |
Allocator alloc
| the allocator used for getting memory |
T[] array
| a reference to the array being grown |
size_t delta
| number of elements to add (upon success the new length of array is array.length + delta ) |
T init
| element used for filling the array |
R range
| range used for initializing the array elements |
true
upon success, false
if memory could not be allocated. In the latter case array
is left unaffected. alloc
's primitives do. The overloads that involve copy initialization deallocate memory and propagate the exception if the copy operation throws.Shrinks an array by delta
elements.
If array.length < delta
, does nothing and returns false
. Otherwise, destroys the last array.length - delta
elements in the array and then reallocates the array's buffer. If reallocation fails, fills the array with default-initialized data.
T | element type of the array being created |
Allocator alloc
| the allocator used for getting memory |
T[] array
| a reference to the array being shrunk |
size_t delta
| number of elements to remove (upon success the new length of array is array.length - delta ) |
true
upon success, false
if memory could not be reallocated. In the latter case, the slice array[$ - delta .. $]
is left with default-initialized elements. alloc
's primitives do. The overloads that involve copy initialization deallocate memory and propagate the exception if the copy operation throws.Destroys and then deallocates (using alloc
) the object pointed to by a pointer, the class object referred to by a class
or interface
reference, or an entire array. It is assumed the respective entities had been allocated with the same allocator.
Allocates a multidimensional array of elements of type T.
N | number of dimensions |
T | element type of an element of the multidimensional arrat |
Allocator alloc
| the allocator used for getting memory |
size_t[N] lengths
| static array containing the size of each dimension |
import std.experimental.allocator.mallocator : Mallocator; auto mArray = Mallocator.instance.makeMultidimensionalArray!int(2, 3, 6); // deallocate when exiting scope scope(exit) { Mallocator.instance.disposeMultidimensionalArray(mArray); } writeln(mArray.length); // 2 foreach (lvl2Array; mArray) { writeln(lvl2Array.length); // 3 foreach (lvl3Array; lvl2Array) writeln(lvl3Array.length); // 6 }
Destroys and then deallocates a multidimensional array, assuming it was created with makeMultidimensionalArray and the same allocator was used.
T | element type of an element of the multidimensional array |
Allocator alloc
| the allocator used for getting memory |
T[] array
| the multidimensional array that is to be deallocated |
struct TestAllocator { import std.experimental.allocator.common : platformAlignment; import std.experimental.allocator.mallocator : Mallocator; alias allocator = Mallocator.instance; private static struct ByteRange { void* ptr; size_t length; } private ByteRange[] _allocations; enum uint alignment = platformAlignment; void[] allocate(size_t numBytes) { auto ret = allocator.allocate(numBytes); _allocations ~= ByteRange(ret.ptr, ret.length); return ret; } bool deallocate(void[] bytes) { import std.algorithm.mutation : remove; import std.algorithm.searching : canFind; bool pred(ByteRange other) { return other.ptr == bytes.ptr && other.length == bytes.length; } assert(_allocations.canFind!pred); _allocations = _allocations.remove!pred; return allocator.deallocate(bytes); } ~this() { assert(!_allocations.length); } } TestAllocator allocator; auto mArray = allocator.makeMultidimensionalArray!int(2, 3, 5, 6, 7, 2); allocator.disposeMultidimensionalArray(mArray);
Returns a dynamically-typed CAllocator
built around a given statically- typed allocator a
of type A
. Passing a pointer to the allocator creates a dynamic allocator around the allocator pointed to by the pointer, without attempting to copy or move it. Passing the allocator by value or reference behaves as follows.
A
has no state, the resulting object is allocated in static shared storage.A
has state, the result will std.algorithm.mutation.move
the supplied allocator A a
within. The result itself is allocated in its own statically-typed allocator.import std.experimental.allocator.mallocator : Mallocator; RCIAllocator a = allocatorObject(Mallocator.instance); auto b = a.allocate(100); writeln(b.length); // 100 assert(a.deallocate(b)); // The in-situ region must be used by pointer import std.experimental.allocator.building_blocks.region : InSituRegion; auto r = InSituRegion!1024(); a = allocatorObject(&r); b = a.allocate(200); writeln(b.length); // 200 // In-situ regions can deallocate the last allocation assert(a.deallocate(b));
Returns a dynamically-typed CSharedAllocator
built around a given statically- typed allocator a
of type A
. Passing a pointer to the allocator creates a dynamic allocator around the allocator pointed to by the pointer, without attempting to copy or move it. Passing the allocator by value or reference behaves as follows.
A
has no state, the resulting object is allocated in static shared storage.A
has state and is copyable, the result will std.algorithm.mutation.move
the supplied allocator A a
within. The result itself is allocated in its own statically-typed allocator.A
has state and is not copyable, the result will move the passed-in argument into the result. The result itself is allocated in its own statically-typed allocator.Implementation of IAllocator
using Allocator
. This adapts a statically-built allocator type to IAllocator
that is directly usable by non-templated code.
Usually CAllocatorImpl
is used indirectly by calling theAllocator
.
The implementation is available as a public member.
The implementation is available as a public member.
Returns impl.alignment
.
Returns impl.goodAllocSize(s)
.
Returns impl.allocate(s)
.
If impl.alignedAllocate
exists, calls it and returns the result. Otherwise, always returns null
.
If Allocator
implements owns
, forwards to it. Otherwise, returns Ternary.unknown
.
Returns impl.expand(b, s)
if defined, false
otherwise.
Returns impl.reallocate(b, s)
.
Forwards to impl.alignedReallocate
if defined, false
otherwise.
If impl.deallocate
is not defined, returns false
. Otherwise it forwards the call.
Calls impl.deallocateAll()
and returns the result if defined, otherwise returns false
.
Forwards to impl.empty()
if defined, otherwise returns Ternary.unknown
.
Returns impl.allocateAll()
if present, null
otherwise.
Implementation of ISharedAllocator
using Allocator
. This adapts a statically-built, shareable across threads, allocator type to ISharedAllocator
that is directly usable by non-templated code.
Usually CSharedAllocatorImpl
is used indirectly by calling processAllocator
.
The implementation is available as a public member.
The implementation is available as a public member.
Returns impl.alignment
.
Returns impl.goodAllocSize(s)
.
Returns impl.allocate(s)
.
If impl.alignedAllocate
exists, calls it and returns the result. Otherwise, always returns null
.
If Allocator
implements owns
, forwards to it. Otherwise, returns Ternary.unknown
.
Returns impl.expand(b, s)
if defined, false
otherwise.
Returns impl.reallocate(b, s)
.
Forwards to impl.alignedReallocate
if defined, false
otherwise.
If impl.deallocate
is not defined, returns false
. Otherwise it forwards the call.
Calls impl.deallocateAll()
and returns the result if defined, otherwise returns false
.
Forwards to impl.empty()
if defined, otherwise returns Ternary.unknown
.
Returns impl.allocateAll()
if present, null
otherwise.
© 1999–2019 The D Language Foundation
Licensed under the Boost License 1.0.
https://dlang.org/phobos/std_experimental_allocator.html