Disable Bookkeeper::check for relibc

Merge remote-tracking branch 'origin/bugfixes'

Memcpy in the new buffer after reallocating the vec

Reserve enough mem that you have enough left over for the next reserve
Disable memtrim, because it breaks the assumption that reserve will not
cha

Memcpy in the new buffer after reallocating the vec

Reserve enough mem that you have enough left over for the next reserve
Disable memtrim, because it breaks the assumption that reserve will not
change the exsting vector contents.

Tests are still hanging on linux. I think our mutex impl may be broken
when under contention.

show more ...

Revert "Added 'oom' lang-item so downstream crates don't complain about missing 'oom' symbol"

This reverts commit 7d7e3137bb856752c25fe1a3e86d64debbcceee0

Added 'oom' lang-item so downstream crates don't complain about missing 'oom' symbol

Fix another case where #45 would occur

Fixed occasional failing of 'partial_realloc'. This is because our bookkeeper's vec gets too cramped and should (theoretically) need resizing

Removed a warning when compiling with 'log' feature

Fixed TLS incorrect total_bytes -- #45

Run rustfmt on all files

Update implementation for nightly 19/6/2018

Fix sbrk to actually return the *old* break.

Make tests compile

Use new allocator API, and otherwise update for new Rust

- New allocator API
- Remove the "allocator" feature, which should be unnecessary due to how
the new allocator API works
- NonZero no longer

Use new allocator API, and otherwise update for new Rust

- New allocator API
- Remove the "allocator" feature, which should be unnecessary due to how
the new allocator API works
- NonZero no longer implements Deref (https://github.com/rust-lang/rust/pull/41064)
- NonZero::new() returns an Option; use NonZero::new_unchecked()
- Thread locals are no longer 'static (https://github.com/rust-lang/rust/pull/43746)
- Changes to feature flags
- Use unsafe to access extern static (https://github.com/rust-lang/rust/issues/36247)

show more ...

fix the build (#42)

* fix the build

the `unborrow!` macro is need in the block and bookkeeper modules

* cfg(tls) away impl LocalAllocator

as the struct LocalAllocator is not available when

fix the build (#42)

* fix the build

the `unborrow!` macro is need in the block and bookkeeper modules

* cfg(tls) away impl LocalAllocator

as the struct LocalAllocator is not available when the tls feature is
disabled

show more ...

Merge branch 'master' of github.com:redox-os/ralloc

Remove the `nborrow` dependency and give the macro its own module.

To avoid linking hell.

Remove feature question_mark. (#38)

This feature is now in Rust stable, so adding !#[feature(question_mark)] is now useless and causes a warning.

Make `Leak` an invaraint.

We make the `Leak` trait unsafe and consituting an invariant. Secondly,
we implement `Leak` for all `Copy` types.

Audit all unsafes.

We equip all `unsafe` blocks with a timestamped confirmations of an
audit. Whenever a block is changed, it should be removed until a new
audit is made.

The format of these messag

Audit all unsafes.

We equip all `unsafe` blocks with a timestamped confirmations of an
audit. Whenever a block is changed, it should be removed until a new
audit is made.

The format of these messages is:

```
LAST AUDIT: yyyy-mm-dd (Username)
```

Close #28.

show more ...

Fix bugs in memtrimming related to the byte count.

Various issues (like premature checks) were present in the byte count
beforehand. We fix these.

- Fix invalid byte counts.
- Add a `LOCAL_MEMTRIM_

Fix bugs in memtrimming related to the byte count.

Various issues (like premature checks) were present in the byte count
beforehand. We fix these.

- Fix invalid byte counts.
- Add a `LOCAL_MEMTRIM_STOP` constant to `shim`, which serves for the
minimum memtrimmed allocator (i.e. it will stop when the byte count is
below this value).
- Add more logs.
- Add assertions about libc interference with SBRK.

There is still some problem when running

show more ...

Multi-level logging and user configuration.

This commit is a complete revision of `shim`. Anything which is
configurable of nature is now moved to `shim` allowing complete
customizability of `ralloc

Multi-level logging and user configuration.

This commit is a complete revision of `shim`. Anything which is
configurable of nature is now moved to `shim` allowing complete
customizability of `ralloc`.

But it doesn't end there!

The logs got quite messy before due to the classical TMI problem. We
solve this by adding multiple "log levels" each describing a different
class of importance.

- Add multi-level logging.
- Move each component of shim into distinct modules.
- Add allocator canonicalization to `shim`.
- Add adjustable constant to `shim`.
- Add default OOM handler to `shim`.
- Add logging to everything.
- Remove the `libc_write` module and add it to `log` instead.
- Add colourful OOM message.
- Tweak the allocator canonicalization strategy.
- Rename the `log!` macro to `bk_log!`, and use the old name for the
generalized logging macro.
- Remove the `unsafe_no_brk_lock` feature, due to being unsafe in
multithreaded environment (and in singlethreaded ones,
`unsafe_no_mutex_lock` is sufficient).
- Remove the `sys` module in favor of direct `shim` imports.

show more ...

OS memtrimming for the global allocator.

This commit introduces OS/BRK memtrimming, in which the memory from the
global allocator is freed to the OS when a certain limit is reached.
This avoids long

OS memtrimming for the global allocator.

This commit introduces OS/BRK memtrimming, in which the memory from the
global allocator is freed to the OS when a certain limit is reached.
This avoids long-running processes from acquiring too much memory from
the system and never releasing it again.

- Implement safe BRK releasing.

show more ...

Implement BRK caching.

Previously, BRK was making two syscalls in glibc due to requesting
the program break and then setting it. This is fixed by caching this
program break.

This commit prepares fo

Implement BRK caching.

Previously, BRK was making two syscalls in glibc due to requesting
the program break and then setting it. This is fixed by caching this
program break.

This commit prepares for OS memtrimming, which needs a well-defined
thread-safe function.

- Completely remove libc dependency due to allocation behavior being
uncertain in non-glibc implementation (the POSIX standard tells little
to nothing about this).
- Move the default OOM handler to shim.
- Give an error message in the default OOM handler.
- Add SBRK benchmark.

This should improve performance of fresh allocations by 30-40%.

show more ...

Implement memtrimming for the local allocator.

Memtrimming (releasing memory to a higher allocator or the OS) is
important for avoiding accumulation. This commit introduces memtrimming
for local all

Implement memtrimming for the local allocator.

Memtrimming (releasing memory to a higher allocator or the OS) is
important for avoiding accumulation. This commit introduces memtrimming
for local allocators to avoid fragmentation and stubs accumulating in
local allocators.

By keeping track of how many bytes that are currently in the bookkeeper,
we can estimate the level of fragmentation and thus decide if we should
memtrim (i.e. free to the global allocator).

The next thing is to implement global memtrimming.

We do a few minor changes as well:

- Refactor for_each to use a new method, `pop_iter` a iterator popping
elements of the vector.
- Introduce a new field `total_bytes` keeping track of the number of
bytes in the bookkeeper.
- Move the initializers of the allocators to methods defined on the type
itself.
- Introduce an `on_new_memory()` method, which is called whenever new
memory is introduced.

show more ...