Skip to content

Commit

Permalink
mm: kmsan: remove runtime checks from kmsan_unpoison_memory()
Browse files Browse the repository at this point in the history
Similarly to what's been done in commit 85716a8 ("kmsan: allow using
__msan_instrument_asm_store() inside runtime"), it should be safe to call
kmsan_unpoison_memory() from within the runtime, as it does not allocate
memory or take locks.  Remove the redundant runtime checks.

This should fix false positives seen with CONFIG_DEBUG_LIST=y when
the non-instrumented lib/stackdepot.c failed to unpoison the memory
chunks later checked by the instrumented lib/list_debug.c

Also replace the implementation of kmsan_unpoison_entry_regs() with
a call to kmsan_unpoison_memory().

Link: https://lkml.kernel.org/r/[email protected]
Fixes: f80be45 ("kmsan: add KMSAN runtime core")
Signed-off-by: Alexander Potapenko <[email protected]>
Tested-by: Marco Elver <[email protected]>
Cc: Dmitry Vyukov <[email protected]>
Cc: Ilya Leoshkevich <[email protected]>
Cc: Nicholas Miehlbradt <[email protected]>
Signed-off-by: Andrew Morton <[email protected]>
  • Loading branch information
ramosian-glider authored and akpm00 committed Feb 22, 2024
1 parent 9af4727 commit d749cc7
Showing 1 changed file with 13 additions and 23 deletions.
36 changes: 13 additions & 23 deletions mm/kmsan/hooks.c
Original file line number Diff line number Diff line change
Expand Up @@ -359,6 +359,12 @@ void kmsan_handle_dma_sg(struct scatterlist *sg, int nents,
}

/* Functions from kmsan-checks.h follow. */

/*
* To create an origin, kmsan_poison_memory() unwinds the stacks and stores it
* into the stack depot. This may cause deadlocks if done from within KMSAN
* runtime, therefore we bail out if kmsan_in_runtime().
*/
void kmsan_poison_memory(const void *address, size_t size, gfp_t flags)
{
if (!kmsan_enabled || kmsan_in_runtime())
Expand All @@ -371,47 +377,31 @@ void kmsan_poison_memory(const void *address, size_t size, gfp_t flags)
}
EXPORT_SYMBOL(kmsan_poison_memory);

/*
* Unlike kmsan_poison_memory(), this function can be used from within KMSAN
* runtime, because it does not trigger allocations or call instrumented code.
*/
void kmsan_unpoison_memory(const void *address, size_t size)
{
unsigned long ua_flags;

if (!kmsan_enabled || kmsan_in_runtime())
if (!kmsan_enabled)
return;

ua_flags = user_access_save();
kmsan_enter_runtime();
/* The users may want to poison/unpoison random memory. */
kmsan_internal_unpoison_memory((void *)address, size,
KMSAN_POISON_NOCHECK);
kmsan_leave_runtime();
user_access_restore(ua_flags);
}
EXPORT_SYMBOL(kmsan_unpoison_memory);

/*
* Version of kmsan_unpoison_memory() that can be called from within the KMSAN
* runtime.
*
* Non-instrumented IRQ entry functions receive struct pt_regs from assembly
* code. Those regs need to be unpoisoned, otherwise using them will result in
* false positives.
* Using kmsan_unpoison_memory() is not an option in entry code, because the
* return value of in_task() is inconsistent - as a result, certain calls to
* kmsan_unpoison_memory() are ignored. kmsan_unpoison_entry_regs() ensures that
* the registers are unpoisoned even if kmsan_in_runtime() is true in the early
* entry code.
* Version of kmsan_unpoison_memory() called from IRQ entry functions.
*/
void kmsan_unpoison_entry_regs(const struct pt_regs *regs)
{
unsigned long ua_flags;

if (!kmsan_enabled)
return;

ua_flags = user_access_save();
kmsan_internal_unpoison_memory((void *)regs, sizeof(*regs),
KMSAN_POISON_NOCHECK);
user_access_restore(ua_flags);
kmsan_unpoison_memory((void *)regs, sizeof(*regs));
}

void kmsan_check_memory(const void *addr, size_t size)
Expand Down

0 comments on commit d749cc7

Please sign in to comment.