mm/damon/core: merge regions aggressively when max_nr_regions is unmet

DAMON keeps the number of regions under max_nr_regions by skipping regions
split operations when doing so can make the number higher than the limit.
It works well for preventing violation of the limit.  But, if somehow the
violation happens, it cannot recovery well depending on the situation.  In
detail, if the real number of regions having different access pattern is
higher than the limit, the mechanism cannot reduce the number below the
limit.  In such a case, the system could suffer from high monitoring
overhead of DAMON.

The violation can actually happen.  For an example, the user could reduce
max_nr_regions while DAMON is running, to be lower than the current number
of regions.  Fix the problem by repeating the merge operations with
increasing aggressiveness in kdamond_merge_regions() for the case, until
the limit is met.

[[email protected]: increase regions merge aggressiveness while respecting min_nr_regions]
Link: https://lkml.kernel.org/r/[email protected]
[[email protected]: ensure max threshold attempt for max_nr_regions violation]
Link: https://lkml.kernel.org/r/[email protected]
Link: https://lkml.kernel.org/r/[email protected]
Fixes: b9a6ac4e4ede ("mm/damon: adaptively adjust regions")
Signed-off-by: SeongJae Park <[email protected]>
Cc: <[email protected]>	[5.15+]
Signed-off-by: Andrew Morton <[email protected]>

diff --git a/mm/damon/core.c b/mm/damon/core.c
index 6392f1cc97a3e0217e64352583e74177b35035f9..e66823d6b10b0057b2d5d0e4228c5eb5c918fcbf 100644 (file)
--- a/mm/damon/core.c
+++ b/mm/damon/core.c
@@ -1358,14 +1358,31 @@ static void damon_merge_regions_of(struct damon_target *t, unsigned int thres,
  * access frequencies are similar.  This is for minimizing the monitoring
  * overhead under the dynamically changeable access pattern.  If a merge was
  * unnecessarily made, later 'kdamond_split_regions()' will revert it.
+ *
+ * The total number of regions could be higher than the user-defined limit,
+ * max_nr_regions for some cases.  For example, the user can update
+ * max_nr_regions to a number that lower than the current number of regions
+ * while DAMON is running.  For such a case, repeat merging until the limit is
+ * met while increasing @threshold up to possible maximum level.
  */
 static void kdamond_merge_regions(struct damon_ctx *c, unsigned int threshold,
                                  unsigned long sz_limit)
 {
        struct damon_target *t;
-
-       damon_for_each_target(t, c)
-               damon_merge_regions_of(t, threshold, sz_limit);
+       unsigned int nr_regions;
+       unsigned int max_thres;
+
+       max_thres = c->attrs.aggr_interval /
+               (c->attrs.sample_interval ?  c->attrs.sample_interval : 1);
+       do {
+               nr_regions = 0;
+               damon_for_each_target(t, c) {
+                       damon_merge_regions_of(t, threshold, sz_limit);
+                       nr_regions += damon_nr_regions(t);
+               }
+               threshold = max(1, threshold * 2);
+       } while (nr_regions > c->attrs.max_nr_regions &&
+                       threshold / 2 < max_thres);
 }
 
 /*