Singular stochastic control model for algae growth management in dam downstream

ABSTRACT A stochastic control model for finding an ecologically sound, fit-for-purpose dam operation policy to suppress bloom of attached algae in its downstream is presented. A singular exactly solvable and a more realistic regular-singular cases are analysed in terms of a Hamilton–Jacobi–Bellman equation. Regularity and consistency of the value function are analysed and its classical verification theorem is established. Practical implications of the mathematical analysis results are discussed focusing on parameter dependence of the optimal controls. An asymptotic analysis with a numerical computation reveals solution behaviour of the Hamilton–Jacobi–Bellman equation near the origin, namely at the early stage of algae growth.


Introduction
Dam is a water infrastructure indispensable for life of modern people [46]. River discharge downstream of a dam is strongly regulated by its outflow, which often deviates from the natural ones in both quantity and quality [19,49]. Lowering the magnitude and fluctuations of river discharge is a common environmental issue that a river equipped with a dam encounters, which often results in severe degradation of the downstream river environment and ecosystems [9,35,43]. One of the most severe issues among them is the bloom of harmful attached algae, such as periphyton, on the riverbed in dam downstream [6,31,32]. The harmful attached algae, hereafter simply referred to as the algae for the sake of simplicity of descriptions, have been reported to provide a variety of disutilities. Such examples include qualitative changes of food webs directly and indirectly as the producer in aquatic ecosystems [18,23,36], degradation of river landscape [39], nasty smell from dead algae [29,58], and degradation of the quality of inland fishery resources [24]. Establishment of ecologically sound as well as fit-for-purpose operation policies of dams to suppress the algae bloom is currently an urgent environmental issue worldwide.
It has been found by the experimental and field investigations that the algae are gradually detached from the riverbed by the bedload transport and shear stresses [7,13], indicating that river discharge should not be too small to suppress their growth. Deterministic and mechanistic population dynamics models have been applied to simulating the algae detachment processes [7,16,17,34,51]. In reality, biological dynamics like the population dynamics of algae is essentially stochastic, and application of a stochastic process model is more appropriate for its analysis [1,61]. Recently, the authors applied a stochastic process model for evaluation of the algae growth in a Japanese river environment, demonstrating reasonable agreement between the predicted and observed algae population dynamics [58]. However, most of the above-mentioned researchers keep heuristic discussion and analyse the problem from engineering viewpoint rather than mathematical one. Analysis of the algae growth from a mathematical viewpoint would provide better comprehension of the dynamics and effective ways to manage them. This is a strong motivation of this paper.
The objective of this paper is formulation and analysis of a stochastic control model for finding the ecologically sound as well as fit-for purpose management policy of the attached algae downstream of a dam: an urgent environmental and ecological issue. We employ a stochastic differential equation (SDE) for describing the algae population dynamics. The SDE has two contrasting control variables; one of them is the dam discharge that is regular, while the other is singular that turns out to give the threshold to suppress the algae growth. Stochastic control problems based on SDEs have been central mathematical topics in wide range of research fields. Such examples include economics [28,47], finance and insurance [25,50,63], environmental science [10,27], and ecology [61,52,54]. Regular-singular stochastic control problems with analytical solutions have been mathematically analysed for economic problems [11,21,62]. For management of algae growth, it is reasonable to set the upper threshold of its population (or population density), above which the aquatic environment and ecosystems are severely affected [36]. This management policy would be effectively analysed within the context of the singular control. To our knowledge, no attempt has been made for singular control modelling of the algae growth and their management despite its potential applicability to the problem. Regular-singular stochastic control modelling of the algae growth is therefore a new attempt, which would give new insights on the management problem from both mathematical and practical viewpoints.
The singular control of the present SDE is slightly different from the conventional ones [3,Chapter 4.5 of 44] in that the singular control variable is multiplied by a power function of the state variable in the former. Related SDEs with a not usual but simpler singular control terms multiplied by state variables have been mathematically and numerically analysed [2,22,38,41,48]. A performance index to be maximized by the decision-maker, which is the manager of the dam, is presented under the assumptions that there exists a target value of the dam discharge and that the growth of algae is considered as not desirable. The stochastic control problem effectively reduces to a boundary value problem of a Hamilton-Jacobi-Bellman (HJB) equation: a degenerate elliptic variational inequality. A series of regularity results on the value function, the maximized performance index, are derived. In addition, the value function is characterized as a locally Lipschitz continuous viscosity solution to the HJB equation [44,15]. An explicit exact solution as the unique classical as well as viscosity solution to the HJB equation with the uncontrolled dam discharge is derived and its practical implications are presented. A more realistic regular-singular case with the controlled dam discharge is also analysed with the help of an asymptotic analysis technique, which clearly shows dependence of the optimal dam discharge on the early stage of algae growth. Numerical computation of the HJB equation is also carried out to validate the mathematical analysis results. The present mathematical model thus forms a regular-singular stochastic control problem having a sound application.
The rest of this paper is organized as follows. Section 2 formulates the problem and derives the HJB equation. Section 3 analyses regularity, parameter dependence, and viscosity property of the value function. Section 4 analyses the HJB equation with the uncontrolled dam discharge. Section 4 also deals with the problem with the controlled dam discharge and presents its numerical solutions that validate the mathematical analysis results. Section 5 concludes this paper and presents future perspectives of our research.

Problem setting
Population dynamics of attached algae on riverbed just downstream of a dam is considered. The main assumption made in the present mathematical model is that the detachment process of the algae is due to the physical factors by the bedload transport and shear stress [51]. In addition, it is assumed that the algae growth can be suppressed by the decision-maker, the manager of the dam, through activities such as river cleaning. The SDE here is based on a geometric Brownian type, which is a linearized counterpart of the logistic type models [20] employed in the algae population dynamics models [58]. Employing the simpler SDE allows us to derive a tractable model as demonstrated later.
The time is denoted as t ≥ 0. The 1-D standard Brownian motion on the complete probability space is denoted as B t . The population of the algae on the riverbed, such as the unit-area biomass, at the time t is considered as a non-negative stochastic process X t . There are two control variables in the present model. The one is the dam discharge q t , which is bounded, measurable, and has the compact range Q = [q min , q max ], 0 ≤ q min ≤ q max . The other is the non-decreasing right-continuous process η t having left-side limit [44], which turns out to give the allowable threshold of the algae growth, above which the aquatic environment and ecosystems are severely affected. The control η t conceptually represents a decrease in the algae population rather than by controlling the dam discharge q t . A typical and actually performed example in Japan is cleaning up of the riverbed by residents and/or local governments. Another example is controlling water quality and water environment surrounding the algae, such as improvement of water quality in the water stored in the dam so that the algae growth is suppressed. These countermeasures possibly lead to rapid environmental changes with time scales significantly smaller than that of the algae growth, thus can be represented as a singular control variable. Both control variables are adapted to a natural filtration generated by B t . The controls q t and η t are chosen so that the SDE (1) has a unique strong solution such that X t ≥ 0, t ≥ 0. The set of admissible controls q t and η t complying with the above-mentioned requirements are expressed as θ q and θ η , respectively. The subscript of the control variables is often omitted when there is no confusion.

Controlled SDEs
Hereafter, the notation X t− = X t−0 is employed for the sake of brevity of descriptions. The Itô's SDE that governs X t (t ≥ 0) with the initial condition X −0 = x ≥ 0 is set as where r > 0 is the deterministic growth rate of the algae, σ > 0 is the parameter that modulates inherent stochastic fluctuations involved in the population dynamics, R = R(q t ) is the detachment rate of the algae as a power function of the dam discharge q t , k > 0, n > −1, and 0 ≤ l ≤ 1 are the constant parameters to represent detachment characteristics of the algae. The parameter σ involves fluctuations of the dam discharge that cannot be resolved in the first term of the SDE (1). Notice that the set θ = {(q, η); q ∈ θ q , η ∈ θ η } is not empty. This is because at least q t = const ∈ [q min , q max ] and η t ≡ 0 are admissible. The parameters k and n represent the magnitude of the detachment rate and its sensitivity on the discharge q t . The value of the parameter n may depend on the algae species. Fovet et al. [16,17] imply that n = 0 is appropriate for some periphyton. On the other hand, for the macroalgae Cladophora glomerata Kützing, the previous research implies R(q) = O(W) [58,51]. Here, W is the work rate done by saltation of gravel bed materials that satisfies W = O(q B τ 1/3 ) where the bed shear stress is denoted as τ and the bedload discharge as q B . The empirical Manning's formula for bed shear stress gives τ = O(q 6/10 ) [5] and the Meyer-Peter and Müller's formula for bedload transport [37] gives q B = O(τ 3/2 ). Summarizing the above results yields W = O(τ 11/6 ) and hence R(q) = O(q 11/10 ) with n = 1/10. However, since these relationships are estimated from the empirical formulae, our model assumes n > −1, so that wider range of problems are handled. The parameter l represents the effectiveness of the singular control term X l t dη t (understood in the sense like [2]), the decrease in the algae population rather than by controlling the discharge. This parameter would depend on the algae species, and on the method to suppress the algae growth. The possible range of the parameter l is specified so that the problem with a conventional singular term (l = 0), proportional singular term (l = 1), and the intermediate case (0 < l < 1) is covered. This parameter would depend on the algae species, and on the method to suppress the algae growth. This is a practical rather than mathematical problem, and is not focused on in this paper.

Remark 2.1:
The process η t (t ≥ 0) admits the cumulative representation [14] η t = t 0 a s ds (or equivalently dη t = a t dt), with an unbounded non-negative process a t (t ≥ 0).

Performance index
The performance index to be maximized by the decision-maker is formulated from dam operational and ecological viewpoints. The performance index is denoted as J = J(x; q, η) and is formulated as where E x is the conditional expectation with X −0 = x ≥ 0. Each J i (i = 1, 2, 3) is specified as follows. Firstly, J 1 measures the deviation between the current dam discharge q and its target valueq (q min ≤q ≤ q max ) prescribed based on the purpose of the dam, which is assumed to be a positive constant, as where τ ≥ 0 is the first-hitting time of X τ = 0, p > (n + 1)/2 is a natural number, and δ > 0 is the discount factor. The parameter p represents the sensitivity of the decision-maker on the deviation |q s −q|. In the present model, δ represents the attitude of the manager of the dam; larger δ means that the manager addresses the problem from a longer term viewpoint, and vice versa. Secondly, J 2 measures ecological, environmental, fisheries, and social disutilities that the algae provide in a lumped manner as where γ > 0 is the weight constant and −l < m ≤ 1 is the sensitivity of the disutility on the algae population. Finally, J 3 measures the cost to suppress the algae growth as where β > 0 is the weight constant. The performance index in Equation (3) is different from the conventional one [58] in that the term J 3 exists and p = 1 in the latter. The assumptions p > (n + 1)/2 and −l < m ≤ 1 on the parameters are employed for technical reasons to facilitate the mathematical analysis in this paper. The condition p > (n + 1)/2 means that the decision-maker is sufficiently sensitive to the deviation |q t −q|. The condition −l < m ≤ 1 means that the decision-maker is sufficiently sensitive to the algae growth.

Remark 2.2: By Remark 2.1, J 3 is expressed with a as
The performance index maximized with respect to admissible q and η is defined as the value function = (x): The value function can be interpreted as the minimized net management cost. The optimal q and η to archive the maximization are expressed as q * and η * , and are referred to as the optimal (Markov) controls. The discount factor δ > 0 is assumed to be sufficiently large, so that is locally bounded. For this purpose, the following assumption is made throughout this paper.
This means that the decision-maker is sufficiently patient since δ represents the patience of the decision-maker. Assumption 2.1 is sufficient to guarantee the local boundedness of as shown in Proposition 3.1.

Hamilton-Jacobi-Bellman equation
The HJB equation is a variational inequality that governs = (x). Applying the dynamic programming principle as in some of the literatures ([2], Chapter 2.2 of [4], [23], [39]), the HJB equation is formally derived as where L q is the operator defined for generic sufficiently smooth f = f (x) as At each x > 0, the maximizer of the term max q∈Q L q can be seen as a function of x. This maximizer is then expressed as q * = q * (x) with the abuse of notation since the optimal dam discharge at each time t is expressed as q * = q * (X t ). The HJB equation is subject to the boundary condition | (0)| < +∞, which turns out to be (0) = 0 later. (10) can be rewritten as

Remark 2.3: By Remarks 2.1 and 2.2, Equation
where L q,a is the operator defined for generic sufficiently smooth Formally, the left-hand side of Equation (12) is unbounded if x l d dx + β < 0 with the optimal a * = +∞, which turns to be false for viscosity solutions as shown in the next section.

Remark 2.4:
It may be more natural to consider −J as the cost. Nevertheless, this paper adopts the non-positive cost as in the previous papers [58,60], so that a cost is consistently considered as a non-positive value. It should be noted that to consider the cost as a nonpositive value or a non-negative value does not affect the mathematical analysis results of this paper.

Discussion on the model assumptions
This paper is on theory and mathematical analysis of the controlled algae population dynamics. The present mathematical model is based on a series of assumptions, which should be justified. This sub-section summarizes these assumptions and discusses when they can be justified. The present mathematical model consists of the two mathematical concepts: the SDE (1) and the performance index (Equation (3)). For each q t ∈ θ q , the SDE (1) without the third term is a minimal SDE that describes temporal evolution of a non-negative quantity, such as a population. The coefficients involved in these terms are based on physical and biological considerations [58,16,17,51]. The third term represents the decrease in the algae population rather than by controlling the discharge q t , which is a very flexible term by the existence of the coefficient X l t . This term can potentially represent the direct (l = 0, such as cleaning up the river by residents and/or local governments) and indirect decrease in the population (l = 1, such as controlling the growth rate of the algae population by modifying its surrounding water environment) in particular. This term can potentially handle even the intermediate case (0 < l < 1) that can be seen as a direct (indirect) decrease case in which its effectiveness increases (decreases) as the population X t decreases (increases). Although the SDE (1) seems to be simple, it has a flexibility to handle a variety of cases. The model parameters can be identified through physical and biological experiments. More realistic problems where the growth rate depends on the population X t like the conventional logistic models can be handled at least numerically as demonstrated in Section 4.2 of this paper.
The performance index J in Equation (3) contains the three terms J 1 , J 2 , and J 3 that represent different indexes as described in Section 2.3. Relative magnitudes of the three terms are modulated by the parameters β and γ . The sensitivity of the integrand on the population dynamics X t and the control q t are modulated by the parameters p and m. Values of these model parameters depend on the decision-maker, and therefore different decisionmakers would have different parameter values. The technical assumptions on the sensitivity parameters p, m, n and δ (Assumption 2.1) can be justified when the decision-maker is sufficiently sensitive to the population dynamics and sufficiently patient; namely, when the decision-maker carefully observes the population dynamics and the control, and manages them from a long-term viewpoint.

Mathematical analysis of value function
The mathematical analysis here focuses on the HJB equation (10) rather than the controlled SDE (1).

Regularity
We first explore local boundedness and regularity of the value function in Equation (8). In this section, the solution X t to the SDE (1) subject to the initial condition x and admissible controls q and η is expressed as X x,q,η t . The local boundedness, namely wellposedness of , is guaranteed by the following proposition.

Proposition 3.1:
is bounded as with where E is presented in Equation (9).
Proof: The non-positivity (x) ≤ 0 directly follows from the functional form of J since each J i (i = 1, 2, 3) is non-positive. By Equation (3) through Equation (6) and the fact that the process X x,q,0 t is a time-homogenous geometric Brownian motion, we have Since substituting Equation (17) into Equation (16) yields and thus Equation (14) is derived. The value function is decreasing with respect to x ≥ 0 as the following proposition shows.
for t ≥ 0 and given admissible q and η. The first hitting time of X x i ,q,η t is denoted as τ i ≥ 0 (i = 1, 2). Then, we have τ 2 ≥ τ 1 a.s. and obtain the estimates and a.s. Consequently, by adding the three estimates, The inequality equation (22) leads to and taking the supremum of the most leftside of Equation (23) yields which completes the proof.
Proposition 3.2 means that the net cost increases as the algae grow more. Another estimate on , which is a key to show its local Lipschitz continuity, is provided below.
Parameter dependence of and its implications are also presented.
which proves the statement by the proof like that of Proposition 3.1. The proof of the part (b) is essentially the same with that of Proposition 3.2 because we have a.s. X t | r=r 1 ≤ X t | r=r 2 and X t | k=k 1 ≥ X t | k=k 2 for r 2 ≥ r 1 > 0 and k 2 ≥ k 1 ≥ 0. Proposition 3.4 implies the following statements. If the cost to suppress the algae growth, the disutilities that the algae provide, or the deterministic growth rate of the algae increases, then the net cost increases. It also implies that if the manager addresses the problem from a longer term viewpoint or the algae tend to be detached from the riverbed easier, then the net cost decreases. These results are consistent with our intuition, showing that this mathematical modelling is consistent with reality.

Viscosity property
In this subsection, it is shown that the value function defined in Equation (8) is a viscosity solution, namely an appropriate weak solution, to the HJB equation (10). Here, the definition of viscosity solutions to the HJB equation (10) is firstly presented. The Hamiltonian H = H(x, u, v, M), which is defined for x ∈ (0, +∞) and u, v, M ∈ R, is set as with and The Hamiltonian H is also degenerate elliptic. In addition, h is monotone in the sense that h(x, u 1 , v, M) ≤ h(x, u 2 , v, M) for u 1 ≤ u 2 . The Hamiltonian H is continuous with respect to its arguments.
Following Chapter 4.3 in [44], and by Remarks 2.1, 2.2, and 2.3, we employ the following assumption on H to require a consistency between the control problem with η and that with a.  [44], viscosity solutions to the HJB equation (10) are defined below.

(b) Viscosity sub-solution
A function w = w(x) with w(0) = 0 such that w ∈ C[0, +∞) is a viscosity subsolution to the HJB equation (10) for all x ∈ (0, +∞) and for all ϕ ∈ C 2 (0, +∞) such that x is a maximum point of is a viscosity solution to the HJB equation (10) in (0, +∞) if it is a viscosity super-solution as well as a viscosity sub-solution.

Remark 3.3:
Any viscosity solutions to the HJB equation (10) should have viscosity-super and sub-differentials that comply with Assumption 3.1 by Definition 3.1. The next theorem shows that the value function in Equation (8) is a viscosity solution to the HJB equation (10) under Assumption 3.1, implying consistency between the dynamic programming principle and the HJB equation at least in the viscosity sense.

Theorem 3.2: The value function in Equation (8) is a viscosity solution to the HJB equation (10) for sufficiently large δ.
Proof: The proof is essentially the same with those of Propositions 4.3.1 and 4.3.2 and Theorem 4.3.1 of Pham [44], since is locally bounded by Proposition 3.1. In addition, by Remark 2.2, J is continuous with respect to x and complies with the conditions of the quadratic growth required for Propositions 4.3.1 and 4.3.2 (The condition (3.8)) of Pham [44], and the present Hamiltonian H is continuous with respect to its all arguments. (8) is a viscosity solution to the HJB equation (10) that is continuous in [0, +∞) and locally Lipschitz continuous in (0, +∞). Therefore, the value function is continuously differentiable a.e. in (0, +∞).

Exactly solvable case: singular control
The HJB equation (10) is exactly solvable when the range Q of q is a singleton, namely when q min = q max =q. In this case, the HJB equation (10) reduces to where Lf for generic sufficiently smooth f = f (x) is given as Here,r can be interpreted as the net growth rate. A direct calculation inspired from literatures of exactly solvable singular control problems [25,26] shows the following proposition.
Equation (43) is a consequence of Assumption 2.1. Proposition 4.1 shows that 0 is a candidate of the value function, which is a viscosity solution to the HJB equation (10) since it is a classical solution belonging to C 2 (0, +∞) ∩ C[0, +∞). The following theorems present the verification results for classical solutions to the HJB equation (10). The idea of its proof was obtained from Proposition 3.2 of Højgaard and Taksar [26]. Proof: Set a small ε > 0. Let τ ε = inf{t ≥ 0 : X t ≤ ε} and t ε = min{t, τ ε }, t ≥ 0. Take an admissible η. The process η is decomposed into the continuous part η c and the discontinuous part η d where η = η c + η d . The set of discontinuous points of η in [0, t ε ] is denoted as .
As in the previous research [38,26,33], we consider a Skorohod-type problem with a solution (X t , η * ): where χ(S) is the indicator function for the set S and η * is the local time acting at x =x.
The process X t is now a geometric Brownian motion reflected at x =x. The above Skorohod problem admits a solution (X t , η * ) when l = 0, 1 by Theorem 5.4 in Chapter 10 of Øksendal and Sulem [40] since the drift and diffusion coefficients of Equation (59) are linear and Lipschitz continuous with respect to X t− . For 0 < l < 1, with the transformation of variables Y t = X 1−l t , Equation (59) can be rewritten as which again is an SDE of a geometric Brownian motion type, complying with the conditions required for Theorem 5.4 in Chapter 10 of Øksendal and Sulem [40]. Therefore, the above Skorohod problem admits a solution (X t , η * ) when 0 ≤ l ≤ 1. The next theorem shows that the function 0 is actually the value function , which completes the verification result. The idea of its proof was obtained from Proposition 3.3 of Højgaard and Taksar [26].
for the solution (X t , η * ) to the Skorohod-type problem (59)

Then, Equation (62) holds true.
Proof: For the case (a), application of the generalized Itô's formula gives Since and thus Taking t → +∞ obtains the desired result For the case (b), the process η * * t induces the discontinuity with the magnitude of the discontinuity (x − x)x −l at t = 0 and η * * t = η * t for t ≥ 0. Therefore, we have and thus The proof for the case (a) shows 0 (x) = (x), indicating Proposition 4.1 shows that the left-hand side of Equation (70) equals 0 (x), which proves the theorem for the case (b).
The following proposition reveals the parameter dependence of the thresholdx, which has a practical importance.

Proof:
The statement for β and −γ immediately follows from the functional form ofx in Equation (42). By Equation (9), we have By Equation (43), we have and In addition, when δ >r, we have where φ = 2σ −2 . The relationship Equation (75) can be rewritten as Since Equations (75) and (77) show ∂λ ∂(σ 2 ) < 0 (78) when δ >r. Introduce the notationȳ =x l+m for the sake of brevity of descriptions. Equation (42) shows and For sufficiently large δ, the first term (O(δ 0 )) in the right-hand side of Equation (79) dominates that of the second term (O(δ −1/2 )). Similar estimates apply to Equations (80) and (81) as well. Sinceȳ =x l+m , we have the statement of the proposition for the parameters δ, −r, and −σ 2 .
Proposition 4.2 implies the following statements. If the cost to suppress the algae growth increases or the manager addresses the problem from a longer term viewpoint, then the threshold to suppress the algae increases. In addition, it implies that if the disutilities that the algae provide increase, the net growth rate of the algae increases, or the stochastic fluctuations involved in the population dynamics increase, then the threshold to suppress the algae decreases. The obtained results show that the parameter dependence of the allowable thresholdx of the algae growth is monotone at least when δ is large. Therefore, the optimal policy to decide the control η, or equivalentlyx, can be effectively established if the decision-maker addresses the management problem from a sufficiently long-term viewpoint. Proposition 4.2 thus has practical implications for the algae growth management.

More realistic case: regular-singular control
The HJB equation (10) is not exactly solvable when the range Q of q is not a singleton. However, we can get analytical estimates, which allow us to better comprehend behaviour of . In this sub-section, we assume Q = [0, +∞) (q min = 0 and q max =→ +∞). A sharper estimate than that of Proposition 3.1 is immediately derived with the value function for the exactly solvable case 0 since 0 ≤ .

Proposition 4.3:
is bounded as Proof: Set admissible q and η. Sinceq ∈ Q, the statement follows from (x) ≤ 0, Bx m+1 ≤ 0 (x), and the inequality The following proposition is necessary to see that the optimal dam discharge q * = q * (x) is uniquely expressed with d dx at each x > 0.

Proposition 4.4:
The equation with a given constant C > 0 admits a unique solution z = z * such that z * >q.
When n = 0, z * that satisfies the requirement is uniquely found as z * =q + C 1 2p−1 . When −1 < n < 0, Equation (83) can be rewritten as (b) Assume l = 0. Then, there exists a thresholdx > 0 such that x l d dx Proof: For the case of 0 < l ≤ 1, assume that the statement of the proposition is not true.
Although the full profile of has not been derived as in the previous exactly solvable case, behaviour of and q * for small x > 0 is estimated as follows by Proposition 4.5. Proof: Assume the asymptotic behaviour of and q * as with some constants C 1 , C 2 ∈ R and ψ 1 , ψ 2 > 0. Then, by the functional form of the HJB equation (89) and Propositions 4.4 and 4.5, q * = q * (x) satisfies Substituting Equation (88) into Equation (90) with the assumption that x > 0 is sufficiently small leads to the consistency conditions By Proposition 4.5, the HJB equation (10) is now written as (92) for small x > 0. Substituting Equation (88) into Equation (92) with the assumption that x > 0 is sufficiently small leads to another consistency conditions Combining Equations (91) and (93) 1 show that, at least near x = 0, it is optimal to specify larger dam discharge for larger algae population. This result reveals the relationship among the performance index J specified by the decision-maker, the resulting value function , and the optimal dam discharge q * , at the early growth stage of the algae. has qualitatively the same functional shape with the integrand of J 2 near x = 0. The results obtained imply that changes more sharply for smaller m when the algae population is small. In addition, the derivative is unbounded at x = 0 when −l < m < 0, indicating that the decision-maker should immediately respond to the algae even at the early  growth stage. Similar results hold for q * except that its behaviour near x = 0 is governed not by m + 1 but by the index m+1 2p−1 . This indicates that the decision-maker more strongly responds to the algae at the early growth stage as p, which is the sensitivity of the deviation between the target and specified dam discharges, increases. Proposition 4.2 thus implies the importance of observing the early growth stage of the algae to decide the dam discharge.
The mathematical analysis results are validated through numerical computation of the HJB equation (10). The finite element scheme with the help of a penalization technique suitable for solving the degenerate elliptic boundary value problems such as variational inequalities is employed [57]. The detail of the scheme and its variant, and their application examples are not described here, but found in literatures [58,53,55,56,59]. Table 1 summarizes the specified parameter values used in the numerical computation. γ is fixed to 5 in Figures 1, 2, 5, and 6. n is fixed to 2.0 in Figures 3 and 4. These parameter values are chosen for demonstrating that the mathematical analysis results in this paper are true. The scales of the parameters and variables are therefore not of importance in this paper. The parameter values should be collected from field surveys and/or experiments, both of  which are currently undertaken by the authors and their co-workers. This paper focuses mainly on mathematics of the present model. Identifying the parameter values is therefore a future research topic and is beyond the scope of this paper. In the numerical computation, the computational domain is truncated as [0, 2] and is discretized into 800 elements. The boundary conditions are specified as = 0 at x = 0 and = −βx −l at x = 2, the latter being determined with the assumption thatx exists in [0, 2] for the model parameters specified here. The notation q * * = q * −q is employed in Figures 1 through 6 for the sake of simplicity of descriptions. Figures 1 and 2 plot the numerically computed and q * * for small x > 0, respectively. The computational results reasonably agree with Proposition 4.6, verifying the theoretical analysis results. Figures 3 and 4 show the computed , q * * , andx for different values of γ with m = −0.2 and m = 0.5, respectively. Figures 3 and 4 validate Remark 4.1. In addition, the results show that Proposition 4.2 holds true for the singular-regular case, implying that the optimal control η * is a barrier type that is exerted so that X t (t ≥ 0) is in [0,x] if X 0 ∈ [0,x] as in the exactly solvable case.  Finally, as an advanced topic, validity of the asymptotic analysis results in Proposition 4.6 is examined for the Verhulst counterpart where the SDE (1) is replaced by In the Verhulst counterpart (Equation (94)), the drift term is quadratic with respect to the solution. This model would serve as a more realistic mathematical model of the algae growth in which their deterministic growth rate is upper-bounded. Formal calculation analogous to that in Proposition 4.6 leads to the same asymptotic behaviour (Equation (86)). Figures 5 and 6 plot the computed and q * for small x > 0, respectively. The computational results are close to those presented in Figures 1 and 2, and clearly demonstrate that the asymptotic results of Proposition 4.6 for the model with SDE (1) apply also to the model with the Verhulst-type SDE (94) having a more complicated coefficient.

Conclusions
A stochastic control problem for finding the ecologically sound and fit-for purpose optimal policy to suppress bloom of the attached algae was formulated. The optimal control problem ultimately reduced to a boundary value problem of the HJB equation. The value function was characterized as a locally Lipschitz continuous viscosity solution to the HJB equation. The exactly solvable case subject to the uncontrolled dam discharge was firstly analysed, showing that the value function is the unique viscosity as well as classical solution to the HJB equation. In addition, parameter dependence of the optimal threshold to suppress the algae bloom was theoretically derived. The more realistic, regular-singular control case where the dam discharge is controlled was secondly analysed with the help of an asymptotic analysis technique. Parameter dependence of the optimal dam discharge was then analysed, implying impacts of the personality of the decision-maker on the optimal dam discharge during the early stage of the algae growth. Numerical computation of the HJB equation was finally carried out to verify the mathematical analysis results. The results presented in this paper would be helpful for comprehension and assessment of the algae growth dynamics and planning of their effective management policies.
In future research, we will consider a finite-horizon counterpart of the presented mathematical model where the parameters and coefficients such as the target dam discharge are time-dependent. This model is more realistic than the presented one, but an appropriate numerical technique will be necessary for its practical application. Utilizing the impulsive control [12,30] as an alternative to the singular one is also an interesting and practically meaningful research topic. Incorporating storage dynamics of the dam, which is temporally stochastic [8,45], would advance the mathematical modelling so that a more complicated dam operation policy can be handled. Along with the above-mentioned mathematical modelling, observations of dam discharge and algae growth in several Japanese rivers will be continued by the authors with the help of local fisheries cooperatives for deeper comprehension of their dynamics.