This paper studies the multiple timescale behavior that is induced by dynamic coupling between continuous-time and discrete-time systems, and that arises naturally in distributed networked systems. An order reduction method is proposed that establishes a mathematically rigorous separation principle between the fast evolution of the continuous-time dynamics and the slow updates of the discrete-time dynamics. Quantitative conditions on the discrete update rate are then derived that ensure the stability of the coupled dynamics based on the behavior of the isolated systems. The results are illustrated for a distributed network of satellites whose attitudes evolve continuously while communicating intermittently over the network.
Introduction
In multi-agent systems, distributed graph-based protocols between agents are often coupled to dynamic weight evolution and tracking of the agents' own nonlinear dynamics. One approach to analyzing these types of complex systems is to assume that the agents' network communication occurs very quickly, leading to a set of coupled, continuous-time dynamics [1]. These purely continuous-time dynamics can then be collectively designed to achieve desirable behavior [2,3]. However, this approach can break down as the time between communication updates becomes too large, leading to instability [4,5]. An alternative approach is to view the updates over the network as occurring only intermittently. This produces an inherently hybrid-time character in the coupled dynamics, as shown in Fig. 1. Intuitively, if the agents move quickly relative to the slow discrete updates over the network, then they will reach their immediate goal, and the network dynamics will evolve as if the agents are always at their state-dependent equilibrium trajectory. This implies that, depending on the rate of updates, a decoupling is possible between the fast, continuous-time agent dynamics and the slow, discrete-time network dynamics that is based on the different characteristic timescales over which the subsystems evolve. Such a separation between the subsystem dynamics is useful because it has the potential to decrease the complexity of analyzing the coupled hybrid-time system, permitting the networked decision dynamics to be designed separately from the agents' dynamics. The question, then, is under what conditions is this separation valid?
Concepts from singular perturbation theory provide an effective approach for understanding such multiple timescale systems [6]. For purely continuous-time systems, singular perturbation theory describes how slow and fast behaviors are induced when a small parameter multiplies the time derivatives of a subset of the system states. The Tikhonov–Levinson theorem then gives conditions under which such a purely continuous-time system can be analyzed based on the properties of its isolated slow and fast dynamics [6,7]. Application of these conditions to networked dynamical systems, for example, has yielded graph-topological stability bounds for the consensus-tracking and state-dependent graph problems [8]. The success of the Tikhonov–Levinson conditions for simplified analysis of continuous-time systems with slow and fast behaviors has led to several extensions in the literature for different classes of systems. These include: (1) discrete-time systems [9], (2) differential inclusions [10], (3) impulsive differential equations [11,12], and (4) hybrid systems where the fast dynamics are constrained to evolve on a compact set [13,14]. However, by focusing on the role of a small parameter in inducing slow and fast behaviors, these extensions do not consider how the update rate can affect the behavior of coupled hybrid-time dynamics and allow their analysis to be simplified.
This paper addresses the described research gap. In particular, this work studies the role of the discrete update period on the properties of coupled continuous-time and discrete-time dynamics. The paper makes two main contributions. The first is a novel reduced-order modeling technique, based on concepts of perturbation and asymptotic theory, that provides mathematical rigor to the intuitive notion of a separation principle in such hybrid-time systems as the time between discrete updates grows. In particular, conditions are derived under which the design of the discrete-time dynamics can be separated from the behavior of the continuous-time dynamics, and asymptotic bounds on the error that this decoupled design introduces are explicitly computed in terms of the update period. In the context of networked systems, these conditions give insight into when a designer can choose the network-based update algorithm independently from the behavior of the individual agents. The second contribution is a set of quantitative conditions that give a lower bound on the update rate under which the coupled hybrid-time system is guaranteed to be stable, and which are based on stability properties of the decoupled systems. These techniques can be practically applied to understand the effects of implemented communication rates on the behavior of networked dynamical systems.
The structure of the paper is as follows: In Sec. 2, the hybrid-time system under study is defined. Section 3 then develops reduced-order models for the hybrid-time system and proves their efficacy under appropriate conditions. Next, Sec. 4 presents the method for finding quantitative stability bounds for the coupled hybrid-time dynamics. An application to a distributed network of satellites is illustrated in Sec. 5, and conclusions are presented in Sec. 6.
Problem Formulation
where the vector of discrete-time states is , the vector of continuous-time states is , updates of the discrete-time system occur at distinct times t1, t2,…, differences between these distinct times are lower-bounded by for , and μ = 1/τ measures the corresponding fastest update rate. In the context of networked dynamical systems, for example, y describes the agent states while x encodes the network states that update at time tk. Here, the dependence on μ in the last argument of f and g captures possible changes in the vector fields due to a change in the update rate. Similarly, the dependence of x0 and y0 on μ is included to capture possible changes in the initial conditions due to a different update rate being used. Of course, g, f, x0, and y0 may not change with the update rate in a particular system, but including this potential dependency on the update rate allows the ensuing results to be applied to a wider class of systems. To pose a well-defined problem, assume that:
Assumption 1. The functions g, f, x0, and y0 areas τ → ∞ in the domains Dy and Dx.
Assumption 2. The function g is continuously differentiable in all its arguments and the functions f, x0, and y0 are Lipschitz in their arguments over the domains Dy and Dx.
Reduced-Order Modeling
In this section, two reduced-order models are formulated for the hybrid-time system (1). The validity of these models in approximating the behavior of Eq. (1) is then rigorously proven, justifying the separate design of the continuous-time agent dynamics from the discrete-time network decision dynamics. The reduced-order models are characterized as follows:
subject to .
subject to for the first interval and otherwise, and where is the state vector of the decision system defined in Eq. (2).
Remark 1. The decision system (2) describes the reduced-order behavior of the isolated discrete-time network dynamics with the continuous-time agent dynamics always at their state-dependent equilibrium. Note that the system is purely discrete.
Remark 2. The interval correction system (3) describes the evolution of the isolated continuous agent dynamics toward the equilibrium trajectory between each set of consecutive discrete updates. The initial conditions are based on the state vector of the decision system alone. They are independent of the state of the interval correction system on any previous intervals. Note that the interval correction system describes purely continuous-time dynamics. The new time variable η is introduced here to make clear that solutions of Eq. (3) are dependent on the elapsed time and are defined only for a particular interval .
Remark 3. The last argument of the vector fields f and g is set to zero in Eqs. (2) and (3) because the reduced-order models describe the dynamics in the limit of τ growing very large so that the discrete network updates always occur with the agents at their state-dependent equilibrium.
Remark 4. While the original dynamics (1) are fully coupled, the reduced-order models (2) and (3) obtain their triangular structure by exploiting the equilibrium trajectory .
With the reduced-order models defined in Eqs. (2) and (3), the next logical question is under what conditions these models provide an accurate description of the original coupled dynamics (1). To this end, the following lemma first provides conditions to ensure that the approximation provided by the reduced-order continuous-time interval dynamics remains close to the true continuous-time dynamics over the time interval , given that the initial conditions of Eq. (3) and the state vector of the decision system (2) are both close to the true values of Eq. (1) at the start of the interval.
holds for all t∈[tj, tk+1).
Proof. The proof of the lemma follows three steps:
- (1)
Formulate the dynamics of the continuous-state approximation error over an interval as a perturbed version of the interval correction dynamics.
- (2)
Use the stability of the interval correction system and a converse Lyapunov theorem to obtain a Lyapunov function with certain desirable bounding properties for the interval correction dynamics.
- (3)
Use the interval correction dynamics' Lyapunov function as well as the form of the perturbation in dynamics of the continuous-state approximation error to obtain bounds on the norm of this approximation error.
The steps are detailed as follows:
Step 1. In the following, all instances of will be written as x and all instances of as for conciseness since both and are constant over the interval where the analysis is performed.
hold over the domain.
and for class functions αi defined on [0, r].
This gives the bound on for all tk ≤ t < tk+1. Since Eq. (6) gives an asymptotically decaying bound on , τ can be chosen large enough that there exists a tj with tk < tj ≤ tk+1 such that for t ≥ tj and thus holds for all t ∈ [tj, tk+1). □
In Lemma 1, the Landau “little-Oh” o(1) bounds on the approximation error of the continuous agent state over an interval can be interpreted as saying that this error decreases asymptotically as τ grows large even though the reduced-order model is not quite the same as the full model and the approximation starts from different initial conditions than the true dynamics. This is a result of the assumption of uniform asymptotic stability for Eq. (3), which allows the continuous dynamics to eventually evolve to a known trajectory when is known. As described by the following lemma, tighter bounds on this approximation error can be found under the more restrictive assumption of exponential stability for Eq. (3).
Lemma 2. Under the conditions of Lemma 1, if instead the errors in initial conditions areand the interval correction system (3) is exponentially stable for all pointsand their corresponding known trajectories, then the o(1) bounds on the approximation in Lemma 1 are replaced bybounds.
Proof. The proof adopts the same three-step structure as the proof of Lemma 1, with the following changes:
Step 1. Follows identically.
Step 2. By Ref. [7, Theorem 4.14], the conditions on the converse Lyapunov function V are satisfied with for i = 1, 2, 3 and for positive constants c1–c4.
whose first term is of for all η ≥ 0 if , and whose second term is of because d is and since the integral is bounded for all η ≥ 0. This gives the bound on for all tk ≤ t < tk+1. Since has an exponentially decaying bound in η, τ can be chosen large enough that there exists a tj with tk < tj ≤ tk+1 such that , giving the desired bound on . □
Under the more stringent condition of exponential stability for the interval correction system (3), the corresponding Landau “big-Oh” bounds in Lemma 2 give a stricter statement of the rate of the approximation error's decrease as τ grows large. This is possible because exponential stability gives concrete time bounds for the evolution of y toward in step 3 of the lemma.
With Lemmas 1 and 2 in place, the validity of approximating the coupled hybrid-time system (1) by dynamics of the reduced-order models (2) and (3) can now be determined.
holds for all t∈[tj, tk+1).
Proof. The proof uses induction to follow the error in the approximation for x over discrete updates, with the error in the y approximation bounded over the continuous-time intervals using Lemma (1).
hold by induction for any finite number of discrete updates, and thus are valid for all t ∈ [t0, tf]. The bound on y for t ∈ [tj, tk+1) then comes from application of Lemma 1. □
Again, stricter bounds on the approximation errors may be found by assuming exponential stability of the interval correction system.
Corollary 1. Under the conditions of Theorem 1, if the interval correction system (3) is instead exponentially stable for all pointsand their corresponding known trajectories, then the o(1) bounds on the approximation in Theorem 1 are replaced bybounds.
Proof. The desired results follow identically to the proof of Theorem 1 by noting that (1) both and hold since x0 and y0 are Lipschitz, (2) the continuous-interval bounds given by Lemma 2 may be used instead of the bounds given by Lemma 1 since the stricter requirement of Eq. (3) being exponentially stable is met here. □
Theorem 1 provides a certificate that Eqs. (2) and (3) are good approximations of Eq. (1) as τ grows large, with the trajectories of the reduced-order approximations remaining asymptotically close to the trajectories of the full system. Intuitively, the error bounds grow smaller as the update period grows because the continuous-time agent dynamics have more time to reach their equilibrium trajectory, making the reduced-order models more accurate. Corollary 1 then provides stricter bounds on the approximation error by assuming exponential stability instead of asymptotic stability, as in Lemma 2. These results give mathematical rigor to the notion of a separation principle between the continuous-time and discrete-time dynamics, as desired.
Stability Bounds on Communication Rate
For the purpose of implementation, quantitative bounds on τ are desirable that guarantee stability of the hybrid-time system (1). If the reduced-order discrete-time decision system (2) is designed assuming that the continuous-time dynamics are always at their state-dependent equilibrium, then too-frequent updates may lead to instability of the coupled dynamics (1). This is because at the time of the next update, the continuous-time states would not have had a chance to reach their new equilibrium and may in fact have initially moved away from this equilibrium due to nonminimum phase behavior [6, Chap. 6]. This section therefore details an approach to find sufficient lower bounds on τ above which the hybrid-time system is guaranteed to be stable under given conditions and using the stability properties of the individual reduced-order models.
subject to and valid for all time t ≥ t0. This collection of states will be denoted in the following by .
In order to derive explicit numerical conditions that guarantee stability of Eq. (7), it will be further assumed that
with, and
with, and
with, and .
Assumption 3 implies that the discrete x dynamics have a zero equilibrium when and μ = 0. This is reasonable as equilibrium of interest can be relocated to zero by a simple coordinate shift [7]. Assumption 4 allows to have a stable zero equilibrium when μ = 0, while Assumption 5 provides state-dependent bounds on the change in the continuous agent dynamics' state-dependent equilibrium trajectory due to a discrete update. Nonlinearities of these types are standard in the interconnected systems literature and cover a wide class of practical systems including the attitude dynamics of precision-pointing spacecraft [15, Chap. 6] and multimachine power systems [16,17].
With these assumptions in place, the following theorem now gives sufficient conditions under which the error dynamics (7) are stable about the origin. The approach uses the well-known theory of vector Lyapunov functions [18, Chap. 2], which allows stability properties of the isolated subsystems to be leveraged in the analysis by loosening the restrictions on scalar Lyapunov functions for hybrid systems [19].
where ρ(⋅) denotes the spectral radius of a matrix; then the error dynamics (7) are stable about zero for all τ ≥ τ⋆.
Proof. The proof follows by construction of a vector Lyapunov function and analysis of the corresponding comparison system. To begin, assume the vector Lyapunov function (see Ref. [18, Chap. 2], for example) with and and Pi > 0. Further assume that the LMIs are satisfied for some . Since μ comes into the LMIs through a positive semidefinite matrix, the LMIs are also satisfied for all , or equivalently all .
Since Φ ≤ 0, the inequality therefore holds.
Thus, holds since Ψ ≤ 0.
the condition is feasible if d11 + d12(κ1/κ2) ≤ 1. Therefore, choosing such that , and noting that is monotonic in τ, the original system (1) is stable for all . ◻
The results of Theorem 2 yield stability bounds for the hybrid-time system. The matrices in the LMIs are slack matrices that allow a simpler comparison system to be analyzed in the proof instead of the original dynamics. This comparison system is based on Lyapunov functions for the individual continuous-time and discrete-time dynamics. Of course, the acquired bounds may be conservative since they are based on particular Lyapunov functions. However, the outlined approach can be adapted if more information, such as more appropriate Lyapunov functions, are known for the reduced-order models.
Application
This section presents an application of the paper's main results to the analysis of a distributed network of satellites. Using the approach detailed in Sec. 3, reduced-order models are derived that decouple the satellites' discrete-time leader–follower consensus protocol from their individual continuous-time attitude tracking dynamics when the update rate is slow. A bound on the update rate is then found that guarantees stability for the coupled hybrid-time system using the method of Sec. 4, and it is shown how update rates faster than this bound can cause instability.
Consider a group of satellites communicating intermittently over a network to distributively reach consensus on their attitude as illustrated in Fig. 2, where the ith satellite's attitude is represented by the modified Rodrigues parameters (MRPs) . Further assume that one satellite, the leader, has knowledge of the desired attitude σdesired for the group. A distributed protocol for the ith satellite's reference attitude is then provided by the discrete leader–follower dynamics
where , and where accounts for the nonlinear effects of imperfect actuation in the control. This is a tracking controller that stabilizes to when σref,i is fixed.
given by Eqs. (2) and (3), respectively, become good approximations of the true dynamics as the minimum time τ between discrete updates increases. Here, the reduced-order decision dynamics for describe discrete-time leader–follower dynamics whose behavior is linked to the communication graph's topology.
which is of the form Eq. (7). Now, for the satellite and network parameters defined in Table 1, Assumptions 1 and 3 of Theorem 2 are satisfied with
Parameter | Value |
---|---|
c1 | 0.4⋅ 1 |
c2 | 1 |
Δ | 0.4 |
Barbell graph on 8 nodes |
Parameter | Value |
---|---|
c1 | 0.4⋅ 1 |
c2 | 1 |
Δ | 0.4 |
Barbell graph on 8 nodes |
while Assumption 2 holds by assuming that . The LMIs and spectral radius inequality in Theorem 2 are then satisfied using the constants defined in Table 2, providing the bound s. As expected, Fig. 4(a) shows that the hybrid-time system is stable when τ = 33 s. However, the bound given by any particular combination of parameters that satisfy Theorem 2 may be conservative. For these particular initial conditions, Fig. 4(b) demonstrates that the satellites exhibit unstable oscillations in their attitudes when τ = 10 s. In this particular case, the instability is due to a resonance phenomenon where the distributed decisions on new reference attitudes are made when satellites have overshot their previous reference attitudes. For large enough τ, however, the satellites' attitudes settle closer to their individual references, which allows the discrete leader–follower consensus protocol to evolve in a stable fashion as designed. This example illustrates the potential danger of too-frequent communication updates even for systems where the discrete network dynamics and continuous agent dynamics are stable when isolated.
Conclusion
This paper examined the interactions between continuous-time and discrete-time dynamics often found in networked systems. First, a separation principle between the continuous-time agent dynamics and the discrete-time network dynamics was proven as the period between updates of the discrete system grows. Different asymptotic error bounds for the resulting reduced-order models were found based on the stability properties of the isolated continuous-time agent dynamics. Intuitively, these bounds grow tighter for a slower communication rate because the continuous-time system can evolve closer to its state-dependent equilibrium, yielding a more accurate trajectory in the reduced-order models. In the context of networked dynamical systems, this separation principle rigorously justifies the isolated design of discrete-time network dynamics and continuous-time agent dynamics. Next, a method was described for establishing quantitative upper bounds on the update rate below which the coupled hybrid-time system is guaranteed to be stable. The approach uses separate Lyapunov functions for the continuous-time agent dynamics and the discrete-time network dynamics to form a simpler comparison system that establishes stability of the coupled hybrid-time system when the bound is satisfied. When updates occur faster than this bound, however, the system can become unstable even if the decoupled network and agent dynamics are individually stable. This is because the agents no longer have adequate time to approach their reference trajectories before the next update, and may in fact initially diverge from their reference trajectories due to non-minimum phase behavior. An application where satellites intermittently communicate over a network to establish consensus on their attitudes illustrated these results.
Funding Data
National Science Foundation (CAREER Award No. 155229).
Nomenclature
- Times and Rates
- tk =
time at the kth update of the discrete-time system, s
- =
time immediately following the kth update of the discrete-time system, s
- =
time immediately preceding the kth update of the discrete-time system, s
- t0 =
initial time, s
- μ =
fastest update rate of the discrete-time system, 1/τ, Hz
- =
sufficient upper bound on the update rate to guarantee stability of the coupled system, , Hz
- τ =
lower-bound on time between updates of the discrete-time system, s
- =
sufficient lower-bound on τ to guarantee stability of the coupled system, s
- Full Model Symbols
- Dx =
domain of the discrete-time state vector x
- Dy =
domain of the continuous-time state vector y
- f =
vector field of the discrete-time dynamics, mapping
- g =
vector field of the continuous-time dynamics, mapping
- nx =
dimension of the discrete-time state vector x
- ny =
dimension of the continuous-time state vector y
- x =
discrete-time state vector of the dynamics
- =
value of the discrete-time state vector x at time
- =
value of the discrete-time state vector x at time
- x0(μ) =
initial conditions of the discrete-time state vector x, a function of the update rate μ
- y =
continuous-time state vector of the dynamics
- =
error between the true continuous-time state vector y(t) and the state-dependent equilibrium trajectory , defined for all t ≥ t0
- y(tk) =
the value of the true continuous-state vector y at the discrete-update at time tk. Note that
- =
value of the error between the true continuous-time state vector y and the state-dependent equilibrium trajectory at time
- =
value of the error between the true continuous-time state vector y and the state-dependent equilibrium trajectory at time
- y0(μ) =
initial conditions of the continuous-time state vector y, a function of the update rate μ
- z =
collection of the state vectors x and
- Reduced Model Symbols
- h(p, t) =
equilibrium trajectory of the isolated continuous-time dynamics, mapping
- =
time interval between tk (inclusive) and tk+1 (exclusive)
- =
state vector of the reduced-order discrete-time decision system
- =
value of the reduced-order discrete-time decision system state vector at time
- =
value of the reduced-order decision system state vector at time
- =
state vector of the reduced-order continuous-time interval correction system defined on the interval , a function of the elapsed time η within the interval
- =
value of the state vector of the kth interval correction system at η = 0
- η =
elapsed time within the time interval