Internet-Draft Flow Aggregation for Enhanced DetNet July 2024
Xiong, et al. Expires 3 January 2025 [Page]
Workgroup:
DetNet
Internet-Draft:
draft-xiong-detnet-flow-aggregation-01
Published:
Intended Status:
Standards Track
Expires:
Authors:
Q. Xiong
ZTE Corporation
T. Jiang
China Mobile
J. Joung
Sangmyung University

Flow Aggregation for Enhanced DetNet

Abstract

This document describes the objectives and requirements of flow aggregation in scaling networks and proposes a scheme by aggregating DetNet flows based on DetNet flow-specific classification in enhanced DetNet, and suggests the flow identification of aggregated-class be used to indicate the required treatment and forwarding behaviors. Toward the end, the draft discusses how the novel flow aggregation scheme could be applied to realize the flow aggregation in a 5GS logical DetNet node participating in enhanced DetNet.

Status of This Memo

This Internet-Draft is submitted in full conformance with the provisions of BCP 78 and BCP 79.

Internet-Drafts are working documents of the Internet Engineering Task Force (IETF). Note that other groups may also distribute working documents as Internet-Drafts. The list of current Internet-Drafts is at https://datatracker.ietf.org/drafts/current/.

Internet-Drafts are draft documents valid for a maximum of six months and may be updated, replaced, or obsoleted by other documents at any time. It is inappropriate to use Internet-Drafts as reference material or to cite them other than as "work in progress."

This Internet-Draft will expire on 3 January 2025.

Table of Contents

1. Introduction

The [RFC8655] clearly states that Deterministic Networking (DetNet) operates at the IP layer and delivers service which provides extremely low data loss rates and bounded latency within a network domain. The DetNet Quality of Service (QoS) includes the bounded latency indicating the minimum and maximum end-to-end latency from source to destination and bounded jitter (packet delay variation).

As per [RFC8655], the DetNet data plane must support the aggregation of DetNet flows in order to support larger numbers of DetNet flows and improve scalability by reducing the per-hop states. Without aggregation, the considerable state information and the large number of signaling exchanges among individual flows to provision deterministic services in scaling networks are unbearable, and the per-relay system may limit the scale of DetNet networks.

The [RFC8938] introduces that the flow aggregation is the ability to aggregate individual flows along with their associated resource control into a large aggregate. It is recommended that the DetNet flow aggregation be enabled for compatible flows with the same or very similar QoS and CoS characteristics via the use of wildcards, masks, prefixes, and ranges. This RFC also suggests the reduction of per-hop states help avoid the per DetNet-flow specific state maintenance in a transit node. It further provides arguments on how DetNet services might be realized in term of delay bound, delay jitter and bandwidth provisioning.

Further, the [RFC8964], has proposed and expanded two methods of flow aggregation, one being the aggregation via LSP hierarchy and the other to aggregate DetNet flows as a new combined DetNet flow.

In the maturing IETF draft for scaling networks, i.e., [I-D.ietf-detnet-scaling-requirements], an enhanced DetNet should support different levels of co-existed applications with different SLAs requirements. From the use cases in [RFC8578] and [I-D.zhao-detnet-enhanced-use-cases], DetNet applications differ in their network topologies and specific desired behaviors. Different DetNet flows transmit and forward with different QoS behaviors. It should provide fine-grained service provisioning to achieve differentiated DetNet QoS. The DetNet flows with the same level of service requirements can be aggregated to receive collective treatments and forwarding behaviours. The DetNet flows can be classified and aggregated based on flow-specific characteristics. Moreover, the existing aggregation of individual flows may be still challenging for network operations. The aggregated flows still requires a large amount of control signaling to establish and maintain the states of DetNet flows when there will be large-scale deterministic flows over the dynamic network topology in enhanced DetNet. It is required to improve the scalability and forward packets at the class-aggregate level, instead of the per-flow or flow-aggregate level, for which the flow identification of aggregated-class might be adopted to indicate the per-hop behavior without the maintenance of excessive states in scaling networks.

This document, in the Section 2, describes the objectives & requirements of flow aggregation and proposes a novel aggregation scheme for DetNet flows based on DetNet flow-specific classification in enhanced DetNet. The proposal argues that the flow identification of an aggregated-class can be used to indicate the required treatment and forwarding behaviors in scaling networks. The Section 3 discusses the realization of DetNet flow aggreation for 5GS.

1.1. Requirements Language

The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT", "SHOULD", "SHOULD NOT", "RECOMMENDED", "MAY", and "OPTIONAL" in this document are to be interpreted as described in RFC 2119 [RFC2119].

1.2. Terminology

The terminology is defined as [RFC8655].

DC: DetNet Traffic Class

2. Objectives & Requirements: Flow Aggregation in Enhanced DetNet

2.1. DetNet Services to Aggregated Flows across Domains

Flow aggregation is recommended in the multi-domain scenario to achieve the end-to-end QoS guarantees for aggregated flow(s) that span across multiple domains. As per [I-D.ietf-detnet-scaling-requirements], different network implementations may be intended for different application domains, where there is no additional requirements for the coordination. As defined in [ITU-T Y.2122], the network operating parameters of a flow aggregate should be exchanged among different network domains. As shown in Figure 1, the DetNet domain B receiving an aggregated flow should identify the flow and get the service requirements such as the QoS parameters of the flow aggregate.


  Individual Flows +-----------------+                 +-----------------+
     ------->      |                 |                 |                 |
      ......       | DetNet Domain A | Aggregated Flow | DetNet Domain B |
     ------->      |                 | --------------> |                 |
                   +-----------------+                 +-----------------+

Figure 1: Aggregating DetNet Flows across Multiple Domains

2.2. Aggregated vs. Fine-grained QoS Provisioning

The IETF draft [I-D.ietf-detnet-scaling-requirements] specifies that different levels of applications differ in the SLAs requirements such as tight jitter, strict latency, loose latency and so on. While these types of aggregated requirements might bear the coarse-grained nature, individual flows demand differentiated DetNet treatments and more granular QoS forwarding behaviors. A DetNet node or domain adopting multiple forwarding technologies needs to transmit individual flows by aggregating them into a select treatment solution that corresponds to one of some pre-defined per-hop QoS behaviors, as shown in Figure 2. For example, as per [I-D.jlg-detnet-5gs], a 5GS as a logical DetNet node requires to achieve the service requirements and service levels of the aggregated flows, along with the provisioning of fine-grained per-hop behavior (PHB) to each individual flow.


                            DetNet-aware Node/Network
                           +--------------------------+
   Aggregated-flow 1 ----->|  Per-hop QoS Behavior 1  |
                           +--------------------------+
   Aggregated-flow 2 ----->|  Per-hop QoS Behavior 2  |
                           +--------------------------+
          ...              |           ...            |
                           +--------------------------+
   Aggregated-flow n ----->|  Per-hop QoS Behavior N  |
                           +--------------------------+

Figure 2: Aggregating DetNet flows to corresponding QoS PHBs

2.3. Scale Down States Maintenance at Transit Nodes

As per [I-D.joung-detnet-taxonomy-dataplane], the treatment solutions in data plane can be categorized based on performance and functional characteristics. For example, the category of a solution can be classified based on the traffic granularity, e.g., flow aggregate vs. class level. The class level is provided to simplify the control and accommodate traffic fluctuations by combining flows requiring the same or similar levels of service requirements. The flow aggregation based on the class level could further improve the scalability. As per [I-D.ietf-detnet-scaling-requirements], there may be a large number of traffic flows in a scaling network, which makes it nearly impossible to achieve the flow-specific state identification. As shown in the Figure 3, the flow identification of aggregated-class can be used to indicate the required treatment and forwarding behaviors without the need to maintain excessive states at transit nodes.

    Individual                Aggregated
      Flows   +-------------+  Flow(s)  +-------------+         +-------------+
     -------> |             |           |             |         |             |
       ...    |DetNet Node A|---------->|DetNet Node B|----->...|DetNet Node N|
     -------> |             |           |             |         |             |
              +-------------+           +-------------+         +-------------+

                               'Bucketed' into
              Large number of                      Fewer number of classes
             Individual Flows ----------------->  consisting of aggregated flows

Figure 3: Aggregating DetNet Flows to Improve Scalability

2.4. Implications of Flow Aggregations to Transit Nodes

When DetNet flows are aggregated based on service-class level, transit nodes provide deterministic services to a flow aggregate and go thru the per-class scheduling without the burden to maintain excessive per-flow states. Still, a transit node performing aggregation should ensure all per-flow service requirements within an aggregated class are achieved. For example, the latency or jitter bounds of an aggregated class shall not exceed the corresponding metrics of any individual flow that has been bucketed into the class. The aggregation based on the class level has data plane and controller plane aspects.

For the data plane, when DetNet flows are aggregated to a class, transit nodes provide service to the aggregate and not on a per-DetNet-flow basis. And the transit nodes supporting this type of aggregation should identify the class of the aggregated flows and ensure that individual flows receive the corresponding traffic treatment and forwarding behaviour.

For the controller plane, the service should be provisioned on an aggregated-class level. The resources should be controlled and scheduled on a per-class basis and the routes should be established to meet the service requirements with the allocated resources. The edge nodes must be able to handle admission control for DetNet flows to an aggregated class based on the available resources.

2.4.1. Flow Classification

The DetNet QoS can be achieved by aggregating flows based on DetNet flow-specific traffic classification and providing the traffic-forwarding treatment. The flow classification should consider the flow-specific characteristics such as traffic specification and service requirements. For example, the DetNet flows MAY be classified based on the service SLAs requirements of applications in scaling networks as per [I-D.xiong-detnet-differentiated-detnet-qos]. And the services can also be classified into tight/loose latency, large/small burst, periodic/non-periodic and large/small scale services as per [I-D.joung-detnet-taxonomy-dataplane]. Several classes can be predefined to indicate the different levels of applications with SLAs requirements and each class demands differentiated QoS behaviors and treatment as well as different DetNet capabilities in scaling networks.

2.4.2. Flow Identification

The flow identification is required to be dynamic and simplified to ensure the aggregated flows have compatible DetNet flow-specific QoS characteristics. For the data plane, individual flows may be aggregated for treatment based on shared service specification on aggregated-class level which is identified by an aggregation class (A-Class). A transit node should provide the class level traffic treatment based on A-Class. The aggregation class information may be used alone or together with other metadata to indicate the required queuing and forwarding behaviors. The encoding of the A-Class may reuse the DSCP/TC or existing field such as the TC field in A-Label as per [RFC8964]. And it also can be encapsulated with the deterministic latency information as per [I-D.xiong-detnet-data-fields-edp].

3. Realization of Flow Aggregation for 5GS DetNet Service

The 3GPP in its document [TS.23.501] has defined and standardized how a 5G system (5GS) may behave as a logical DetNet node, as well as how a 5GS DetNet node may integrate into the IP-domain DetNet as described in [RFC8655]. 3GPP has realized the functionalities of the DetNet forwarding sub-layer.

As a logical DetNet transit node, a 5GS behaves as a transparent box to external DetNet entities. It can connect to either DetNet end systems or full-fledged IP DetNet domain(s) or both. The 3GPP [TS.23.501] has demonstrated a ‘composite’ architecture in that a 5GS could act as one or more DetNet nodes upon the integration into the IP DetNet domain. The granularity of determining a 5GS DetNet node is per UPF for each network instance, with the corresponding UPF-id identified as the 5GS DetNet node-id.

The 3GPP [TS.23.503] has implicitly specified two types of DetNet related traffic parameters. One type is the higher-level per-(logical)-node QoS requirements like the node max-latency, max-loss, etc., while the other is more granular settings with which DetNet flow attributes and specifications are mapped to the Flow Description information. The DetNet flow specifications could be based on IP-tuple information, e.g., including IP address, protocol type, ToS, TCP/DUP ports, etc. The document [I-D.jlg-detnet-5gs] has provided more details.

3.1. Realization of 5GS DetNet Service across Domains

3GPP has so far standardized the forward sub-layer functionality for 5GS. It indicates a 5GS (logical) DetNet node could connect to other end systems and/or IP DetNet domains, together to form a holistic end-to-end DetNet. Thanks to the 'composite' architecture of a 5GS node, along with the interaction between an CPF:DetNet controller in IETF domain and the NF TSCTSF in 3GPP domain [TS.23.501], a 5GS node might realize much more advanced DetNet services than a traditional IP DetNet transit node.

In scenarios where the (IETF-domain) CPF:Detnet Controller could well divide the DetNet QoS service requirements that are in reality associated with an integrated DetNet domain into multiple QoS sub-requirements that together form the original end-to-end QoS equivalence, a 5GS might be considered as a standalone DetNet (sub-)domain with its own DetNet QoS (sub-)requirements that would be provisioned from the CPF:DetNet controller. The 5GS DetNet QoS (sub-)requirements serve a portion of the original requirements of the integrated DetNet domain. These together form a scaling network to realize the 5GS DetNet service across domains.

3.2. 5GS QoS Provisioning: Aggregated vs. Fine-grained

We have explained previously that the 3GPP [TS.23.503] has implicitly specified two categories of DetNet related traffic parameters. One type bears the aggregated nature for (5GS DetNet) node-level requirements, while the other addresses the more granular DetNet flow-level attributes and specifications. Evidently, with this kind of two-hierarchy architecture, a 5GS DetNet node could achieve not only the node-level aggregated QoS requirements, but also the more fine-grained flow-level QoS provisioning. This reflects the true value of applying our flow aggregation model in scaling networks to realizing advanced DetNet services for 5GS.

Here, we want to point out that the feasibility of applying our flow aggregation scheme indeed depends on the hierarchical nature of a 5GS DetNet node. Had the same aggregation scheme been applied to DetNet nodes that do not have the similar intrinsic hierarchy, the effectiveness could be certainly impaired.

3.3. State Maintenance at a 5GS Transit Node

The 5GS QoS architecture is roughly comprised of three levels, i.e., the UE, the PDU-session, and the QoS-flow levels. Technically, a 5GS DetNet node is of 'composite' nature with a large number of configuration, provisioning, operation and runtime states to maintain. At first glance, this might undermine the state-reduction objective via the flow aggregation for a 5GS DetNet transit node.

Fortunatley, the 5GS DetNet work owns intrinsically a couple of aspects to handle the challenges: First, also as we have mentioned before, a 5GS node behaves as a transparent entity participating in the DetNet domain. Thus, even having a significant number of states, this can naturally have the 5GS DetNet related states remain hidden from the external entities (and domains). Second, the 3GPP NF TSCTSF exchanges only traffic parameters with the IETF CPF:Detnet Controller, but not the states that are maintained inside a 5GS DetNet node. The external DetNet domain does not care the inside status of a 5GS, nor can it.

3.4. Flow Classification & Identification at 5GS Node

As we have explained so far, the IETF domain CPF:DetNet controller provides traffic parameters & specifications to 3GPP NF TSCTSF. Thus, the SLA requirements of applications in scaling networks could be readily pre-specified in the IETF DetNet CPF, which would then apply the flow classification mapping (to aggregated service classes) and send them over to a 5GS DetNet node to enforce. This model can also relieve the classification burden of a 5GS node in reality.

The 5GS has excellent control logics to address flow identification. For example, PDRs (Packet Detection Rules), SDF (Service Data Flow) filters (e.g., IP-filter, MAC-filter, etc.), etc., are all good tools to differentiate flows [TS.23.501]. Further, the 5GS has standardized powerful procedures for the establishment & update of PDU sessions/QoS flows, which accordingly achieves the flow dynamics (e.g., flow joining & leaving a flow-aggregate as manifested potentially by a PDU session) [TS.23.502]. Moreover, some QoS parameters, e.g., Aggregated Bit Rate (ABR), may stand at different levels, including UE-ABR, Session-ABR, flow-ABR, etc., that would make the service differentiation & sharing on the aggregated-class (A-Class) level feasible.

4. Security Considerations

Security considerations for DetNet are covered in the DetNet Architecture [RFC8655] and DetNet data plane [RFC8938], [RFC8939], [RFC8964] and DetNet security considerations [RFC9055]. The security considerations specified in [I-D.ietf-detnet-scaling-requirements] are also applicable to the procedures defined in this document.

5. IANA Considerations

This document makes no requests for IANA action.

6. Acknowledgements

The authors would like to acknowledge Bin Tan and Aihua Liu for the thorough review and very helpful comments.

7. References

7.1. Normative References

[I-D.ietf-detnet-scaling-requirements]
Liu, P., Li, Y., Eckert, T. T., Xiong, Q., Ryoo, J., zhushiyin, and X. Geng, "Requirements for Scaling Deterministic Networks", Work in Progress, Internet-Draft, draft-ietf-detnet-scaling-requirements-06, , <https://datatracker.ietf.org/doc/html/draft-ietf-detnet-scaling-requirements-06>.
[I-D.jlg-detnet-5gs]
Jiang, T., Liu, P., and X. Geng, "DetNet YANG Model Extension for 5GS as a Logical DetNet Node", Work in Progress, Internet-Draft, draft-jlg-detnet-5gs-01, , <https://datatracker.ietf.org/doc/html/draft-jlg-detnet-5gs-01>.
[I-D.joung-detnet-taxonomy-dataplane]
Joung, J., Geng, X., Peng, S., and T. T. Eckert, "Dataplane Enhancement Taxonomy", Work in Progress, Internet-Draft, draft-joung-detnet-taxonomy-dataplane-01, , <https://datatracker.ietf.org/doc/html/draft-joung-detnet-taxonomy-dataplane-01>.
[I-D.xiong-detnet-data-fields-edp]
Xiong, Q., Liu, A., Gandhi, R., and D. Yang, "Data Fields for DetNet Enhanced Data Plane", Work in Progress, Internet-Draft, draft-xiong-detnet-data-fields-edp-02, , <https://datatracker.ietf.org/doc/html/draft-xiong-detnet-data-fields-edp-02>.
[I-D.xiong-detnet-differentiated-detnet-qos]
Xiong, Q., Zhao, J., Du, Z., Zeng, Q., and C. Liu, "Differentiated DetNet QoS for Deterministic Services", Work in Progress, Internet-Draft, draft-xiong-detnet-differentiated-detnet-qos-01, , <https://datatracker.ietf.org/doc/html/draft-xiong-detnet-differentiated-detnet-qos-01>.
[I-D.zhao-detnet-enhanced-use-cases]
Zhao, J., Xiong, Q., and Z. Du, "Enhanced Use cases for Scaling Deterministic Networks", Work in Progress, Internet-Draft, draft-zhao-detnet-enhanced-use-cases-00, , <https://datatracker.ietf.org/doc/html/draft-zhao-detnet-enhanced-use-cases-00>.
[RFC2119]
Bradner, S., "Key words for use in RFCs to Indicate Requirement Levels", BCP 14, RFC 2119, DOI 10.17487/RFC2119, , <https://www.rfc-editor.org/info/rfc2119>.
[RFC4655]
Farrel, A., Vasseur, J.-P., and J. Ash, "A Path Computation Element (PCE)-Based Architecture", RFC 4655, DOI 10.17487/RFC4655, , <https://www.rfc-editor.org/info/rfc4655>.
[RFC4915]
Psenak, P., Mirtorabi, S., Roy, A., Nguyen, L., and P. Pillay-Esnault, "Multi-Topology (MT) Routing in OSPF", RFC 4915, DOI 10.17487/RFC4915, , <https://www.rfc-editor.org/info/rfc4915>.
[RFC5120]
Przygienda, T., Shen, N., and N. Sheth, "M-ISIS: Multi Topology (MT) Routing in Intermediate System to Intermediate Systems (IS-ISs)", RFC 5120, DOI 10.17487/RFC5120, , <https://www.rfc-editor.org/info/rfc5120>.
[RFC5440]
Vasseur, JP., Ed. and JL. Le Roux, Ed., "Path Computation Element (PCE) Communication Protocol (PCEP)", RFC 5440, DOI 10.17487/RFC5440, , <https://www.rfc-editor.org/info/rfc5440>.
[RFC6549]
Lindem, A., Roy, A., and S. Mirtorabi, "OSPFv2 Multi-Instance Extensions", RFC 6549, DOI 10.17487/RFC6549, , <https://www.rfc-editor.org/info/rfc6549>.
[RFC7752]
Gredler, H., Ed., Medved, J., Previdi, S., Farrel, A., and S. Ray, "North-Bound Distribution of Link-State and Traffic Engineering (TE) Information Using BGP", RFC 7752, DOI 10.17487/RFC7752, , <https://www.rfc-editor.org/info/rfc7752>.
[RFC8174]
Leiba, B., "Ambiguity of Uppercase vs Lowercase in RFC 2119 Key Words", BCP 14, RFC 8174, DOI 10.17487/RFC8174, , <https://www.rfc-editor.org/info/rfc8174>.
[RFC8231]
Crabbe, E., Minei, I., Medved, J., and R. Varga, "Path Computation Element Communication Protocol (PCEP) Extensions for Stateful PCE", RFC 8231, DOI 10.17487/RFC8231, , <https://www.rfc-editor.org/info/rfc8231>.
[RFC8233]
Dhody, D., Wu, Q., Manral, V., Ali, Z., and K. Kumaki, "Extensions to the Path Computation Element Communication Protocol (PCEP) to Compute Service-Aware Label Switched Paths (LSPs)", RFC 8233, DOI 10.17487/RFC8233, , <https://www.rfc-editor.org/info/rfc8233>.
[RFC8578]
Grossman, E., Ed., "Deterministic Networking Use Cases", RFC 8578, DOI 10.17487/RFC8578, , <https://www.rfc-editor.org/info/rfc8578>.
[RFC8655]
Finn, N., Thubert, P., Varga, B., and J. Farkas, "Deterministic Networking Architecture", RFC 8655, DOI 10.17487/RFC8655, , <https://www.rfc-editor.org/info/rfc8655>.
[RFC8664]
Sivabalan, S., Filsfils, C., Tantsura, J., Henderickx, W., and J. Hardwick, "Path Computation Element Communication Protocol (PCEP) Extensions for Segment Routing", RFC 8664, DOI 10.17487/RFC8664, , <https://www.rfc-editor.org/info/rfc8664>.
[RFC8938]
Varga, B., Ed., Farkas, J., Berger, L., Malis, A., and S. Bryant, "Deterministic Networking (DetNet) Data Plane Framework", RFC 8938, DOI 10.17487/RFC8938, , <https://www.rfc-editor.org/info/rfc8938>.
[RFC8939]
Varga, B., Ed., Farkas, J., Berger, L., Fedyk, D., and S. Bryant, "Deterministic Networking (DetNet) Data Plane: IP", RFC 8939, DOI 10.17487/RFC8939, , <https://www.rfc-editor.org/info/rfc8939>.
[RFC8964]
Varga, B., Ed., Farkas, J., Berger, L., Malis, A., Bryant, S., and J. Korhonen, "Deterministic Networking (DetNet) Data Plane: MPLS", RFC 8964, DOI 10.17487/RFC8964, , <https://www.rfc-editor.org/info/rfc8964>.
[RFC9055]
Grossman, E., Ed., Mizrahi, T., and A. Hacker, "Deterministic Networking (DetNet) Security Considerations", RFC 9055, DOI 10.17487/RFC9055, , <https://www.rfc-editor.org/info/rfc9055>.
[RFC9320]
Finn, N., Le Boudec, J.-Y., Mohammadpour, E., Zhang, J., and B. Varga, "Deterministic Networking (DetNet) Bounded Latency", RFC 9320, DOI 10.17487/RFC9320, , <https://www.rfc-editor.org/info/rfc9320>.
[RFC9357]
Xiong, Q., "Label Switched Path (LSP) Object Flag Extension for Stateful PCE", RFC 9357, DOI 10.17487/RFC9357, , <https://www.rfc-editor.org/info/rfc9357>.
[TS.23.501]
"3GPP TS 23.501 (V19.0.0): System Architecture for the 5G System (5GS)", 3GPP TS 23.501, .
[TS.23.502]
"3GPP TS 23.502 (V19.0.0): Procedures for the 5G System (5GS)", 3GPP TS 23.502, .
[TS.23.503]
"3GPP TS 23.503 (V19.0.0): Policy and charging control framework for the 5G System (5GS); Stage 2", 3GPP TS 23.503, .

Authors' Addresses

Quan Xiong
ZTE Corporation
China
Tianji Jiang
China Mobile
Jinoo Joung
Sangmyung University