MPLS Working Group X. Song Internet-Draft Q. Xiong Intended status: Standards Track ZTE Corp. Expires: 22 January 2025 R. Gandhi Cisco Systems, Inc. 21 July 2024 MPLS Network Action for Deterministic Latency draft-sxg-mpls-mna-deterministic-latency-01 Abstract This document specifies formats and principles for the MPLS Network Action for Deterministic Latency to provide guaranteed latency services. They are used to make scheduling decisions for time- sensitive services running on Deterministic Network (DetNet) nodes that operate within a single or multiple domains. Status of This Memo This Internet-Draft is submitted in full conformance with the provisions of BCP 78 and BCP 79. Internet-Drafts are working documents of the Internet Engineering Task Force (IETF). Note that other groups may also distribute working documents as Internet-Drafts. The list of current Internet- Drafts is at https://datatracker.ietf.org/drafts/current/. Internet-Drafts are draft documents valid for a maximum of six months and may be updated, replaced, or obsoleted by other documents at any time. It is inappropriate to use Internet-Drafts as reference material or to cite them other than as "work in progress." This Internet-Draft will expire on 22 January 2025. Copyright Notice Copyright (c) 2024 IETF Trust and the persons identified as the document authors. All rights reserved. Song, et al. Expires 22 January 2025 [Page 1] Internet-Draft MNA for Deterministic Latency July 2024 This document is subject to BCP 78 and the IETF Trust's Legal Provisions Relating to IETF Documents (https://trustee.ietf.org/ license-info) in effect on the date of publication of this document. Please review these documents carefully, as they describe your rights and restrictions with respect to this document. Code Components extracted from this document must include Revised BSD License text as described in Section 4.e of the Trust Legal Provisions and are provided without warranty as described in the Revised BSD License. Table of Contents 1. Introduction . . . . . . . . . . . . . . . . . . . . . . . . 2 2. Conventions . . . . . . . . . . . . . . . . . . . . . . . . . 3 2.1. Requirements Language . . . . . . . . . . . . . . . . . . 4 2.2. Terminology . . . . . . . . . . . . . . . . . . . . . . . 4 3. Enhanced Deterministic Network Requirements . . . . . . . . . 4 3.1. Queuing Delay . . . . . . . . . . . . . . . . . . . . . . 4 3.2. Deterministic Latency . . . . . . . . . . . . . . . . . . 5 4. MPLS Extensions for Deterministic Latency . . . . . . . . . . 5 4.1. Enhanced DetNet MPLS Header for Deterministic Latency . . 5 4.2. Deterministic Latency Network Action . . . . . . . . . . 7 5. IANA Considerations . . . . . . . . . . . . . . . . . . . . . 9 6. Security Considerations . . . . . . . . . . . . . . . . . . . 9 7. Acknowledgements . . . . . . . . . . . . . . . . . . . . . . 10 8. Normative References . . . . . . . . . . . . . . . . . . . . 10 9. Informative References . . . . . . . . . . . . . . . . . . . 10 Authors' Addresses . . . . . . . . . . . . . . . . . . . . . . . 12 1. Introduction [RFC8655] defines Deterministic Network (DetNet) architecture. The overall framework for DetNet data plane is introduced in [RFC8938]. Deterministic Networking (DetNet) operates at the IP layer and delivers services with low data loss rates and bounded latency guarantee within a network domain. [RFC8964] introduces the DetNet MPLS data plane technology, providing a foundation of building blocks to enable PREOF (Packet Replication, Elimination and Ordering Functions (PREOF)) functions to the DetNet service sub-layer and forwarding sub-layer. The DetNet service sub- layer includes a DetNet Control Word (d-CW), service label (S-Label), and aggregation label (A-Label) in special case of S-Label used for aggregation. The DetNet forwarding sub-layer supports one or more forwarding labels (F-Labels) to forward a DetNet flow over MPLS domains. The DetNet forwarding sub-layer provides corresponding forwarding assurance with resource allocations and explicit routes. Song, et al. Expires 22 January 2025 [Page 2] Internet-Draft MNA for Deterministic Latency July 2024 To support time-sensitive services with ultra-low loss rates and deterministic latency, feasible scheduling mechanisms must be applied to specific applications for deterministic networking. As described in [RFC9320], the end-to-end bounded latency is the sum of non- queuing and queuing delay bounds along with the queuing mechanisms. The queuing mechanisms, as mentioned in [RFC9320] and [RFC8655], which include Time Aware Shaping IEEE802.1Qbv, Asynchronous Traffic Shaping IEEE802.1Qcr, cyclic-scheduling queuing mechanism proposed in IEEE802.1Qch. In terms of delay guarantee for different applications, selecting the right scheduling/queuing mechanism applied to a specific application is required. Based on the existing DetNet MPLS encapsulations and mechanisms [RFC8964], the document defines the encoding format for the Deterministic Latency Network Action (DLNA) option in the MPLS data plane. But with DetNet network scaling up or flows number increased in the same work, some enhanced data plane requirements for DetNet network are brought, which are described at the [I-D.ietf-detnet-scaling-requirements]. This document follows the enhanced data plane requirements and introduces the MPLS Network Actions (MNA) solution to address the requirements specified in section 4.2 of [I-D.ietf-detnet-scaling-requirements]. The deterministic network should support synchronized or asynchronized queuing mechanisms. Different queuing mechanisms require different information to be defined as the DetNet-specific metadata to help ensure deterministic latency, including regulation, queue management, etc. The use case Delay Budgets for Time Bound Applications are under discussion in the MPLS MNA [I-D.ietf-mpls-mna-usecases] document. MPLS Network Actions (MNA) indicate actions for LSPs and/or MPLS packets and transfer data needed for these actions. [I-D.ietf-mpls-mna-hdr] defined the MNA solution for carrying Network Actions with Sub-Stack Data and associated Ancillary Data (AD) (i.e., in the MPLS label stack). This document presents one MPLS MNA solution for Deterministic Latency. It follows the MPLS MNA requirements specified at [I-D.ietf-mpls-mna-requirements] and MPLS MNA header specifid at [I-D.ietf-mpls-mna-hdr] to support basic DetNet service and DetNet service with enhanced DetNet data plane requirements specified at [I-D.ietf-detnet-scaling-requirements] . 2. Conventions Song, et al. Expires 22 January 2025 [Page 3] Internet-Draft MNA for Deterministic Latency July 2024 2.1. Requirements Language The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT", "SHOULD", "SHOULD NOT", "RECOMMENDED", "NOT RECOMMENDED", "MAY", and "OPTIONAL" in this document are to be interpreted as described in BCP 14 [RFC2119] [RFC8174] when, and only when, they appear in all capitals, as shown here. 2.2. Terminology Refer to [RFC8655], [RFC8964], [I-D.ietf-mpls-mna-hdr], [I-D.ietf-mpls-mna-fwk], [I-D.ietf-mpls-mna-requirements] and [RFC9320] for the key terms used in this document. Deterministic Latency (DL): The ability to precisely determine the delay in the network from source to destination(s). The delay is variable and depends on the queuing mechanisms used for network flows and the operations of the network nodes. The delay variation is acceptable but should be bounded and measurable. Deterministic Latency Network Action (DLNA): Used to indicate deterministic latency network action for MPLS data plane. 3. Enhanced Deterministic Network Requirements 3.1. Queuing Delay [RFC8655] provides the architecture for deterministic networking (DetNet), which enables the service delivery of DetNet flows with extremely low packet loss rates and deterministic latency. The forwarding sub-layer provides corresponding forwarding assurance but can not provide the deterministic latency (including bounded latency, low packet loss and in-order delivery). As described at [RFC9320], the end-to-end bounded latency for one DetNet flow is the sum of the delay bound of non-queuing and queuing processing latency. The delay bound for non-queuing processing may include output delay, link delay, frame preemption delay, and processing delay, the delay bound for queuing processing may include regulator delay, queuing delay. It is assumed that the delay of non-queuing processing is fixed or be ignorable, the delay of queuing processing is variable. To realize the guarantee of bounded latency service, it is important to select the right queuing methodology applied to specific applications and carry necessary queuing delay information for the computation of end- to-end latency. The existing switches and routers have the ability to classify traffic and provide independent queuing mechanisms based on Class of Service (CoS) that CoS is used in the Priority Code Point (PCP) field Song, et al. Expires 22 January 2025 [Page 4] Internet-Draft MNA for Deterministic Latency July 2024 of the 802.1Q, DSCP field in IPv4 header and Traffic Class field in IPv6 field. CoS defines the priority levels of traffic and QoS uses these CoS values to handle traffic to optimize traffic transmission. To achieve deterministic/bounded latency service requirements, the queuing mechanisms, as mentioned in [RFC9320] and [RFC8655], Time Aware Shaping IEEE802.1Qbv, Asynchronous Traffic Shaping IEEE802.1Qcr, cyclic-scheduling queuing mechanism proposed in IEEE802.1Qc are used in single or multiple domains network. 3.2. Deterministic Latency The DetNet data plane encapsulation in the transport network using the MPLS data plane is specified in [RFC8964]. A deterministic latency option is required to address the DetNet scaling question and support the enhanced data plane requirements described at [I-D.ietf-detnet-scaling-requirements]. The option should include end-to-end and hop-by-hop processing of packets to be adaptive to different queuing mechanisms in DetNet networks. The DetNet routers in the data plane perform MPLS forwarding functions using a feasible way with sufficient network resources for the incoming packets and make the right selection on the queuing or scheduling mechanisms applied for specific DetNet flows to satisfy strict deterministic service criteria in the forwarding output port. The queuing or scheduling mechanism information is carried in the MPLS header. Refer to [I-D.stein-srtsn], considering the time latency information is processed per hop so that the time latency information (such as deadline time, cycle identify, etc.) of each DetNet node for DetNet flows is expected to be carried as a set of lists of LSEs in MPLS data plane. 4. MPLS Extensions for Deterministic Latency This document provides an optional MNA header to address enhanced DetNet data plane requirements described at [I-D.ietf-detnet-scaling-requirements] to support different deterministic service categories such as bandwidth guarantee, bounded latency, loss ratio guarantee, etc. 4.1. Enhanced DetNet MPLS Header for Deterministic Latency To support deterministic bounded latency service, this document introduces an MNA option for Deterministic Latency Network Action (DLNA). As shown in Figure 1, the MNA label is inserted to indicate the presence of MPLS Network Actions. The format for DLNA follows the DetNet data plane MPLS encapsulation specified at [RFC8964] and MNA encapsulation specified in [I-D.ietf-mpls-mna-hdr] and [I-D.ietf-mpls-mna-fwk], which is comprised of a set of Label Stack Song, et al. Expires 22 January 2025 [Page 5] Internet-Draft MNA for Deterministic Latency July 2024 Entries (LSEs) that carry the DLNA Indicator and Ancillary Data to perform DLNA actions for MPLS packets. +---------------------------+ | DetNet App-Flow | | Payload Packet | +---------------------------+--\ | DetNet Control Word | | +---------------------------+<--|-- Bottom of Stack | S-Label | | +---------------------------+ | DetNet | DLNA | | Data Plane +---------------------------+ | MPLS Encapsulation | MNA Label | | +---------------------------+ | | F-Label(s) | / +---------------------------+<-/--- Top of Stack | Data-Link | +---------------------------+ | Physical | +---------------------------+ Figure 1: Enhanced DetNet MPLS Header for Deterministic Latency As defined in [RFC8964], the DetNet functionality PREOF (Packet Replication, Elimination and Ordering Functions) is supported through d-CW,S-label and F-label. The queue mechanism for DetNet networks is expected to use the existing COS mechanism, such as PCP for VLAN, DSCP for IPv4, Traffic Class for IPv6. The S-lable is at the bottom of MPLS label stack and is normally followed by d-CW (DetNet Control- Word, i.e., sequence number). The S-label is used to identify DetNet service-type. F-lable(s) identify explicit route and allocated resources for DetNet nodes, the route schedule and resource reservation are achieved via provision by the controller. D-CW (i.e., sequence number) is used for the ordering function of DetNet packets. To support backward compatibility, the aspects (DetNet d-CW, S-label, F-label and A-label) are kept shown in MPLS sub-stack but outside of MPLS MNA sub-stack. The base DetNet data plane MPLS encapsulation follows specification at [RFC8964]. For base DetNet services, it's assumed that the requirements can be satisfied via deploying CoS mechanisms (i.e., PCP for VLAN, DSCP for IPv4 and Traffic Class for IPv6) to DetNet network nodes. For enhanced DetNet services, enhanced queuing mechanisms are expected to be deployed, and the queueing information may be carried in data packets. The enhanced DetNet data plane requirements are specified in [I-D.ietf-detnet-scaling-requirements]. To support Song, et al. Expires 22 January 2025 [Page 6] Internet-Draft MNA for Deterministic Latency July 2024 enhanced deterministic services, strict queuing technologies may be required for DetNet devices. Its related latency requirements may involve different categories: (1) Industrial, tight jitter, strict latency limit; (2) Industrial, strict latency limit; (3) Non- periodic, relatively loose latency requirements; (4) Best effort. And different network implementations require different SLA requirements with different queueing mechanisms implemented in single or multiple network domains. 4.2. Deterministic Latency Network Action The Deterministic Latency Network Action Sub-Stack format for MNA is shown in Figure 2. The network action follows LSE format C to carry DLNA Opcode and LSE format D for Additional Data as specified in [I-D.ietf-mpls-mna-hdr]. 0 1 2 3 4 5 6 7 0 1 2 3 4 5 6 7 0 1 2 3 4 5 6 7 0 1 2 3 4 5 6 7 +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | | |R|IHS|S|U| NASL | NAL | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | DLNA Opcode | Reserved |DLNA Flag|S|U| Res | NAL | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ |1| Deterministic Latency Data |S| | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ |1| Deterministic Latency Data |S| | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ Figure 2: DLNA Sub-Stack As specified in [I-D.ietf-mpls-mna-hdr], The header for MPLS Sub- Stack Network Action encodes: R (1 bit) : Reserved bit. This MUST be transmitted as zero and ignored upon receipt. IHS (2 bits) : The processing scope of the sub-stack. The IHS scope values refer to [I-D.ietf-mpls-mna-hdr]. The filed is set as 00 for End-to-End processing and 01 for Hop-By-Hop processing. S (1 bit) : The Bottom of Stack [RFC3032]. Res (3 bits) : Reserved bits. These MUST be transmitted as zeros and ignored upon receipt. U (1 bit): Unknown Action Handling. This field MUST be transmited as zero and ignore upon receipt. Song, et al. Expires 22 January 2025 [Page 7] Internet-Draft MNA for Deterministic Latency July 2024 NASL (4 bits) : The Network Action Sub-Stack Length (NASL). The number of additional LSEs in the sub-stack, not including the leading Format A LSE and the Format B LSE. DLNA Opcode (7 bits): This is the first 7-bit value in the Label Field. The value is used to indicate DLNA network action with Data and to be assigned by IANA as value TBA1. DLNA Flags (5 bits): A bit map that specifies the type of enhanced Deterministic latency. The supported Deterministic latency type is listed in Table 1. +=====+============================+ | Bit | Deterministic Latency Type | +=====+============================+ | 0 | Reserved | +-----+----------------------------+ | 1 | Latency Bound | +-----+----------------------------+ | 2 | Queuing Delay Bound | +-----+----------------------------+ Table 1: Deterministic Latency Type Deterministic Latency Data (60 bits): The ancillary data LSEs for the Deterministic Latency Type. The ancillary data carried in Format D LSE is not mandatory. In common DetNet scenario (i.e., not network topo at scale or network flows at scale), the traditional mechanisms such as DSCP and Traffic Class are used for queue processing. The basic DetNet functionality PREOF (Packet Replication, Elimination and Ordering Functions) is supported through sequence number and S-label and the aggregated flow function is supported via MPLS A-label. In this case, the DLNA is assumed to be the only MNA data carried in LSE format B. The value for Opcode in Format B LSE will be set as 2 and not perform the DLNA network action. The Deterministic Latency Data speicification refers to [RFC9320] and [I-D.ietf-detnet-dataplane-taxonomy], which introduces DetNet Bounded Latency Model. To support deterministic latency services the latency variation across the DetNet-aware or DetNet-unaware islands should be bounded and computable. The Deterministic Latency Bound of End-to- End and each nodes along with the DetNet flows should be included. It is important to select the right queuing method applied to specific applications and carry necessary queuing delay information in data plane. The End-to-End latency and jitter information (e.g., deadline, timestamp, etc.) and hop-by-hop queuing information (e.g., Song, et al. Expires 22 January 2025 [Page 8] Internet-Draft MNA for Deterministic Latency July 2024 cycle, queuing method, etc.) should be carried. And network delay is related to network topology scale and network flows scale, hop counts for delay assessment is an important factor. The possible parameters for ancillary data carried in Format D LSE is showed as Figure 3. +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ |1| Queuing_method |S| Hop_count | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ |1| Timestamp |S| | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ Figure 3: Ancillary Data Format Packet-by-packet load-sharing e.g., via ECMP is not utilized in DETNET [RFC8938], Section 3.5.1.5, hence timestamp can be added in In-Stack Data as label stack will not be used for hashing. 5. IANA Considerations This document requests one new IANA-managed code-point for Deterministic Latency processing. IANA maintains the "Network Action Opcodes" registry when created from IANA request in [I-D.ietf-mpls-mna-hdr]. IANA is requested to allocate a value for MPLS Network Action Opcode for Deterministic Latency Network Action from this registry: +=======+=============+===============+ | Value | Description | Reference | +=======+=============+===============+ | TBA1 | DLNA Opcode | This document | +-------+-------------+---------------+ Table 2: MPLS Network Action Opcode for Deterministic Latency 6. Security Considerations Security considerations for DetNet are covered in the DetNet Architecture [RFC8655], DetNet Data Plane Framework [RFC8938] and DetNet Security Considerations [RFC9055]. MPLS security considerations are covered in [RFC8964], [RFC3031], [RFC3032]. These security considerations also apply to this document. The MNA security considerations speicified at [I-D.ietf-mpls-mna-hdr] and [I-D.ietf-mpls-mna-fwk] are also applicable to the procedures defined in this document. Song, et al. Expires 22 January 2025 [Page 9] Internet-Draft MNA for Deterministic Latency July 2024 7. Acknowledgements The authors would like to acknowledge Adrian Farrel, Lou Berger, Gregory Mirsky, Loa Andersson for their helpful comments and Shaofu Peng for his thorough review and very helpful comments. 8. Normative References [I-D.ietf-mpls-mna-hdr] Rajamanickam, J., Gandhi, R., Zigler, R., Song, H., and K. Kompella, "MPLS Network Action (MNA) Sub-Stack Solution", Work in Progress, Internet-Draft, draft-ietf-mpls-mna-hdr- 07, 17 June 2024, . [RFC2119] Bradner, S., "Key words for use in RFCs to Indicate Requirement Levels", BCP 14, RFC 2119, DOI 10.17487/RFC2119, March 1997, . [RFC8174] Leiba, B., "Ambiguity of Uppercase vs Lowercase in RFC 2119 Key Words", BCP 14, RFC 8174, DOI 10.17487/RFC8174, May 2017, . [RFC8964] Varga, B., Ed., Farkas, J., Berger, L., Malis, A., Bryant, S., and J. Korhonen, "Deterministic Networking (DetNet) Data Plane: MPLS", RFC 8964, DOI 10.17487/RFC8964, January 2021, . 9. Informative References [I-D.ietf-detnet-dataplane-taxonomy] Joung, J., Geng, X., Peng, S., and T. T. Eckert, "Dataplane Enhancement Taxonomy", Work in Progress, Internet-Draft, draft-ietf-detnet-dataplane-taxonomy-01, 6 July 2024, . [I-D.ietf-detnet-scaling-requirements] Liu, P., Li, Y., Eckert, T. T., Xiong, Q., Ryoo, J., zhushiyin, and X. Geng, "Requirements for Scaling Deterministic Networks", Work in Progress, Internet-Draft, draft-ietf-detnet-scaling-requirements-06, 22 May 2024, . Song, et al. Expires 22 January 2025 [Page 10] Internet-Draft MNA for Deterministic Latency July 2024 [I-D.ietf-mpls-mna-fwk] Andersson, L., Bryant, S., Bocci, M., and T. Li, "MPLS Network Actions (MNA) Framework", Work in Progress, Internet-Draft, draft-ietf-mpls-mna-fwk-09, 19 June 2024, . [I-D.ietf-mpls-mna-requirements] Bocci, M., Bryant, S., and J. Drake, "Requirements for Solutions that Support MPLS Network Actions (MNA)", Work in Progress, Internet-Draft, draft-ietf-mpls-mna- requirements-16, 30 May 2024, . [I-D.ietf-mpls-mna-usecases] Saad, T., Makhijani, K., Song, H., and G. Mirsky, "Use Cases for MPLS Network Action Indicators and MPLS Ancillary Data", Work in Progress, Internet-Draft, draft- ietf-mpls-mna-usecases-10, 20 June 2024, . [I-D.stein-srtsn] Stein, Y. J., "Segment Routed Time Sensitive Networking", Work in Progress, Internet-Draft, draft-stein-srtsn-01, 29 August 2021, . [RFC3031] Rosen, E., Viswanathan, A., and R. Callon, "Multiprotocol Label Switching Architecture", RFC 3031, DOI 10.17487/RFC3031, January 2001, . [RFC3032] Rosen, E., Tappan, D., Fedorkow, G., Rekhter, Y., Farinacci, D., Li, T., and A. Conta, "MPLS Label Stack Encoding", RFC 3032, DOI 10.17487/RFC3032, January 2001, . [RFC8655] Finn, N., Thubert, P., Varga, B., and J. Farkas, "Deterministic Networking Architecture", RFC 8655, DOI 10.17487/RFC8655, October 2019, . [RFC8938] Varga, B., Ed., Farkas, J., Berger, L., Malis, A., and S. Bryant, "Deterministic Networking (DetNet) Data Plane Framework", RFC 8938, DOI 10.17487/RFC8938, November 2020, . Song, et al. Expires 22 January 2025 [Page 11] Internet-Draft MNA for Deterministic Latency July 2024 [RFC9055] Grossman, E., Ed., Mizrahi, T., and A. Hacker, "Deterministic Networking (DetNet) Security Considerations", RFC 9055, DOI 10.17487/RFC9055, June 2021, . [RFC9320] Finn, N., Le Boudec, J.-Y., Mohammadpour, E., Zhang, J., and B. Varga, "Deterministic Networking (DetNet) Bounded Latency", RFC 9320, DOI 10.17487/RFC9320, November 2022, . Authors' Addresses Xueyan Song ZTE Corp. China Email: song.xueyan2@zte.com.cn Quan Xiong ZTE Corp. China Email: xiong.quan@zte.com.cn Rakesh Gandhi Cisco Systems, Inc. Canada Email: rgandhi@cisco.com Song, et al. Expires 22 January 2025 [Page 12]