Сделать домашней страницей | Добавить в избранное
База RFC-документов

Полезное


Статьи

 

Request for Comments number 1821

Главная / RFC1821


Поиск RFC:

RFC1821 Integration of Real-time Services in an IP-ATM Network Architecture


RFC1821   Integration of Real-time Services in an IP-ATM Network Architecture    M. Borden, E. Crawley, B. Davie, S. Batsell [ August 1995 ] ( TXT = 64466 bytes)

Скачать PDF версию >>>









Network Working Group                                          M. Borden
Request for Comments: 1821                                    E. Crawley
Category: Informational                                     Bay Networks
                                                                B. Davie
                                                                Bellcore
                                                              S. Batsell
                                                                     NRL
                                                             August 1995


  Integration of Real-time Services in an IP-ATM Network Architecture

Status of the Memo

   This memo provides information for the Internet community.  This memo
   does not specify an Internet standard of any kind. Distribution of
   this memo is unlimited.

Abstract

   The IETF is currently developing an integrated service model which is
   designed to support real-time services on the Internet.
   Concurrently, the ATM Forum is developing Asynchronous Transfer Mode
   networking which similarly provides real-time networking support. The
   use of ATM in the Internet as a link layer protocol is already
   occurring, and both the IETF and the ATM Forum are producing
   specifications for IP over ATM. The purpose of this paper is to
   provide a clear statement of what issues need to be addressed in
   interfacing the IP integrated services environment with an ATM
   service environment so as to create a seamless interface between the
   two in support of end users desiring real-time networking services.

Table of Contents

   1.0 Introduction                                                2
   2.0 Problem Space Overview                                      3
   2.1 Initial Assumptions                                         3
   2.2 Topologies Under Consideration                              4
   2.3 Providing QoS in IP over  ATM - a walk-though               5
   3.0 Service Model Issues                                        6
   3.1 Traffic Characterization                                    7
   3.2 QoS Characterization                                        8
   4.0 Resource Reservation Styles                                10
   4.1 RSVP                                                       10
   4.2 ST-II                                                      13
   4.3 Mapping IP flows to ATM Connections                        15
   5.0 End System Issues                                          16
   6.0 Routing Issues                                             16



Borden, et al                Informational                      [Page 1]

RFC 1821          Real-time Service in IP-ATM Networks       August 1995


   6.1 Multicast routing                                          17
   6.2 QoS Routing                                                17
   6.3 Mobile Routing                                             18
   7.0 Security Issues                                            19
   8.0 Future Directions                                          20
   9.0 References                                                 22
   10.0 Authors' Addresses                                        24

1.0 Introduction

   The traditional network service on the Internet is best-effort
   datagram transmission. In this service, packets from a source are
   sent to a destination, with no guarantee of delivery. For those
   applications that require a guarantee of delivery, the TCP protocol
   will trade packet delay for correct reception by retransmitting those
   packets that fail to reach the destination. For traditional
   computer-communication applications such as FTP and Telnet in which
   correct delivery is more important than timeliness, this service is
   satisfactory. However, a new class of application which uses multiple
   media (voice, video, and computer data) has begun to appear on the
   Internet. Examples of this class of application are video
   teleconferencing, video-on-demand, and distributed simulation. While
   these applications can operate to some extent using best-effort
   delivery, trading packet delay for correct reception is not an
   acceptable trade-off. Operating in the traditional mode for these
   applications results in reduced quality of the received information
   and, potentially, inefficient use of bandwidth. To remedy this
   problem the IETF is developing a real-time service environment in
   which multiple classes of service are offered [6]. This environment
   will greatly extend the existing best-effort service model to meet
   the needs of multimedia applications with real-time constraints.

   At the same time that this effort is underway in the IETF,
   Asynchronous Transfer Mode (ATM) is being developed, initially as a
   replacement for the current telephone network protocols, but more
   recently as a link-layer protocol for computer communications. As it
   was developed from the beginning with telephone voice applications in
   mind, a real-time service environment is an integral part of the
   protocol. With the approval of UNI 3.1 by the ATM Forum, the ATM
   standards now have several categories of service. Given the wide
   acceptance of ATM by the long-line carriers, the use of ATM in the
   Internet is, if not guaranteed, highly likely. The question now
   becomes, how can we successfully interface between the real-time
   services offered by ATM and the new,integrated service environment
   soon to be available in the IP protocol suite. The current IP over
   ATM standards assume no real-time IP protocols. It is the purpose of
   this RFC to clearly delineate what the issues are in integrating
   real-time services in an IP-over-ATM network [10,15,19,20,21].



Borden, et al                Informational                      [Page 2]

RFC 1821          Real-time Service in IP-ATM Networks       August 1995


   In the IP-over-ATM environment, as in many others, multicast routing
   adds an additional set of challenges. While the major focus of this
   paper is quality of service (QoS) issues, it is unwise at best to
   ignore multicast when considering these issues, especially since so
   many of the applications that motivate the provision of real time QoS
   also require efficient multicast support. We will therefore try to
   keep considerations of multicast in the foreground in the following
   discussion.

   One of the primary motivations for this document is a belief by the
   authors that ATM should, if possible, be used as more than a leased
   line replacement. That is to say, while it is possible for the
   Internet to be overlaid on constant bit rate (CBR), permanent virtual
   circuits (PVCs), thus reducing IP over ATM to a previously solved
   problem, we believe that this is unlikely to be the most efficient
   way to use ATM services as they are offered by carriers or as they
   appear in LANs. For example, a carrier offering a CBR service must
   assume that the peak bit rate can be used continuously with no
   degradation in quality and so resources must be allocated to the
   connection to provide that service, even if the peak rate is in fact
   rarely used. This is likely to make a CBR service more expensive that
   a variable bit rate service of the same peak capacity.  Another way
   to view this is that the new IP service model will allow us to
   associate information about the bandwidth requirements of
   applications with individual flows; surely it is not wise to discard
   this information when we request a service from an ATM subnet.

   While we believe that there is a range of capabilities in ATM
   networks that can be effectively used by a real-time Internet, we do
   not believe that just because ATM has a capability, the Internet must
   use it. Thus, our goal in this RFC is to begin to explore how an
   Internet with real time service capability might make most effective
   use of ATM networks.  Since there are a number of problems to be
   resolved to achieve this effective use, our major goal at this point
   is to describe the scope of the problems that need to be addressed.

2.0 Problem Space Overview

   In this section we aim to describe in high level terms the scope of
   the problem that will be explored in more detail in later sections.

2.1 Initial Assumptions

   We begin by assuming that an Integrated Services Internet, i.e., an
   Internet with a range of qualities of service to support both real-
   time and non-real-time applications, will eventually happen. A number
   of working groups are trying to make this happen, notably




Borden, et al                Informational                      [Page 3]

RFC 1821          Real-time Service in IP-ATM Networks       August 1995


   * the Integrated Services group (int-serv), which is working to define
     a new IP service model, including a set of services suited to a
     range of real-time applications;

   * the Resource reservation Setup Protocol group (rsvp), which is
     defining a resource reservation protocol [7] by which the
     appropriate service for an application can be requested from the
     network;

   * the Internet Streams Protocol V2 group (ST-II), which is updating
     [27], a stream-oriented internet protocol that provides a range of
     service qualities.

   In addition, the IETF IP over ATM working group and the ATM Forum
   Multiprotocol over ATM group are working to define a model for
   protocols to make use of the ATM layer.

   Since these groups have not yet generated standards, we will need to
   do some amount of extrapolation to predict the problems that may
   arise for IP over ATM. We also assume that the standards being
   developed in the ATM Forum will largely determine the service model
   for ATM. Again, some extrapolation may be needed. Given these
   assumptions, this paper aims to explore ways in which a future
   Integrated Services Internet might make effective use of ATM as it
   seems likely to be deployed.

2.2 Topologies Under Consideration

   Figure 1 shows a generic internetwork that includes ATM and non-ATM
   subnetworks. This paper aims to outline the problems that must be
   addressed to enable suitable quality of service to be provided end-
   to-end across such a network. The problem space, therefore, includes

   * communication across an 'ATM-only' network between two hosts
     directly connected to the ATM network;

   * communication between ATM-connected hosts which involves traversing
     some non-ATM subnets;

   * communication between a host on a non-ATM subnet and a host directly
     connected to ATM;

   * communication between two hosts, neither of which has a direct ATM
     connection, but which may make use of one or more ATM networks for
     some part of the path.






Borden, et al                Informational                      [Page 4]

RFC 1821          Real-time Service in IP-ATM Networks       August 1995


                     [H]
                      |                           [H]
              ________|________________________    |
              |                                |   |
      ________|__                        ______|___|____
      |         |                        |             |
      |  ATM   [R]                      [R]  ATM       |
      |  Cloud  |                        |   Cloud     |___[H]
      |         |     Non-ATM Internet   |             |
      |         |                       [R]            |
      |________[R]                       |_____________|
       |      |                                |
       |      |                                |
      [H]     |________________________________|
                                        |
                                        |
                                       [H]

   [H] = Host
   [R] = Router
                              Figure 1

   In the last case, the entities connected to the ATM network are IP
   routers, and it is their job to manage the QoS provided by the ATM
   network(s) in such a way that the desired end-to-end QoS is provided
   to the hosts. While we wish to describe the problem space in a way
   that covers all of these scenarios, the last is perhaps the most
   general, so we will use it for most illustrative purposes. In
   particular, we are explicitly not interested in ways of providing QoS
   that are applicable only to a subset of these situations. We claim
   that addressing these four situations is sufficiently general to
   cover other situations such as those in which several ATM and non-ATM
   networks are traversed.

   It is worth mentioning that the ATM networks in this case might be
   local or wide area, private or public. In some cases, this
   distinction may be significant, e.g., because there may be economic
   implications to a particular approach to providing QoS.

2.3 Providing QoS in IP over ATM - a walk-through

   To motivate the following discussion, this section walks through an
   example of what might happen when an application with a certain set
   of QoS needs starts up. For this example, we will use the fourth case
   mentioned above, i.e., two hosts connected to non-ATM networks,
   making use of an ATM backbone.





Borden, et al                Informational                      [Page 5]

RFC 1821          Real-time Service in IP-ATM Networks       August 1995


   A generic discussion of this situation is made difficult by the fact
   that the reservation of resources in the Internet may be sender or
   receiver initiated, depending on the specifics of the setup protocol.
   We will attempt to gloss over this distinction for now, although we
   will return to it in Section 4. We will assume a unicast application
   and that the traffic characteristics and the QoS requirements (such
   as delay, loss, throughput) of the application are known to at least
   one host.  That host launches a request for the desired QoS and a
   description of the expected traffic into the network; at some point
   this request hits a router at the edge of the ATM network. The router
   must examine the request and decide if it can use an existing
   connection over the ATM network to honor the request or whether it
   must establish a new connection. In the latter case, it must use the
   QoS and traffic characterizations to decide what sort of ATM
   connection to open and to describe the desired service to the ATM
   network. It must also decide where to open the connection to. Once
   the connection is opened, the request is forwarded across the ATM
   network to the exit router and then proceeds across the non-ATM part
   of the network by the normal means.

   We can see from the above description that there are several sets of
   issues to be discussed:

   * How does the IP service model, with certain service classes and
     associated styles of traffic and QoS characterization, map onto
     the ATM service model?

   * How does the IP reservation model (whatever it turns out to be) map
     onto ATM signalling?

   * How does IP over ATM routing work when service quality is added to
     the picture?

   These issues will be discussed in the following sections.

3.0 Service Model Issues

   There are several significant differences between the ways in which
   IP and ATM will provide QoS.  When IP commits to provide a certain
   QoS to an application according to the Internet service model, it
   must be able to request an appropriate QoS from the ATM network using
   the ATM service model. Since these service models are by no means the
   same, a potentially complex mapping must be performed for the IP
   layer to meet its commitments.  The details of the differences
   between ATM and IP and the problems presented by these differences
   are described below.





Borden, et al                Informational                      [Page 6]

RFC 1821          Real-time Service in IP-ATM Networks       August 1995


   We may think of a real-time service model as containing the following
   components:

   * a way to characterize traffic (sometimes called the Tspec);

   * a way to characterize the desired quality of service (the Rspec).

   We label these components as traffic characterization and QoS
   characterization.  Each of these components is discussed in turn in
   the following sections.

   As well as these aspects of the service model, both ATM and IP will
   have a number of mechanisms by which the model is implemented. The
   mechanisms include admission control, policing, and packet
   scheduling. A particularly important mechanism is the one by which
   end-nodes communicate their QoS needs and traffic characteristics to
   the network, and the network communicates admission control decisions
   to the end-nodes. This is referred to as resource reservation or
   signalling, and is the subject of Section 4. In fact, it seems to be
   the only mechanism where significant issues of IP/ATM integration
   arise. The details of admission control, policing and packet
   scheduling are largely internal to a single network element and we do
   not foresee significant problems caused by the integration of IP and
   ATM. For example, while there may be plenty of challenges in
   designing effective approaches to admission control for both IP and
   ATM, it is not apparent that there are any special challenges for the
   IP over ATM environment. As the walk-through of Section 2.3
   described, a reservation request from a host would at some point
   encounter the edge of the ATM cloud. At this point, either a new
   connection needs to be set up across the ATM cloud, or the router can
   decide to carry the requested traffic over an existing virtual
   circuit. If the ATM cloud cannot create a new connection as
   requested, this would presumably result in an admission control
   failure which would cause the router to deny the reservation request.

3.1 Traffic Characterization

   The traffic characterization provided by an application or user is
   used by the network to make decisions about how to provide the
   desired quality of service to this application and to assess the
   effect the new flow will have on the service provided to existing
   flows. Clearly this information feeds into the admission control
   decision process.

   In the Internet community, it is assumed that traffic will in general
   be bursty and that bursty traffic can be characterized by a `token
   bucket'.  While ATM does not expect all traffic to be bursty (the
   Continuous Bit Rate class being defined specifically for non-bursty



Borden, et al                Informational                      [Page 7]

RFC 1821          Real-time Service in IP-ATM Networks       August 1995


   traffic), it uses an essentially equivalent formulation for the
   characterization of traffic that is bursty, referred to as the
   Generic Cell Rate Algorithm (GCRA). However, ATM in some classes also
   requires specification of peak cell rate, whereas peak rates are not
   currently included in the IP traffic characterizations. It may be
   possible to use incoming interface speeds to determine an approximate
   peak rate.

   One of the functions that must be performed in order to carry IP
   traffic over an ATM network is therefore a mapping from the
   characterization of the traffic as supplied to IP to a
   characterization that is acceptable for ATM. While the similarity of
   the two characterizations suggests that this is straightforward,
   there is considerable flexibility in the mapping of parameters from
   IP to ATM. As an extreme example, a router at the edge of an ATM
   cloud that expects to receive bursts of IP packets on a non-ATM
   interface, with the bursts described by some token bucket parameters,
   could actually inject ATM cells at a constant rate into the ATM
   network. This may be achieved without significant buffering if the
   ATM link speed is faster than the point-to-point link speed;
   alternatively, it could be achieved by buffering out the burstiness
   of the arriving traffic. It seems more reasonable to map an IP flow
   (or a group of flows) with variable bandwidth requirements onto an
   ATM connection that accommodates variable bit rate traffic.
   Determining how best to map the IP traffic to ATM connections in this
   way is an area that warrants investigation.

   A potential complication to this process is the fact that the token
   bucket parameters are specified at the edge of the IP network, but
   that the specification of the GCRA parameters at the entry to an ATM
   network will frequently happen at a router in the middle of an IP
   network. Thus the actual burstiness that is encountered at the router
   may differ from that described by the IP token bucket parameters, as
   the burstiness changes as the traffic traverses a network. The
   seriousness of this problem needs to be understood to permit
   efficient resource utilization.

3.2 QoS Characterization

   In addition to specifying the traffic that they will submit to the
   network, applications must specify the QoS they require from the
   network. Since the goal is to carry IP efficiently over ATM networks,
   it is necessary to establish mechanisms by which QoS specifications
   for IP traffic can be translated into QoS specifications that are
   meaningful for an ATM network.






Borden, et al                Informational                      [Page 8]

RFC 1821          Real-time Service in IP-ATM Networks       August 1995


   The proposed method of QoS specification for the Internet is to
   specify a `service class' and some set of parameters, depending on
   the service class. The currently proposed service classes are

   *  guaranteed, which provides a mathematically guaranteed delay
      bound [23];

   *  predictive delay, which provides a probabilistic delay bound
      [24];and

   *  controlled delay, which merely tries to provide several levels of
      delay which applications may choose between [25].

   These are in addition to the existing `best-effort' class. More IP
   service classes are expected in the future. ATM has five service
   classes:

   *  CBR (constant bit rate), which emulates a leased line, providing
      very tightly constrained delay and designed for applications which
      can use a fixed bandwidth pipe;

   *  VBR (variable bit rate)-real-time which attempts to constrain delay
      for applications whose bandwidth requirements vary;

   *  VBR-non-real-time, intended for variable bandwidth applications
      without tight delay constraints;

   *  UBR (unspecified bit rate) which most closely approximates the best
      effort service of traditional IP;

   *  ABR (available bit rate) which uses a complex feedback mechanism
      to control loss.

   Each class requires some associated parameters to be specified, e.g.,
   CBR requires a peak rate. Observe that these classes are by no means
   in direct correspondence with the IP classes. In some cases, ATM
   classes require parameters which are not provided at the IP level,
   such as loss rate, to be specified. It may be necessary to assume
   reasonable default values in these cases.

   The major problem here is this: given traffic in a particular IP
   service class with certain QoS parameters, how should it be sent
   across an ATM network in such a way that it both meets its service
   commitments and makes efficient use of the ATM network's resources?
   For example, it would be possible to transport any class of IP
   traffic over an ATM network using the constant bit rate (CBR) ATM
   class, thus using the ATM network like a point-to-point link. This
   would allow IP to meet its service commitments, but would be an



Borden, et al                Informational                      [Page 9]

RFC 1821          Real-time Service in IP-ATM Networks       August 1995


   inefficient use of network resources in any case where the IP traffic
   was at all bursty (which is likely to be most cases). A more
   reasonable approach might be to map all IP traffic into a variable
   bit rate (VBR) class; certainly this class has the flexibility to
   accommodate bursty IP traffic more efficiently than CBR.

   At present, the IETF is not working on any service classes in which
   loss rate is considered as part of the QoS specification. As long as
   that is the case, the fact that ATM allows target loss rates to be
   specified is essentially not an issue. However, we may certainly
   expect that as the IP service model is further refined, service
   classes that include specifications of loss may be defined. At this
   point, it will be necessary to be able to map between loss rates at
   the IP level and loss rates at the ATM level. It has already been
   shown that relatively small loss rates in an ATM network can
   translate to high loss rates in IP due to the fact that each lost
   cell can cause the loss of an entire IP packet. Schemes to mitigate
   this problem, which include the proposed approach to implementing the
   ABR class, as well as other solutions [22], have been proposed. This
   is clearly likely to be an important issue in the future.

4.0 Resource Reservation Styles

   ATM uses a signalling protocol (Q.2931) both to establish virtual
   connections and to allocate resources to those connections. It has
   many of the characteristics of a 'conventional' signalling protocol,
   such as being sender-driven and relying on hard-state in switches to
   maintain connections. Some of the key characteristics are listed in
   the table below. In the current standards, the QoS associated with a
   connection at setup time cannot be changed subsequently (i.e., it is
   static); in a unicast connection, resources are allocated in both
   directions along the path, while in the multicast case, they are
   allocated only from the sender to the receivers. In this case, all
   senders receive the same QoS.

   Two protocols have been proposed for resource reservation in IP. The
   first (chronologically) is ST-II, the other is RSVP. Each of these,
   and its relationship to ATM, is discussed in the following sections.

4.1 RSVP

   IP has traditionally provided connectionless service. To support
   real-time services in a connectionless world, RSVP has been proposed
   to enable network resources to be reserved for a connectionless data
   stream. ATM, on the other hand, provides a connection-oriented
   service, where resource reservations are made at connection setup
   time, using a user-network interface (UNI) and a network-network
   interface (NNI) signalling protocol.



Borden, et al                Informational                     [Page 10]

RFC 1821          Real-time Service in IP-ATM Networks       August 1995


     -----------------------------------------------------------------
     |   Category   |      RSVP            |       ATM (UNI 3.0)     |
     -----------------------------------------------------------------
     |              |                      |                         |
     | Orientation  | Receiver-based       |       Sender-based      |
     |              |                      |                         |
      ----------------------------------------------------------------
     |              |                      |                         |
     |     State    |      Soft state      |       Hard state        |
     |              |  (refresh/time-out)  |   (explicit delete)     |
     -----------------------------------------------------------------
     |              |                      |                         |
     |QoS SetupTime |   Separate from      |    Concurrent with      |
     |              | route establishment  |   route establishment   |
     -----------------------------------------------------------------
     |              |                      |                         |
     |QoS Changes?  | Dynamic QoS          |       Static QoS        |
     |              |                      |  (Fixed at setup time)  |
     -----------------------------------------------------------------
     |              |                      | Bidirectional allocation|
     |Directionality|  Unidirectional      |  for unicast            |
     |              |resource allocation   |Unidirectional allocation|
     |              |                      |  for multicast          |
     -----------------------------------------------------------------
     |              |                      |                         |
     |Heterogeneity |   Receiver           |    Uniform QoS to       |
     |              |  heterogeneity       |    all receivers        |
     -----------------------------------------------------------------

   The principles used in the design of RSVP differ from those of ATM in
   the following respects:

   *  Resource reservations in IP hosts and routers are represented by
      soft state, i.e., reservations are not permanent, but time out
      after some period. Reservations must be refreshed to prevent
      time-out, and may also be explicitly deleted. In ATM, resources are
      reserved for the duration of a connection, which must be explicitly
      and reliably deleted.

   *  The soft state approach of RSVP allows the QoS reserved for a flow
      to be changed at any time, whereas ATM connections have a static
      QoS that is fixed at setup time.

   *  RSVP is a simplex protocol, i.e., resources are reserved in one
      direction only. In ATM, connections (and associated reservations)
      are bi-directional in point-to-point calls and uni-directional in
      point-to-multipoint calls.




Borden, et al                Informational                     [Page 11]

RFC 1821          Real-time Service in IP-ATM Networks       August 1995


   *  Resource reservation is receiver-initiated in RSVP. In ATM,
      resources are reserved by the end system setting up the connection.
      In point-to-multipoint calls, connection setup (and hence resource
      reservation) must be done by the sender.

   *  RSVP has explicit support for sessions containing multiple senders,
      namely the ability to select a subset of senders,  and to
      dynamically switch between senders. No such support is provided
      by ATM.

   *  RSVP has been designed independently of other architectural
      components, in particular routing. Moreover, route setup and
      resource reservation are done at different times.  In ATM, resource
      reservation and route setup are done at the same time (connection
      setup time).

   The differences between RSVP and ATM state establishment, as
   described above, raise numerous problems. For example, since point-
   to-point connections are bidirectional in ATM, and since reservations
   can be made in both directions, receiver-initiated resource
   reservations in RSVP can be simulated in ATM by having the receiver
   set up the connection and reserve resources in the backward direction
   only.  However, this is potentially wasteful of connection resources
   since connections are only ever used to transfer data in one
   direction even though communication between the two parties may be
   bidirectional. One option is to use a `point-to-multipoint' ATM
   connection with only one receiver. Of course, the fact that the RSVP
   reservation request is made by the receiver(s) means that this
   request must be somehow communicated to the sender on the ATM
   network. This is somewhat analogous to the receiver-oriented join
   operation of IP multicast and the problems of implementing it over
   ATM, as discussed in Section 6. In general, the efficiency of any
   proposed connection management scheme needs to be investigated in
   both unicast and multicast contexts for a range of application
   requirements, especially at a large scale.

   The use by RSVP of `soft state' as opposed to explicit connections
   means that routers at the ATM network's edges need to manage the
   opening and closing of ATM connections when RSVP reservations are
   made and released (or time out).  The optimal scheme for connection
   setup and tear-down will depend on the cost of setting up a
   connection versus the cost of keeping the connection open for
   possible future use by another stream, and is likely to be service
   class-dependent. For example, connections may be left open for reuse
   by best-effort traffic (subject to sufficient connections being
   available), since no resources are explicitly reserved. On the other
   hand, connections supporting the real-time service classes are likely
   to be expensive to leave open since resources may be allocated even



Borden, et al                Informational                     [Page 12]

RFC 1821          Real-time Service in IP-ATM Networks       August 1995


   when the connection is idle. Again, the cost incurred will depend on
   the class. For example, the cost of an open, idle `guaranteed' QoS
   connection is likely to be significantly more expensive than a
   connection providing predictive or controlled delay service. Note
   that connections can be reused for traffic of the same class with
   compatible QoS requirements, and that it may sometimes be possible to
   use a `higher quality' class to substitute for a lower quality one.

   Another characteristic of RSVP which presents problems for ATM is the
   use of PATH messages to convey information to receivers before any
   reservation is made. This works in IP because routing is performed
   independently of reservation. Delivery of PATH messages across an ATM
   network is therefore likely to require a mechanism for setting up
   connections without reservations being made. The connection also
   needs to be of sufficient quality to deliver PATH messages fairly
   reliably; in some circumstances, a low quality best effort service
   may be inadequate for this task. A related issue is the problem of
   advertising services prior to reservations. The OPWA model (one pass
   with advertising) requires network elements to advertise the QoS that
   they are able to provide so that receivers can decide what level of
   reservation to request. Since these advertisements may be made prior
   to any resources having been reserved in the ATM network, it is not
   clear how to make meaningful advertisements of the QoS that might be
   provided across the ATM cloud.

   Finally, the multiparty model of communication is substantially
   different in  RSVP and ATM. Emulating RSVP receiver-initiation using
   ATM point-to-multipoint connections is likely to cause severe scaling
   problems as the number of receivers becomes large. Also, some
   functions of RSVP are not currently provided by ATM. For example,
   there is no support for different receiver requirements and
   capabilities-all receivers in a session receive the same QoS, which
   is fixed at the time the first receiver is added to the multicast
   tree. It is likely that ATM support for multi-party sessions will be
   enhanced in later versions of the standards. It is necessary for such
   support to evolve in a manner compatible with RSVP and IP multicast
   routing protocols if large ATM clouds are to be deployed
   successfully.

4.2 ST-II

   ST-II [27] and ST2+ [12] (referred to generically as ST hereafter)
   have data distribution and resource reservation schemes that are
   similar to ATM in many respects.

   * ST is connection oriented using "hard state".  Senders set up
     simplex data flows to all receivers closely matching point-to-
     multipoint connections in ATM. Routing decisions are made when



Borden, et al                Informational                     [Page 13]

RFC 1821          Real-time Service in IP-ATM Networks       August 1995


     the connection is made and are not changed unless there is a
     failure in the path. Positive acknowledgment is required from all
     receivers. ST2+ [12] adds a receiver-based JOIN mechanism that can
     reduce the burden on senders to track all receivers.

   * ST reserves network resources at connection setup time. The ST
     CONNECT message contains a flowspec indicating the resources to be
     reserved for the stream. Agents along the path may change the
     flowspec based on restrictions they may need to impose on the
     stream. The final flowspec is returned to the sender in the ACCEPT
     message from each receiver or target.

     -----------------------------------------------------------------
     |   Category   |      RSVP            |       ATM (UNI 3.0)     |
     -----------------------------------------------------------------
     |              |                      |                         |
     | Orientation  |   Sender-based       |       Sender-based      |
     |              |                      |                         |
      ----------------------------------------------------------------
     |              |                      |                         |
     |     State    |      Hard state      |       Hard state        |
     |              | (explicit disconnect)|   (explicit delete)     |
     -----------------------------------------------------------------
     |              |                      |                         |
     |QoS SetupTime |   Concurrent with    |    Concurrent with      |
     |              |     stream setup     |   route establishment   |
     -----------------------------------------------------------------
     |              |                      |                         |
     |QoS Changes?  | Dynamic QoS          |       Static QoS        |
     |              |                      |  (Fixed at setup time)  |
     -----------------------------------------------------------------
     |              |                      | Bidirectional allocation|
     |Directionality|  Unidirectional      |  for unicast            |
     |              |resource allocation   |Unidirectional allocation|
     |              |                      |  for multicast          |
     -----------------------------------------------------------------
     |              |                      |                         |
     |Heterogeneity |   Receiver           |    Uniform QoS to       |
     |              |  heterogeneity       |    all receivers        |
     -----------------------------------------------------------------

   These similarities make mapping ST services to ATM simpler than RSVP
   but the mapping is still not trivial.  The task of mapping the ST
   flowspec into an ATM service class still has to be worked out.  There
   may be policy issues related to opening a new VC for each stream
   versus aggregating flows over an existing VC.





Borden, et al                Informational                     [Page 14]

RFC 1821          Real-time Service in IP-ATM Networks       August 1995


   Additionally, ST has some differences with UNI 3.1 that can cause
   problems when integrating the two protocols:

   *  In ST, changes to active stream reservations are allowed.  For
      example, if the flowspec received from the target is not sufficient
      for the stream, the sender can send a CHANGE message, requesting a
      different QoS. UNI 3.1 does not allow changes to the QoS of a VC
      after it is set up. Future ATM UNI specifications are contemplating
      allowing changes to a VC after set up but this is still preliminary.
      In the meantime, policies for over reservation or aggregation onto
      a larger VC may be needed.

   * ST uses simplex streams that flow in only one direction.  This is
     fine for UNI 3.1 point-to-multipoint connections since the data flow
     is only in one direction.  When mapping a point-to-point ST
     connection to a standard point-to-point ATM VC, the reverse flow
     connection is wasted.

   This can be solved simply by using only point-to-multipoint VCs, even
   if there is only one receiver.

4.3 Mapping IP flows to ATM connections

   In general, there will be a great deal of flexibility in how one maps
   flows at the IP level to connections at the ATM level. For example,
   one could imagine setting up an ATM connection when a reservation
   message arrives at the edge of an ATM cloud and then tearing it down
   as soon as the reservation times out. However, to minimize latency or
   perhaps for economic reasons, it may be preferable to keep the ATM
   connection up for some period in case it is needed. Similarly, it may
   be possible or desirable to map multiple IP flows to a single ATM
   connection or vice versa.

   An interesting situation arises when a reservation request is
   received for an existing route across the cloud but which, when added
   to the existing reservations using that connection, would exceed the
   capacity of that connection. Since the current  ATM standards do not
   allow the QoS of a connection to be changed, there are two options:
   tear down the old connection and create a new one with the new,
   larger allocation of resources, or simply add a new connection to
   accommodate the extra traffic. It is possible that the former would
   lead to more efficient resource utilization. However, one would not
   wish to tear down the first connection before the second was
   admitted, and the second might fail admission control because of the
   resources allocated to the first. The difficulties of this situation
   seem to argue for evolution of ATM standards to support QoS
   modification on an existing connection.




Borden, et al                Informational                     [Page 15]

RFC 1821          Real-time Service in IP-ATM Networks       August 1995


5.0 End System Issues

   In developing an integrated IP-ATM environment the applications need
   to be as oblivious as possible of the details of the environment: the
   applications should not need to know about the network topology to
   work properly. This can be facilitated first by a common application
   programing interface (API) and secondly by common flow and filter
   specifications [18].

   An example of a common API that is gaining momentum is the BSD
   sockets interface. This is a UNIX standard and, with Winsock2, has
   also become a PC standard. With the IETF integrated service
   environment just beginning to appear in the commercial marketplace,
   the ability to standardize on one common interface for both IP and
   ATM applications is still possible and must be seriously and quickly
   pursued to insure interoperability.

   Since the IP integrated service and ATM environments offer different
   QoS service types, an application should specify sufficient
   information in its flow specification so that regardless of the
   topology of the network, the network can choose an acceptable QoS
   type to meet the applicationUs needs. Making the application provide
   sufficient information to quantify a QoS service and allowing the
   network to choose the QoS service type is essential to freeing the
   application from requiring a set network topology and allowing the
   network to fully utilize the features of IP and ATM.

6.0 Routing Issues

   There is a fundamental difference between the routing computations
   for IP and ATM that can cause problems for real-time IP services.
   ATM computes a route or path at connection setup time and leaves the
   path in place until the connection is terminated or there is a
   failure in the path.  An ATM cell only carries information
   identifying the connection and no information about the actual source
   and destination of the cell.  In order to forward cells, an ATM
   device needs to consult a list of the established connections that
   map to the next hop device, without checking the final destination.

   In contrast, routing decisions in IP are based on the destination
   address contained in every packet. This means that an IP router, as
   it receives each packet,  has to consult a table that contains the
   routes to all possible destinations and the routing decision is made
   based on the final destination of the packet.  This makes IP routing
   very robust in the face of path changes and link failures at the
   expense of the extra header information and the potentially larger
   table lookup.  However, if an IP path has been selected for a given
   QoS, changes in the route may mean a change in the QoS of the path.



Borden, et al                Informational                     [Page 16]

RFC 1821          Real-time Service in IP-ATM Networks       August 1995


6.1 Multicast routing

   Considerable research has gone into overlaying IP multicast models
   onto ATM.  In the MARS (Multicast Address Resolution Server) model
   [1], a server is designated for the Logical IP Subnet (LIS) to supply
   the ATM addresses of the hosts in the IP multicast group, much like
   the ATM ARP server [15].  When a host or router wishes to send to a
   multicast group on the LIS, a query is made to the MARS and a list of
   the ATM address of the hosts or routers in the group is returned. The
   sending host can then set up point-to-point or point-to-multipoint
   VCs to the other group members. When a host or a router joins an IP
   multicast group, it notified the MARS. Each of the current senders to
   the group is then notified of the new group member so that the new
   member can be added to the point to multipoint VC's.

   As the number of LIS hosts and multicast groups grows, the number of
   VCs needed for a one-to-one mapping of VCs to multicast groups can
   get very large.  Aggregation of multicast groups onto the same VC may
   be necessary to avoid VC explosion.  Aggregation  is further
   complicated by the QoS that may be needed for particular senders in a
   multicast group.  There may be a need to aggregate all the multicast
   flows requiring a certain QoS to a set of VCs, and parallel VCs may
   be necessary to add flows of the same QoS.

6.2 QoS Routing

   Most unicast and multicast IP routing protocols compute the shortest
   path to a destination based solely on a hop count or metric.  OSPF
   [16] and MOSPF [17] allow computation based on different IP Type of
   Service (TOS) levels as well as link metrics, but no current IP
   routing protocols take into consideration the wide range of levels of
   quality of service that are available in ATM or in the Integrated
   Services models.  In many routing protocols, computing all the routes
   for just the shortest path for a large network is computationally
   expensive so repeating this process for multiple QoS levels might be
   prohibitively expensive.

   In ATM, the Private Network-to-Network Interface (PNNI) protocol [13]
   communicates QoS information along with routing information, and the
   network nodes can utilize this information to establish paths for the
   required QoS. Integrated PNNI (I-PNNI) [9] has been proposed as a way
   to pass the QoS information available in ATM to other routing
   protocols in an IP environment.

   Wang & Crowcroft [28] suggest that only bandwidth and delay metrics
   are necessary for QoS routing and this would work well for computing
   a route that required a particular QoS at some setup time, but this
   goes against the connectionless Internet model. One possible solution



Borden, et al                Informational                     [Page 17]

RFC 1821          Real-time Service in IP-ATM Networks       August 1995


   to the exhaustive computation of all possible routes with all
   possible QoS values would be to compute routes for a common set of
   QoS values and only then compute routes for uncommon QoS values as
   needed, extracting a performance penalty only on the first packets of
   a flow with an uncommon QoS.  Sparse multicast routing protocols that
   compute a multicast path in advance or on the first packets from a
   sender (such as CBT [5] and MOSPF [17]) could also use QoS routing
   information to set up a delivery tree that will have adequate
   resources.

   However, no multicast routing protocols allow the communication of
   QoS information at tree setup time.  Obtaining a tree with suitable
   QoS is intended to be handled by RSVP, usually after the distribution
   tree has been set up, and may require recomputation of the
   distribution tree to provide the requested QoS.One way to solve this
   problem is to add some "hints" to the multicast routing protocols so
   they can get an idea of the QoS that the multicast group will require
   at group initiation time and set up a distribution tree to support
   the desired QoS. The CBT protocol [5] has some TBD fields in its
   control headers to support resource reservation. Such information
   could also be added to a future IGMP [11] JOIN message that would
   include information on the PIM Rendezvous Point (RP) or CBT Core.

   Another alternative is to recompute the multicast distribution tree
   based on the RSVP messages but this has the danger of losing data
   during the recomputation. However, this can leave a timing window
   where other reservations can come along during the tree recomputation
   and use the resources of the new path as well as the old path,
   leaving the user with no path to support the QoS desired.

   If unicast routing is used to support multicast routing, we have the
   same problem of only knowing a single path to a given destination
   with no QoS information. If the path suggested by unicast routing
   does not have the resources to support the QoS desired, there are few
   choices available. Schemes that use an alternate route to "guess" at
   a better path have been suggested and can work for certain topologies
   but an underlying routing protocol that provides QoS information is
   necessary for a complete solution.  As mentioned earlier, I-PNNI has
   the potential to provide enough information to compute paths for the
   requested QoS.

6.3 Mobile Routing

   In developing an integrated IP-ATM network, potential new growth
   areas need to be included in the planning stages. One such area is
   mobile networking. Under the heading of mobile networks are included
   satellite extensions of the ATM cloud, mobile hosts that can join an
   IP subnetwork at random, and a true mobile network in which all



Borden, et al                Informational                     [Page 18]

RFC 1821          Real-time Service in IP-ATM Networks       August 1995


   network components including routers and/or switches are mobile.

   The IP-ATM real-time service environment must be extended to include
   mobile networks so as to allow mobile users to access the same
   services as fixed network users. In doing so, a number of problems
   exist that need to be addressed. The principle problems are that
   mobile networks have constrained bandwidth compared to fiber and
   mobile links and are less stable than fixed fiber links. The impact
   of these limitations affect IP and ATM differently.  In introducing
   one or more constrained components into the ATM cloud,the effects on
   congestion control in the overall network are unknown. One can
   envision significant buffering problems when a disadvantaged user on
   a mobile link attempts to access information from a high speed data
   stream. Likewise, as ATM uses out of band signalling to set up the
   connection, the stability of the mobile links that may have
   significant fading or complete loss of connectivity could have a
   significant effect on ATM performance.

   For QoS, fading on a link will appear as a varying channel capacity.
   This will result in time-dependent fluctuations of available links to
   support a level of service. Current routing protocols are not
   designed to operate in a rapidly changing topology. QoS routing
   protocols that can operate in a rapidly changing topology are
   required and need to be developed.

7.0 Security Issues

   In a quality of service environment where network resources are
   reserved, hence potentially depriving other users access to these
   resources for some time period, authentication of the requesting host
   is essential. This problem is greatly increased in a combined IP-ATM
   topology where the requesting host can access the network either
   through the IP or the ATM portion of the network. Differences in the
   security architectures between IP and ATM can lead to opportunities
   to reserve resources without proper authorization to do so.  A common
   security framework over the combined IP-ATM topology would be
   desirable. In lieu of this, the use of trusted edge devices
   requesting the QoS services are required as a near term solution.

   Significant progress in developing a common security framework for IP
   is underway in the IETF [2]. The use of authentication headers in
   conjunction with appropriate key management is currently being
   considered as a long range solution to providing QoS security [3,8].
   In developing this framework, the reality of ATM portions of the
   Internet should be taken into account. Of equal importance, the ATM
   Forum ad-hoc security group should take into account the current work
   on an IP security architecture to ensure compatibility.




Borden, et al                Informational                     [Page 19]

RFC 1821          Real-time Service in IP-ATM Networks       August 1995


8.0 Future Directions

   Clearly, there are some challenging issues for real-time IP-ATM
   services and some areas are better understood than others. For
   example, mechanisms such as policing, admission control and packet or
   cell scheduling can be dealt with mostly independently within IP or
   ATM as appropriate.  Thus, while there may be hard problems to be
   solved in these areas that need to be addressed in either the IP or
   ATM communities, there are few serious problems that arise
   specifically in the IP over ATM environment. This is because IP does
   not particularly care what mechanisms a network element (such as an
   ATM network) uses to provide a certain QoS; what matters is whether
   the ATM service model is capable of offering services that can
   support the end-to-end IP service model. Most of the hard problems
   for IP over ATM therefore revolve around the service models for IP
   and ATM.  The one piece of mechanism that is important in an IP/ATM
   context is signalling or resource reservation, a topic we return to
   below.

   The following paragraphs enumerate some of the areas in which we
   believe significant work is needed. The work falls into three areas:
   extending the IP over ATM standards; extensions to the ATM service
   model; and extensions to the IP service model. In general, we expect
   that practical experience with providing IP QoS over ATM will suggest
   more enhancements to the service models.

   We need to define ways of mapping the QoS and traffic
   characterizations (Tspecs and Rspecs) of IP flows to suitable
   characterizations for ATM connections.  An agreement is needed so
   that some sort of uniform approach is taken. Whatever agreement is
   made for such mappings, it needs to be done so that when traversing
   several networks, the requested QoS is obtained end-to-end (when
   admission is possible). Practical experience should be gained with
   these mappings to establish that the ATM service classes can in fact
   provide suitable QoS to IP flows in a reasonably efficient way.
   Enhancement of the ATM service classes may be necessary, but
   experience is needed to determine what is appropriate.

   We need to determine how the resource reservation models of IP (RSVP
   and ST-II) interact with ATM signalling. Mechanisms for establishing
   appropriate connection state with suitable QoS in ATM networks that
   are part of a larger integrated services Internet need to be defined.
   It is possible that the current IP/ATM mechanisms such as ARP servers
   and MARS can be extended to help to manage this state.

   There is a need for better QoS routing.  While this functionality is
   needed even in the pure ATM or pure IP environment, there is also an
   eventual need for integrated QoS routing between ATM and IP.  Further



Borden, et al                Informational                     [Page 20]

RFC 1821          Real-time Service in IP-ATM Networks       August 1995


   research and practical experience is needed in the areas of QoS
   routing in IP in order to support more than the shortest best-effort
   path, especially when this path may traverse ATM networks.  In many
   IP networks, there are multiple paths between a given source and
   destination pair but current routing technologies only pay attention
   to the current shortest path. As resources on the shortest path are
   reserved, it will be necessary and viable to explore other paths in
   order to provide QoS to a flow.

   Enrichment of the ATM model to support dynamic QoS would greatly help
   the IP over ATM situation. At present, the QoS objectives for ATM are
   established at call set-up and then fixed for the duration of a call.
   It would be advantageous to have the ability to provide a dynamic QoS
   in ATM, so that an existing call could be modified to provide altered
   services.

   Another possible area of enhancement to the ATM service model is in
   the area of multicasting. The multicast QoS offered is equal for all
   receivers, and thus may be determined by the least favorable path
   through the tree or by the most demanding receiver. Furthermore,
   there is no current provision for multipoint to multipoint
   connections. This limitation may rule out some of the services
   envisioned in the IP service model.

   There are areas of potential enrichment of the IP model as well.
   While the receiver-based approach of RSVP has nice scaling properties
   and handles receiver heterogeneity well, it is not clear that it is
   ideal for all applications or for establishing state in ATM networks.
   It is possible that a sender-oriented mode for RSVP might ease the
   IP/ATM integration task.

   Since the widespread availability of QoS raises new security concerns
   (e.g., denial of service by excessive resource reservation), it seems
   prudent that the IP and ATM communities work closely to adopt
   compatible approaches to handling these issues.

   This list is almost certainly incomplete. As work progresses to
   define IP over ATM standards to support QoS and to implement
   integrated services internetworks that include ATM, more issues are
   likely to arise. However, we believe that this paper has described
   the major issues that need to be taken into consideration at this
   time by those who are defining the standards and building
   implementations.








Borden, et al                Informational                     [Page 21]

RFC 1821          Real-time Service in IP-ATM Networks       August 1995


9.0 References

   1.  Armitage, G., "Support for Multicast over UNI 3.1 based ATM
       Networks", Work in Progress, Bellcore, February 1995.

   2.  Atkinson,  R., "Security Architecture for the Internet Protocol",
       RFC 1825, NRL, August 1995.

   3.  Atkinson, R., "IP Authentication Header", RFC 1826, NRL,
       August 1995.

   4.  Ballardie, A., and J. Crowcroft, "Multicast-Specific Security
       Threats and Counter-Measures", Proceedings of ISOC Symposium on
       Network and Distributed System Security, San Diego, Feb. 1995,
       pp. 2-16.

   5.  Ballardie, T., Jain, N., Reeve, S. "Core Based Trees (CBT)
       Multicast, Protocol Specification", Work In Progress, University
       College London, Bay Networks, June, 1995.

   6.  Braden, R., Clark, D., and S. Shenker, "Integrated Services in
       the Internet Architecture: an Overview", RFC 1633, ISI/MIT/Xerox
       PARC, July 1994.

   7.  Braden, R., Zhang, L., Estrin, Herzog, D., and S. Jamin,
       "Resource ReSerVation Protocol (RSVP) - Version 1 Functional
       Specification", Work in Progress, ISI/PARC/UCS, July 1995.

   8.  Braden, R., Clark, D., Crocker, S., and C. Huitema, "Report of IAB
       Workshop on Security in the Internet Architecture", RFC 1636, ISI,
       MIT, TIS, INRIA, June 1994.

   9.  Callon, R., and B. Salkewicz, An Outline for Integrated PNNI for
       IP Routing", ATM Forum/ 95-0649, Bay Networks, July 1995.

   10. Cole, R., Shur, D., and C. Villamizar, "IP over ATM: A Framework
       Document", Work in Progress, AT&T Bell Laboratories/ ANS, April
       1995.

   11. Deering, S., "Host Extensions for IP Multicasting", STD 5, RFC
       1112, Stanford University, August 1989.

   12. Delgrossi, L., and L. Berger, Editors, "Internet Stream Protocol
       Version 2 (ST-2) Protocol Specification - Version ST2+", RFC 1819,
       ST2 Working Group, August 1995.

   13. Dykeman, D., Ed., "PNNI Draft Specification", ATM Forum/94-0471R8,
       IBM Zurich Research Lab, May 1995.



Borden, et al                Informational                     [Page 22]

RFC 1821          Real-time Service in IP-ATM Networks       August 1995


   14. Goyal, P., Lam, S., and Vin, H., "Determining End-to-End Delay
       Bounds in Heterogeneous Networks," 5th International Workshop on
       Network and Operating System Support for Digital Audio and Video,
       April, 1995.(Available via URL http://www.cs.utexas.edu/users/dmcl)

   15. Laubach, M., "Classical IP and ARP over ATM", RFC 1577, HP,
       January 1994.

   16. Moy, J., "OSPF Version 2", RFC 1583, Proteon, March 1994.

   17. Moy, J., "Multicast Extensions to OSPF," RFC 1584, Proteon, March
       1994.

   18. Partridge, C., "A  Proposed Flow Specification", RFC 1363, BBN,
       September 1992.

   19. Perez, M., Liaw, F., Mankin, A., Hoffman, E., Grossman, D. and
       A. Malis, "ATM Signaling Support for IP over ATM", RFC 1755,
       ISI, Fore, Motorola Codex, Ascom Timeplex, February 1995.

   20. Perkins, D., and Liaw, Fong-Ching, "Beyond Classical IP-Integrated
       IP and ATM Architecture Overview", ATM Forum/94-0935, Fore Systems,
       September 1994.

   21. Perkins, D. and Liaw, Fong-Ching, "Beyond Classical IP-Integrated
       IP and ATM Protocol Specifications", ATM Forum/94-0936, Fore
       Systems, September 1994.

   22. Romanow, A., and S. Floyd, "The Dynamics of TCP Traffic over ATM
       Networks", Proceedings of ACM SIGCOMM U94, London, August 1994,
       pp.79-88.

   23. Shenker, S., and C. Partridge. "Specification of Guaranteed Quality
       of Service", Work in Progress, Xerox/BBN, July 1995.

   24. Shenker, S., and C. Partridge. "Specification of Predictive Quality
       of Service", Work in Progress, Xerox/BBN, March 1995.

   25. Shenker, S., C. Partridge and J. Wroclawski. "Specification of
       Controlled Delay Quality of Service", Work in Progress,
       Xerox/BBN/MIT, June 1995.

   26. Schulzrinne, H., Casner, S., Frederick, R., and V. Jacobson, "RTP:
       A Transport Protocol for Real-time Applications", Work in Progress,
       GMD/ISI/Xerox/LBL, March 1995.

   27. Topolcic, C., "Experimental Internet Stream Protocol, Version 2
       (ST-II)", RFC 1190, BBN, October 1990.



Borden, et al                Informational                     [Page 23]

RFC 1821          Real-time Service in IP-ATM Networks       August 1995


   28. Wang, Z., and J. Crowcroft, "QoS Routing for Supporting Resource
       Reservation", University College of London white paper, 1995.

10. Authors' Addresses

   Eric S. Crawley
   Marty Borden
   Bay Networks
   3 Federal Street
   Billerica, Ma 01821
   508-670-8888
   esc@baynetworks.com
   mborden@baynetworks.com


   Bruce S. Davie
   Bellcore
   445 South Street
   Morristown, New Jersey 07960-6438
   201-829-4838
   bsd@bellcore.com


   Stephen G. Batsell
   Naval Research Laboratory
   Code 5521
   Washington, DC 20375-5337
   202-767-3834
   sgb@saturn.nrl.navy.mil






















Borden, et al                Informational                     [Page 24]




 
Полезное

Статьи

Анализ сайта
Rambler's Top100
Render time: 0.0092298984527588 sec