[infod-wg] NM Use Case - words for discussion
Steve Fisher
S.M.Fisher at rl.ac.uk
Sat Jun 25 09:50:55 CDT 2005
1. Network Monitoring Use Case
1.1 Summary
Network monitoring is carried out by network service providers to
ensure that the infrastructure is sound, by customers of those
services to ensure that they are getting the service defined in some
SLA and by schedulers (as described in the scheduling use case) which
need the information to optimise data movements.
1.2 Customers
Actors include:
* Network service providers
* Customers of network service providers
* Schedulers/resource brokers
1.3 Scenarios
1.3.1 Information for job scheduling.
File transfers are monitored and specific measuremnst (iperf, pinger
etc) are made. This information is published. The essential part of
the key is the pair of sites involved.
Data is replicated across the grid. A resource broker examines the
available information to optimse a scheduling plan - which replica to
move to which computing resource. Not every pair of points will be
monitored so it is necessary to compute long trips via intermediate
nodes.
Publisher (one of many)
---------
Name: lxb2009.cern.ch
PubicationType (one or many?)
--------------
Vocabulary: Relatioanal
Schema:
Table: NetworkTCPThroughput Achieved TCP throughput
* NMIdSource VARCHAR(100) ID of the source of the transfer
* NMIdDestination VARCHAR(100) ID of the destination of the transfer
* tool VARCHAR(100) tool used to make the measurement
* bufferSize INTEGER buffer size in bytes
* streams INTEGER number of parallel streams
* duration INTEGER duration of the transfer in seconds
timeStamp VARCHAR(15) timestamp of the measurement
value INTEGER achieved TCP throughput in bit/s
Table: NetworkICMPPacketLoss 2-way loss of ICMP packets
* NMIdSource VARCHAR(100) ID of the source of the packets
* NMIdDestination VARCHAR(100) ID of the destination of the packets
* tool VARCHAR(100) tool used to make the measurement
* packetSize INTEGER size of the packets in bytes
timeStamp VARCHAR(15) timestamp of the measurement
value REAL 2-way percentage loss of ICMP packets
Table: NetworkRTT Round-trip time between two hosts
* NMIdSource VARCHAR(100) ID of the source of the measurement
* NMIdDestination VARCHAR(100) ID of the destination of the measurement
* tool VARCHAR(100) tool used to make the measurement
* packetSize INTEGER size of the packets in bytes
timeStamp VARCHAR(15) timestamp of the measurement
minimum REAL minimum RTT for a series of measurements
maximum REAL maximum RTT for a series of measurements
average REAL mean RTT for a series of measurements
Table: NetworkUDPThroughput Achieved UDP throughput
* NMIdSource VARCHAR(100) ID of the source of the transfer
* NMIdDestination VARCHAR(100) ID of the destination of the transfer
* tool VARCHAR(100) tool used to make the measurement
* packetSize INTEGER size of the packets in bytes
* packets INTEGER number of packets transferred
* packetGap INTEGER gap between successive packets in microseconds
timeStamp VARCHAR(15) timstamp of the measurement
userRate REAL achieved throughput of user information in bit/s
wireRate REAL achieved throughput of information including packet headers etc in bit/s
Table: NetworkUDPPacketLoss 1-way loss of UDP packets
* NMIdSource VARCHAR(100) ID of the source of the packets
* NMIdDestination VARCHAR(100) ID of the destination of the packets
* tool VARCHAR(100) tool used to make the measurement
* packetSize INTEGER size of the packets in bytes
* packets INTEGER number of packets transferred
* packetGap INTEGER gap between successive packets in microseconds
timeStamp VARCHAR(15) timestamp of the measurement
value REAL 1-way percentage loss of UDP packets
Table: NetworkOneWayIPDV 1-way inter-packet delay variation
* NMIdSource VARCHAR(100) ID of the source of the packets
* NMIdDestination VARCHAR(100) ID of the destination of the packets
* tool VARCHAR(100) tool used to make the measurement
* packetSize INTEGER size of the packets in bytes
* packets INTEGER number of packets transferred
* packetGap INTEGER gap between successive packets in microseconds
timeStamp VARCHAR(15) timestamp of the measurement
value REAL 1-way inter-packet delay variation in microseconds
Constraint/Filter:
For all tables NMIDSource matches "*cern\.ch$"
Consumer/Consumption/Subscription
---------------------------------
Vocabulary: Relational
select * from NetworkTCPThroughput where NMIdSource is like '*.ch' or NMIdDestination is like '*.ch'
select * from NetworkICMPPacketLoss where NMIdSource is like '*.ch' or NMIdDestination is like '*.ch'
select * from NetworkRTT where NMIdSource is like '*.ch' or NMIdDestination is like '*.ch'
select * from NetworkUDPThroughput where NMIdSource is like '*.ch' or NMIdDestination is like '*.ch'
select * from NetworkUDPPacketLoss where NMIdSource is like '*.ch' or NMIdDestination is like '*.ch'
select * from NetworkOneWayIPDV where NMIdSource is like '*.ch' or NMIdDestination is like '*.ch'
How to do it in INFOD??
1.3.2 MOnitoring the long-term network performance
* A site network manager uses monitoring tools to get performance
information such as round trip time (RTT) between pairs of hosts,
percentage loss of packets; inter-packet delay variation and
throughput achieved for file transfers. He needs to perform these
measurements over periods of days or weeks to ensure that the
promised QoS is delivered. He also makes the data available to
other potential consumers including end-users and applications
(e.g. schedulers and file transfer tools). The availability of the
data for further analysis and evaluation is crucial.
1.3.3 Spare words
* An end-user or application are more likely to be interested in the
most recent measurements to adjust, in "real-time", their usage of
network resources and make sure that the agreed QoS is honored.
The availability of the data is necessary if further action is to be
taken when the agreed QoS is not delivered
1.4 Security:
Networks are resources so the comments about security above in the previous use case apply here
1.5 Performance:
For interactive use the ~ One second reponse time is expected.
More information about the infod-wg
mailing list