Final report
of ITS Center project: Cellphone probes as an ATMS tool
A
Research Project Report
For
the National ITS Implementation Research Center
A U.S. DOT University
Transportation Center
Principal Investigators:
Dr.
Brian L. Smith
Han
Zhang
Mike
Fontaine
Matt
Green
Technical Report
Prepared by:
Smart Travel Laboratory
Charlottesville,
Virginia
Center for Transportation Studies
University of Virginia
CTS
Website http://cts.virginia.edu
351 McCormick Road, P.O. Box 400742
Charlottesville,
VA 22904-4742
434.924.6362
June 2003
Smart Travel Lab Report No. STL-2003-01
Disclaimer: The contents of this report reflect the views of the authors, who are
responsible for the facts and the accuracy of the information presented herein.
This document is disseminated under the sponsorship of the Department of
Transportation, University Transportation Centers Program, in the interest of
information exchange. The U.S. Government assumes no liability for
the contents or use thereof.

ABSTRACT
The foundation of traffic operations and management is
the ability to monitor traffic conditions. One
approach to traffic monitoring is to sample conditions by “tracking” a limited
number of probe vehicles as they traverse a network. An emerging technology known as wireless location
technology (WLT) has been developed to allow for the geolocation of mobile wireless
devices (the most common of which are cellular telephones).
Over the past decade, a number of research studies and operational tests
have attempted to develop probe traffic monitoring systems based on WLT.
However, there still exists significant confusion and misperceptions concerning
WLT-based traffic monitoring. To address
this problem, this paper seeks to provide a comprehensive assessment of WLT-based
traffic monitoring. To do so, the specific
purposes of this paper are to: (a) fully describe the concept of WLT-based
traffic monitoring, (b) present a critical assessment of past studies of WLT-based
traffic monitoring, (c) document the evaluation of one of the most recent operational
tests – the 2001 Virginia Department of Transportation (VDOT), Maryland State
Highway Administration (MSHA), and US Wireless Corporation (USWC) effort in the
Washington, D.C. region, and (d) discuss the unique challenges that these systems
pose to the field of traffic engineering.
Since
the intelligent transportation systems (ITS) program began to take shape in the
early 1990s, transportation agencies at the federal, state, and local levels have
focused significant resources on using information technology to improve surface
transportation. While ITS has evolved
and now takes a myriad of forms, the foundation of nearly every ITS initiative
is the ability to measure traffic conditions on the network – generally referred
to as traffic condition monitoring. Without knowledge of traffic conditions, transportation
professionals can do little to manage traffic or provide traveler information.
Furthermore, traffic condition data collected by ITS are now being used
in a wide range of transportation applications, such as planning and infrastructure
management.
Transportation
professionals generally measure traffic conditions using a network of “point”
sensors installed at strategic locations throughout the network. While this approach is functional, it suffers
from practical limitations that have resulted in incomplete and erratic traffic
condition data. The communications, installation,
and maintenance costs of the sensor networks have forced transportation agencies
to install them only on the most critical routes – often with widely spaced sensors.
This leaves many “holes” in the system that lack traffic condition data.
An
alternative approach to traffic condition monitoring is to sample a portion of
vehicles as they traverse the network. This
approach is generally referred to as probe-based monitoring. An emerging information technology, wireless
location technology (WLT), holds great promise to provide the platform for a probe-based
traffic condition monitoring system. This technology allows wireless devices to be geolocated while in
use. WLT supports “location-based services”
(LBSs) in which wireless subscribers (whether using cellular phones, automobile-based
telematic devices, mobile computing products, etc.) are provided with targeted
information content based on their specific location (i.e. latitude/longitude).
Thus, WLT offers an existing and growing infrastructure that can conceptually
be tapped to provide probe-based traffic information, without the need for transportation
agencies to install extensive infrastructures solely devoted to traffic monitoring.
Given
the appeal of this concept, it is no surprise that WLT-based monitoring has captured
the interest of the ITS community over the past decade. In fact, there have been a number of relatively
large-scale operational tests undertaken in an effort to accelerate development
of WLT-based traffic monitoring systems. While these tests have generally been categorized as unsuccessful,
the project participants have gained significant insight into the abilities of
WLT-based traffic monitoring. Unfortunately,
relatively little of this insight has made its way into formal research papers
or reports. This has led to significant
confusion in the transportation community, and a lack of information on which
to base future decisions concerning this technology.
To
address this need, this paper seeks to provide a comprehensive introduction to
the concepts, experiences with, and performance of early-generation WLT-based
traffic monitoring systems. The specific
purposes of this paper are to (a) describe the concept of WLT-based traffic monitoring,
(b) present a critical assessment of past studies of WLT-based traffic monitoring,
(c) document the evaluation of one of the most recent operational tests – the
Virginia Department of Transportation (VDOT), Maryland State Highway Administration
(MSHA), and US Wireless Corporation (USWC) effort in the Washington, D.C. region,
and (d) discuss the challenges that these systems pose to the field of traffic
engineering.
WLT
can be classified into two general groups: handset-based systems and network-based
systems. Handset-based systems rely on
global positioning system (GPS)-enabled wireless phones. The GPS unit in the handset determines the
location of a phone, and this information is relayed from the phone to a central
processing system maintained by the wireless carrier. Network-based systems utilize signal information
from cell phones to derive their location. In some cases, network-based systems require
special equipment to be installed throughout a metropolitan area in order to analyze
signal characteristics of calls. For example,
some network-based systems determine positions by analyzing signal power and angle
of arrival at multiple cellular towers. In other cases, network-based systems derive
location estimates purely from signaling information already available at cellular
towers. Since network-based systems do
not require users to have GPS-enabled phones, they generally provide less spatial
accuracy than handset-based systems.
There
have been several attempts to use WLT data to generate traffic condition information.
In order to produce this type of information, a WLT system has to be able
to perform three basic tasks:
Several
evaluations of early generation WLT-based traffic condition monitoring systems
have occurred, but none of these systems adequately performed all three of these
tasks. Past evaluations have taken one
of two forms: simulation studies or field operational tests. Major findings of these studies are summarized
below.
Researchers have used simulation studies to explore the potential accuracy and effectiveness of WLT-based systems. While these studies do not replicate the actual conditions precisely, they do provide some indication of the potential performance of a WLT-based system.
A
study conducted by the French transportation research organization, INRETS, focused
on developing a discrete event simulation of traffic flow in order to determine
the sample size requirements and accuracy of a hypothetical WLT system (Ygnace,
et. al., 2000). The simulation examined
the impact of varying levels of probe vehicle penetration on the accuracy of travel
time estimates. A location error of 150
meters was assumed, and researchers examined a series of traffic and geometric
conditions. The simulation results showed
that freeway link travel times could be estimated to within 10 percent of their
actual value if there is at least 5 percent penetration of wireless devices in
the traffic stream. These promising results are based on relatively
simple geometric conditions.
A
recent evaluation by the Berkeley Institute for Transportation Studies examined
factors that could affect the utility of WLT-based traffic monitoring systems
(Cayford and Johnson, 2003). The researchers
examined three variables in their simulation: location accuracy, frequency of locations of
a single wireless device, and the total number of locations that could be determined
per square mile per second. The variation
in the number of roads that could be traversed by at least one vehicle within
a five-minute period was used as the measure of effectiveness to compare different
alternatives. The researchers did not
attempt to address whether the observed sample sizes were sufficient to produce
accurate estimates of speeds or travel times for the entire traffic stream, however.
The major findings of this research effort were:
Again,
these results only show whether a tracked probe vehicle traveled on a particular
road at least once during a 5-minute period. The researchers did not state whether this
would be sufficient to determine actual speeds or travel times.
Several
field tests of WLT-based systems have been performed in the United States. Network-based systems have been used in all
cases since GPS-enabled phones currently account for a relatively small portion
of available probes.
The
first major operational test of a WLT-based system was conducted over a 27-month
period in the mid-1990’s on several interstates and state routes in Virginia (UMD,
1997). This project was named CAPITAL
(Cellular APplied to ITS Tracking And Location), and was the result of a cooperative
agreement between FHWA, VDOT, MSHA, and several private sector firms.
This evaluation produced the following major findings:
While
the CAPITAL test showed that WLT could provide reasonably accurate positional
data, it was unsuccessful in producing traffic information.
In
addition to the VDOT/MSHA/USWC evaluation documented later in this paper, the
U.S. Wireless Corporation (no longer in business) also participated in an operational
test in Oakland, California (Yim and Cayford, 2001). Researchers at the University of California
- Berkeley obtained 44 hours of wireless location data. The researchers found that the position estimates
generally had a 60-meter accuracy, although 66 percent of all probe vehicle tracks
had at least one data point that deviated from the caller’s actual position by
more than 200 meters.
While
the researchers were generally able to identify the location of a vehicle, they
were not successful in matching vehicles to roads or in generating speed or travel
time information. The researchers noted
that the call lengths were generally very short, with a median call length of
only 30 seconds. This made it impossible
to estimate speeds on links since position estimates were not available for long
distances. As a result, the researchers were not able to match 60 percent of
vehicles to a roadway link.
The most recently completed large-scale field test of WLT-based traffic monitoring was the VDOT/MSHA/USWC effort that took place in the Washington D.C. region beginning in the year 2000. The next sections of this paper introduce this test, describe the evaluation methodology, and present a summary of the evaluation results.
DEPLOYMENT DESCRIPTION – VDOT/MSHA/USWC OPERATIONAL TEST
Beginning in 2000, VDOT and MSHA participated in a WLT
demonstration project with USWC in the southern suburban region of Washington
D.C.. This region includes the Capital
Beltway, a heavily traveled 8-lane freeway that experiences significant congestion,
and many major arterials. The purpose
of the demonstration project was to demonstrate the feasibility of
WLT-based traffic condition monitoring.
EVALUATION METHODOLOGY
The University of Virginia’s Center for Transportation Studies served as
the traffic monitoring evaluator in this field test (the University of Maryland
also served as an evaluator, focusing on location estimation of individual vehicles).
This section details the methodology developed for the WLT-based traffic
monitoring evaluation.
Data Collection
A key evaluation challenge was to collect accurate baseline traffic data to serve as the ground truth against which WLT-based system estimates of macroscopic traffic parameters could be compared. It was essential that the baseline data accurately represent the actual conditions on the facilities – and that this could be verified through manual means. Two possible approaches to collecting the baseline data were available to the evaluator: probe vehicles and point sensors.
Conceptually, the use of probe vehicles for baseline data collection is desirable. Given that the WLT-based system collects data on “probes” over the entire length of roadway links, baseline probes would allow for the same measurement. However, without tolled facilities in the project region, it was impractical to collect significant samples of baseline probe data. The use of a point sensor, on the other hand, allows the speed of every vehicle passing a point on a link to be collected. However, it requires the key assumption that conditions are uniform throughout the link in order to compare with the WLT-based system results. Traffic volumes can also be determined using point sensors, something that is impossible with a probe-based approach. This is important in that it allows for the assessment of the temporal adequacy of samples from the WLT-based system by providing true population data for the macroscopic traffic parameters. Given these advantages, as well as data collection constraints, it was determined that point sensors would be used as the baseline measurement approach in this evaluation.
A van-mounted video detection system was used for baseline data collection. The video detection system was used to derive point measures (spot speeds and counts) by processing video from a camera mounted on a 45-foot telescoping mast installed on the van. This system provided the flexibility to position the location of collection in the mid-point of WLT-based system defined links (relatively short, 0.4 miles in length), and allowed for manual verification of baseline data accuracy (using a hand-held Lidar unit for speed, and manual counts for volume).
Given that the focus of this evaluation was on the ability of WLT-based systems to support traffic monitoring applications, it was decided that a relatively short “polling” interval should be used in the effort. Based on information in the Highway Capacity Manual (TRB, 2000) and recent research on flow rate stability (Smith and Ulmer, 2003) 10 minutes was selected as the polling interval used.
Finally,
it was important to clearly define the term “sample” in the data collection effort.
In many cases, a WLT-based system may sample the speed of the same vehicle
multiple times as it traverses a single link.
While it is possible to argue the validity of treating each sample of the
same vehicle as an independent sample of link speed (i.e. assuming a vehicle’s
speed is solely governed by conditions over the entire length of the link),
a conservative approach that most directly corresponds to traditional traffic
monitoring practice is to consider the average speed of the multiple samples from
the same vehicle as the single sample for that vehicle/link pair. This was the approach used in this research.
Comparative
Analysis
The comparative analysis included two key components. First, the baseline link population data was used to compute confidence intervals on mean speed estimates to identify minimum required sample sizes for deriving traffic data of particular levels of “quality.” These were then compared with the WLT-based system samples to ascertain if the system is theoretically capable of providing sufficient numbers of samples. Second, link data from the baseline video detection system and WLT-based system were directly compared to determine if the WLT-based system produced link mean speed results that accurately reflect the ground truth.
Given that a WLT-based traffic
monitoring system will produce individual vehicle speed samples on links, or samples
of the random variable, U, and the system
is attempting to estimate the mean link speed, μ, the Central Limit Theorem
can be used to estimate the number of samples required to estimate μ to within
some level of allowable error at an assumed confidence level.
This approach is widely used in experimental design and has been used,
for example, to determine the number of probes required for speed estimation in
the Houston automatic vehicle identification (AVI) based traffic monitoring system
(Turner and Holdener, 1996).
Based on the Central Limit Theorem, one can collect n probe samples and compute a confidence interval about the population mean as follows:
(1)
In other words, there is an a probability that the true mean link speed falls in the interval defined above. Note that this effort’s methodology allows for the direct computation of the speed population parameters since the van-based video detection system measured the speed of every vehicle traversing the link over the 10-minute interval.
Working with equation (1), if the “width” of the confidence interval is defined as 2d miles/hour (i.e., an error of ±d miles/hour can be accepted in the estimation of the true link mean speed, m) an equation can be derived to determine the minimum required sample size, n. Note that a confidence level, α, must be assumed.
(2)
Finally, it must be noted that this methodology assumes that a WLT-based traffic monitoring system measures the speed of each vehicle traversing a link without error. Certainly, this will not be the case. As such, the values of n presented in the results represent the absolute minimum number of samples required. A fielded system will likely require a somewhat larger number of samples to account for errors in the system’s ability to measure individual vehicle speeds.
For each 10-minute interval, mean speeds produced by the WLT-based system were compared with the baseline data to measure percentage error in the speed estimates of the WLT-based system. In addition, hypothesis tests were conducted to rigorously assess the difference in mean speed values. The Wilcoxon Rank-sum Test, the most widely used nonparametric alternative to the independent samples t-test, was selected for this purpose. The mean speed of baseline and WLT-based system samples were compared at the 95 percent confidence level using the following hypothesis test:
Ho: m = mo
Ha: m ¹ mo
Where,
m = WLT-based system mean 10-minute interval link speed
mo= Baseline mean 10-minute interval link speed
RESULTS
Three major data collection efforts were conducted to gather the baseline data needed for the evaluation. These took place in the Fall of 2001, and included links that could be classified as freeway, high-speed major arterial, and low-volume/speed urban links. Data collection was conducted primarily during daylight hours, however, data were collected in the evening for several hours on a freeway link. It should first be noted that the WLT-based system was unable to reliably collect sufficient samples to estimate conditions on low-volume/speed urban links – therefore no results are available for this category of facility. Table 1 provides detail on the links analyzed in this research.
Link
Descriptions
| Link ID | Road Name | Direction | Speed Limit (mph) | AADT | # Lanes | Description |
| 201 | I-495 | East | 55 | 65,000 |
4 | Between
Telegraph Rd & US1 |
| 202 | I-495 | West | 55 | 73,000 |
4 | Between
Telegraph Rd & US1 |
| 103 | US-1 | North | 45 | 58,000 (Bidirectional) |
3 | Immediately
south of I-495 interchange |
| 104 | US-1 | South | 45 |