paint-brush
ExPECA: An Experimental Platform for Trustworthy: Experimental Testbed Validationby@edgelet
106 reads

ExPECA: An Experimental Platform for Trustworthy: Experimental Testbed Validation

tldt arrow

Too Long; Didn't Read

ExPECA is an edge computing and wireless communication research testbed designed to tackle challenges in wireless experiments.
featured image - ExPECA: An Experimental Platform for Trustworthy: Experimental Testbed Validation
Edgelet: Rendering The Real Internet HackerNoon profile picture

This paper is available on arxiv under CC 4.0 license.

Authors:

(1) Samie Mostafavi, ssmos, KTH Royal Institute of Technology;

(2) Vishnu Narayanan Moothedath, vnmo, KTH Royal Institute of Technology;

(3) Stefan Ronngren, steron, KTH Royal Institute of Technology;

(4) Neelabhro Roy, §nroy, KTH Royal Institute of Technology;

(5) Gourav Prateek Sharma, gpsharma, KTH Royal Institute of Technology;

(6) Sangwon Seo, sangwona, KTH Royal Institute of Technology;

(7) Manuel Olgu´ın Munoz, [email protected], KTH Royal Institute of Technology;

(8) James Gross, jamesgr, KTH Royal Institute of Technology.

III. EXPERIMENTAL TESTBED VALIDATION

This section aims to substantiate two key assertions about ExPECA: its efficiency in facilitating end-to-end experiments and its ability to ensure experimental reproducibility[1].


To validate the first claim, we employ OpenRTiST [7], an open-source application that is computationally demanding, bandwidth-intensive, and latency-sensitive. OpenRTiST uses machine learning filtering to overlay various artistic styles onto video frames, creating an augmented reality experience. In this experiment, the OpenRTiST client connects to the server either at the edge, specifically the testbed servers, or in the cloud via a server located at Carnegie Mellon University (CMU), in Pittsburgh, Pennsylvania, through a COTS 5G system and the adv-03 node. In Figure 4, we depict the corresponding critical performance indicators such as frames per second (FPS) and round-trip time (RTT) measured using the testbed. In Figure 4a, we plot the Cumulative Distribution Function (CDF) of FPS, and in Figure 4a we plot the Complementary CDF (CCDF) of RTT. As we move from edge to cloud, RTT significantly increases which results in lower refresh rates and less responsive video stream. The performance is benchmarked against different video frame sizes to analyze network and compute capacity.


Fig. 4: Performance analysis of OpenRTiST on COTS 5G system and adv-03 node using the ExPECA testbed.


For the second claim, we concentrate on wireless network latency, a metric inherently challenging to model due to its stochastic nature at the packet level. While latency can be influenced by factors like transmit power and channel interference, it also depends on wireless protocol settings such as modulation schemes, bandwidth, and antenna configurations. ExPECA’s isolated location minimizes variability in channel quality, mitigating potential interference. In Figure 5, we present latency measurements across different radio links over several days, demonstrating the reproducibility level in the case of COTS 5G wireless links. The close similarity between these CCDFs confirms the reproducibility of wireless latency measurements achieved through ExPECA.


Fig. 5: Twelve rounds of independent end-to-end latency measurements over the 5G COTS system between dot-02 andadv-03 node, each based on 160k samples.


Fig. 6: Illustration: Testbed experiment scenarios.


[1] Experiments available as Python Jupyter notebooks at https://github.com/KTH-EXPECA/examples