2024-03-29T06:41:31Z
https://zenodo.org/oai2d
oai:zenodo.org:3528148
2020-01-20T16:58:22Z
user-elastest
openaire
user-eu
Sudhodanan, Avinash
Caballero, Juan
2018-06-27
<p>Web browsers support various cross-origin interaction features including cross-origin resource inclusion and cross-origin resource sharing. These features can be abused to mount various cross-origin attacks (e.g., cross-site request forgery, cross-site script inclusion, etc.).</p>
<p>Many client-side and server-side defenses have been proposed against cross-origin attacks (e.g., SameSite cookies, Cross-Origin Resource Policy, Cross-Origin Window Policy etc.). However, incorrect implementation of these defenses is a big problem.</p>
<p>In this poster, we propose the need for a framework that can assist developers in identifying cross-origin attacks, understanding how to fix them, and test whether the fix has been implemented correctly.</p>
https://doi.org/10.5281/zenodo.3528148
oai:zenodo.org:3528148
eng
Zenodo
https://zenodo.org/communities/elastest
https://zenodo.org/communities/eu
https://doi.org/10.5281/zenodo.3528147
info:eu-repo/semantics/openAccess
Creative Commons Attribution 4.0 International
https://creativecommons.org/licenses/by/4.0/legalcode
Elastest
Cross-Origin Vulnerabilities in Web Sites: Detection & Prevention
info:eu-repo/semantics/conferencePoster
oai:zenodo.org:3387249
2020-01-20T13:51:06Z
user-elastest
user-eu
César Sánchez
2018-11-10
<p> We revisit Stream Runtime Verification for synchronous systems.<br>
Stream Runtime Verification (SRV) is a declarative formalism to<br>
express monitors using streams, which aims to be a simple and<br>
expressive specification language.<br>
The goal of SRV is to allow engineers to describe both<br>
correctness/failure assertions and interesting statistical measures<br>
for system profiling and coverage analysis.<br>
The monitors generated are useful for testing, under actual<br>
deployment, and to analyze logs.<br>
<br>
The main observation that enables SRV is that the steps in the<br>
algorithms to monitor temporal logics (which generate Boolean<br>
verdicts) can be generalized to compute statistics of the trace if a<br>
different data domain is used.<br>
Hence, the fundamental idea of SRV is to separate the temporal<br>
dependencies in the monitoring algorithm from the concrete<br>
operations to be performed at each step.<br>
<br>
In this paper we revisit the pioneer SRV specification language \lola<br>
and present in detail the online and offline monitoring algorithms.<br>
The algorithm for online monitoring \lola specifications uses a<br>
partial evaluation strategy, by incrementally constructing output<br>
streams from input streams, maintaining a storage of partially<br>
evaluated expressions.<br>
We identify syntactically a class of specifications for which the<br>
online algorithm is trace length independent, that is, the memory<br>
requirement does not depend on the length of the input streams.<br>
Then, we extend the principles of the online algorithm to create an<br>
efficient offline monitoring algorithm for large traces, which<br>
consist on scheduling trace length independent passes on a dumped<br>
log.<br>
</p>
https://doi.org/10.1007/978-3-030-03769-7_9
oai:zenodo.org:3387249
Springer
https://zenodo.org/communities/elastest
https://zenodo.org/communities/eu
info:eu-repo/semantics/openAccess
Creative Commons Attribution 4.0 International
https://creativecommons.org/licenses/by/4.0/legalcode
RV, Int'l Conference on Runtime Verification, 11-13 November, 2018
Runtime verification, formal verification, formal methods, stream runtime verification synchronous systems, dynamic analysis, monitoring.
Online and Offline Stream Runtime Verification of Synchronous Systems
info:eu-repo/semantics/conferencePaper
oai:zenodo.org:1253389
2020-01-20T17:03:21Z
user-elastest
user-eu
Bertolino, Antonia
Calabrò, Antonello
De Angelis, Guglielmo
García, Boni
Gallego, Micael
Gortázar, Francisco
2018-05-25
<p>We present ElasTest, an open-source generic and extensible platform supporting end-to-end testing of large complex cloud systems, including web, mobile, network and WebRTC applications. ElasTest is developed following a fully transparent and open agile process around which a community of developers, contributors and users is collected. We demonstrate ElasTest in action by testing the FullTeaching application: the video is available from http://elastest.io/videos/icse2018-demo.</p>
https://doi.org/10.1145/3183440.3183497
oai:zenodo.org:1253389
eng
Zenodo
https://zenodo.org/communities/elastest
https://zenodo.org/communities/eu
info:eu-repo/semantics/openAccess
Creative Commons Attribution 4.0 International
https://creativecommons.org/licenses/by/4.0/legalcode
Cloud testing
End-to-end testing
Open-source test platform
TaaS
Test automation
When the testing gets tough, the tough get ElasTest
info:eu-repo/semantics/conferencePaper
oai:zenodo.org:3406040
2020-01-20T17:33:10Z
user-elastest
user-eu
Boni García
Luis López-Fernández
Francisco Gortázar
Micael Gallego
2019-07-31
<p>WebRTC is the umbrella term for several emergent technologies aimed to exchange real-time media in the Web. Like other media-related services, the perceived quality of WebRTC communication can be measured using Quality of Experience (QoE) indicators. QoE assessment methods can be classified as subjective (users’ evaluation scores) or objective (models computed as a function of different parameters). In this paper, we focus on VMAF (Video Multi-method Assessment Fusion), which is an emergent full-reference objective video quality assessment model developed by Netflix. VMAF is typically used to assess video streaming services. This paper evaluates the use of VMAF in a different type of application: WebRTC. To that aim, we present a practical use case built on the top of well-known open source technologies, such as JUnit, Selenium, Docker, and FFmpeg. In addition to VMAF, we also calculate other objective QoE video metrics such as Visual Information Fidelity in the pixel domain (VIFp), Structural Similarity (SSIM), or Peak Signal-to-Noise Ratio (PSNR) applied to a WebRTC communication in different network conditions in terms of packet loss. Finally, we compare these objective results with a subjective evaluation using a Mean Opinion Score (MOS) scale to the same WebRTC streams. As a result, we found a strong correlation of the subjective video quality perceived in WebRTC video calls with the objective results computed with VMAF and VIFp in comparison with SSIM and PSNR and their variants.</p>
https://doi.org/10.3390/electronics8080854
oai:zenodo.org:3406040
eng
Zenodo
https://zenodo.org/communities/elastest
https://zenodo.org/communities/eu
info:eu-repo/semantics/openAccess
Creative Commons Attribution 4.0 International
https://creativecommons.org/licenses/by/4.0/legalcode
QoE
WebRTC
VMAF
Video quality
Practical Evaluation of VMAF Perceptual Video Quality for WebRTC Applications
info:eu-repo/semantics/article
oai:zenodo.org:1208210
2020-01-20T15:40:01Z
user-elastest
user-eu
Breno Miranda
Emilio Cruciani
Roberto Verdecchia
Antonia Bertolino
2018-05-27
<p>Many test case prioritization criteria have been proposed for speeding up fault detection. Among them, similarity-based approaches give priority to the test cases that are the most dissimilar from those already selected. However, the proposed criteria do not scale up to handle the many thousands or even some millions test suite sizes of modern industrial systems and simple heuristics are used instead. We introduce the <em><strong>FAST</strong></em> family of test case prioritization techniques that radically changes this landscape by borrowing algorithms commonly exploited in the big data domain to find similar items. <em><strong>FAST</strong></em> techniques provide scalable similarity-based test case prioritization in both white-box and black-box fashion. The results from experimentation on real world C and Java subjects show that the fastest members of the family outperform other black-box approaches in efficiency with no significant impact on effectiveness, and also outperform white-box approaches, including greedy ones, if preparation time is not counted. A simulation study of scalability shows that one <em><strong>FAST</strong></em> technique can prioritize a million test cases in less than 20 minutes.</p>
https://doi.org/10.1145/3180155.3180210
oai:zenodo.org:1208210
eng
Zenodo
https://doi.org/10.5281/zenodo.1208195
https://doi.org/10.13039/100010661
https://zenodo.org/communities/elastest
https://zenodo.org/communities/eu
info:eu-repo/semantics/openAccess
Creative Commons Attribution 4.0 International
https://creativecommons.org/licenses/by/4.0/legalcode
ICSE, 40th International Conference on Software Engineering, Gothenburg, Sweden, May 27-June 3, 2018
locality sensitive hashing
minhashing
scalability
similarity
software testing
test case prioritization
FAST Approaches to Scalable Similarity-based Test Case Prioritization
info:eu-repo/semantics/conferencePaper
oai:zenodo.org:1295566
2020-01-20T16:05:04Z
user-elastest
user-eu
Richard Rivera
Platon Kotzias
Avinash Sudhodanan
Juan Caballero
2018-06-06
<p>Freeware is proprietary software that can be used free of charge. A popular vector for distributing freeware are download<br>
portals, i.e., websites that index, categorize, and host programs. Download portals can be abused to distribute potentially unwanted<br>
programs (PUP) and malware. The abuse can be due to PUP and malware authors uploading their ware, by benign freeware<br>
authors joining as affiliate publishers of PPI services and other affiliate programs, or by malicious download portal owners. In this<br>
work, we perform a systematic study of abuse in download portals. We build a platform to crawl download portals and apply it to<br>
download 191K Windows freeware installers from 20 download portals. We analyze the collected installers and execute them in a<br>
sandbox to monitor their installation. We measure an overall ratio of PUP and malware between 8% (conservative estimate) and<br>
26% (lax estimate). In 18 of the 20 download portals examined the amount of PUP and malware is below 9%. But, we also find<br>
two download portals exclusively used to distribute PPI downloaders. Finally, we detail different abusive behaviors that authors of<br>
undesirable programs use to distribute their programs through download portals.</p>
https://doi.org/10.1049/iet-ifs.2017.0585
oai:zenodo.org:1295566
eng
Zenodo
https://zenodo.org/communities/elastest
https://zenodo.org/communities/eu
info:eu-repo/semantics/openAccess
Creative Commons Attribution 4.0 International
https://creativecommons.org/licenses/by/4.0/legalcode
Costly Freeware: A Systematic Analysis of Abuse in Download Portals
info:eu-repo/semantics/article
oai:zenodo.org:3385673
2020-01-20T13:42:37Z
user-elastest
user-eu
Felipe Gorostiaga
César Sánchez
2018-11-10
<p>We study the problem of monitoring rich properties of real-time event streams, and propose a solution based on Stream Runtime Verification (SRV), where observations are described as output streams of data computed from input streams of data. SRV allows a clean separation between the temporal dependencies among incoming events, and the concrete operations that are performed during the monitoring.</p>
<p>SRV specification languages typically assume that all streams share a global synchronous clock and input events arrive in a synchronous manner. In this paper we generalize the time assumption to cover real-time event streams, but keep the essential explicit time dependencies present in synchronous SRV languages. We introduce Striver, which shares with SRV the simplicity, and the separation between the timing reasoning and the data domain. Striver is a general language that allows to express other real-time monitoring languages. We show in this paper translations from other formalisms for (piece-wise constant) signals and timed event streams. Finally, we report an empirical evaluation of an implementation of Striver.</p>
https://doi.org/10.1007/978-3-030-03769-7_16
oai:zenodo.org:3385673
Springer
https://zenodo.org/communities/elastest
https://zenodo.org/communities/eu
info:eu-repo/semantics/openAccess
Creative Commons Attribution 4.0 International
https://creativecommons.org/licenses/by/4.0/legalcode
RV2018, International Conference on Runtime Verification
Striver: Stream Runtime Verification for Real-Time Event-Streams
info:eu-repo/semantics/conferencePaper
oai:zenodo.org:1208196
2020-01-25T07:21:40Z
user-elastest
software
Breno Miranda
Emilio Cruciani
Roberto Verdecchia
Antonia Bertolino
2018-03-27
<p>"FAST Approaches to Scalable Similarity-based Test Case Prioritization" online material.</p>
https://doi.org/10.5281/zenodo.1208196
oai:zenodo.org:1208196
eng
Zenodo
https://github.com/icse18-FAST/FAST/tree/v1.0.0
https://doi.org/10.1145/3180155.3180210
https://zenodo.org/communities/elastest
https://doi.org/10.5281/zenodo.1208195
info:eu-repo/semantics/openAccess
GNU General Public License v2.0 only
https://www.gnu.org/licenses/old-licenses/gpl-2.0-standalone.html
ICSE, 40th International Conference on Software Engineering, Gothenburg, Sweden, May 27-June 3, 2018
Supplementary material (source code and results) for "FAST Approaches to Scalable Similarity-based Test Case Prioritization"
info:eu-repo/semantics/other
oai:zenodo.org:3387253
2020-01-20T16:43:04Z
user-elastest
Pablo Chico de Guzmán
Felipe Gorostiaga
César Sánchez
2019-09-05
<p>Container virtualization technologies, like Docker, are becoming increasingly popular. Containers provide exceptional developer experience because containers offer lightweight isolation and ease of software distribution. Containers also solve a fundamental code portability problem.</p>
<p>In contrast, container virtualization is basically insecure when compared to virtualization based on hypervisors. Virtual machines are also better integrated with the rest of the cloud ecosystem. Sum it all, virtual machines are more suitable for production<br>
environments. However, virtual machines impose a non-negligible memory footprint and suffer longer boot times, which is impractical for local development. So far, there is no deployment infrastructure that allows both the developer experience of containers and the maturity and isolation capabilities of virtual machines.</p>
<p>We solve this problem in this paper by introducing \itwokit, an orchestration tool that enjoys the best of both worlds: (1) the development workflow is untouched, containers can be used as usual; (2) at time of deployment, containers are transformed into virtual machines, keeping code portability, but providing better security and better integration with other cloud services. The tool \itwokit creates virtual machines using Linuxkit. Linuxkit alleviates the drawback in size that using virtual machines would otherwise entail because the footprint of our Linuxkit distributions is only about 60MB. The attack surface of the application is reduced since Linuxkit only installs the minimum set of OS dependencies to run containers. Finally, we report an empirical study using \itwokit that allows us to conclude that \itwokit is a promising technology for VM deployment of<br>
applications developed using containers.<br>
</p>
https://doi.org/10.1007/978-3-030-02922-7_6
oai:zenodo.org:3387253
Springer
https://zenodo.org/communities/elastest
info:eu-repo/semantics/openAccess
Creative Commons Attribution 4.0 International
https://creativecommons.org/licenses/by/4.0/legalcode
WISE, International Conference on Web Information Systems Engineering, 12-15 November, 2018
virtualization, orchestration; security; resource utilization;
i2kit: A Deployment Tool with the Simplicity of Containers and the Security of Virtual Machines
info:eu-repo/semantics/conferencePaper
oai:zenodo.org:1295531
2020-01-20T17:27:50Z
user-elastest
user-eu
Boni García
Micael Gallego
Francisco Gortázar
Eduardo Jiménez
2017-08-02
<p>WebRTC is the umbrella term for a number of emerging technologies that extends the web browsing model<br>
to exchange real-time media (Voice over IP, VoIP) with other browsers. The mechanisms to provide quality<br>
assurance for WebRTC are key to release this kind of applications to production environments.<br>
Nevertheless, testing WebRTC based application, consistently automated fashion is a challenging problem.<br>
The aim of this piece of research is to provide a comprehensive summary of the current trends in the domain<br>
of WebRTC testing. For the sake of completeness, we have carried out this survey by aggregating the results<br>
from three different sources of information: i) Scientific and academia research papers; ii) WebRTC testing<br>
tools (both commercial and open source); iii) "Grey literature”, that is, materials produced by organizations<br>
outside of the traditional commercial or academic publishing and distribution channels.</p>
https://doi.org/10.5220/0006442003630371
oai:zenodo.org:1295531
eng
Zenodo
https://zenodo.org/communities/elastest
https://zenodo.org/communities/eu
info:eu-repo/semantics/openAccess
Creative Commons Attribution 4.0 International
https://creativecommons.org/licenses/by/4.0/legalcode
WebRTC, Software Testing, Software Quality
WebRTC Testing: State of the Art
info:eu-repo/semantics/conferencePaper
oai:zenodo.org:1306239
2020-01-20T17:23:03Z
user-elastest
user-eu
Boni
Luis
Micael
Francisco
2018-07-05
<p>In this article we introduce Kurento, an open source WebRTC media server and a set of client APIs aimed to simplify the development of applications with rich media capabilities for the Web and smartphone platforms. Kurento features include group communications, transcoding, recording, mixing, broadcasting and routing of audiovisual flows, but also provides advanced media processing capabilities such as computer vision and augmented reality. It is based on a modular architecture, which makes it possible for developers to extend and customize its native capabilities with third party media processing algorithms. Thanks to all this, Kurento can be a powerful tool for Web developers who may find natural programming with its Java and JavaScript APIs following the traditional three-tiered Web development model.</p>
https://doi.org/10.1109/MCOMSTD.2017.1700006
oai:zenodo.org:1306239
eng
Zenodo
https://zenodo.org/communities/elastest
https://zenodo.org/communities/eu
info:eu-repo/semantics/openAccess
Creative Commons Attribution 4.0 International
https://creativecommons.org/licenses/by/4.0/legalcode
Kurento: the Swiss Army Knife of WebRTC Media Servers
info:eu-repo/semantics/article
oai:zenodo.org:3579088
2020-01-20T15:02:37Z
user-elastest
user-eu
Augusto Cristian
Morán Jesús
Bertolino Antonia
de la Riva Claudio
Tuya Javier
2019-09-11
<p>Continuous integration practices introduce incremental changes in the code to both improve the quality and add new functionality. These changes can introduce faults that can be timely detected through continuous testing by auto-mating the test cases and re-executing them at each code change. However, re-executing all test cases at each change may not be always feasible, especially for those test cases that make heavy use of resources thoroughly like End-to-End test cases that need a complex test infrastructure. This paper is focused on optimizing the usage of the resources employed during End-to-End testing (e.g., storage, memory, web servers or tables of a database, among others) through a resource-aware test orchestration technique in the context of continuous integration in the cloud. In order to optimize both the cost/usage of resources and the execution time, the approach proposes to i) identify the resources required by the End-to-End test cases, ii) group together those tests that need the same resources, iii) deploy the tests in both dependency isolated and elastic environments, and iv) schedule their parallel execution in several machines.</p>
https://doi.org/10.1007/978-3-030-29238-6_22
oai:zenodo.org:3579088
eng
Zenodo
https://zenodo.org/communities/elastest
https://zenodo.org/communities/eu
info:eu-repo/semantics/openAccess
Creative Commons Attribution 4.0 International
https://creativecommons.org/licenses/by/4.0/legalcode
Software testing
Continuous integration
Continuous testing
Testing in the cloud
End-to-End testing
Test orchestration
RETORCH: Resource-aware End-to-end Test Orchestration
info:eu-repo/semantics/conferencePaper
oai:zenodo.org:3575176
2020-01-20T17:23:46Z
user-elastest
user-eu
Cruciani, Emilio
Miranda, Breno
Verdecchia, Roberto
Bertolino, Antonia
2019-05-25
<p>Test suite reduction approaches aim at decreasing software regression testing costs by selecting a representative subset from large-size test suites. Most existing techniques are too expensive for handling modern massive systems and moreover depend on artifacts, such as code coverage metrics or specification models, that are not commonly available at large scale. We present a family of novel very efficient approaches for similarity-based test suite reduction that apply algorithms borrowed from the big data domain together with smart heuristics for finding an evenly spread subset of test cases. The approaches are very general since they only use as input the test cases themselves (test source code or command line input). We evaluate four approaches in a version that selects a fixed budget B of test cases, and also in an adequate version that does the reduction guaranteeing some fixed coverage. The results show that the approaches yield a fault detection loss comparable to state-of-the-art techniques, while providing huge gains in terms of efficiency. When applied to a suite of more than 500K real world test cases, the most efficient of the four approaches could select B test cases (for varying B values) in less than 10 seconds.</p>
https://doi.org/10.1109/ICSE.2019.00055
oai:zenodo.org:3575176
Zenodo
https://doi.org/10.5281/zenodo.2550079
https://zenodo.org/communities/elastest
https://zenodo.org/communities/eu
info:eu-repo/semantics/openAccess
Creative Commons Attribution 4.0 International
https://creativecommons.org/licenses/by/4.0/legalcode
ICSE, 41st International Conference on Software Engineering (ICSE), Montreal, Canada, 25-31 May 2019
Clustering
Random projection
Similarity-based testing
Software testing
Test suite reduction
Scalable Approaches for Test Suite Reduction
info:eu-repo/semantics/conferencePaper
oai:zenodo.org:3529615
2020-01-20T16:50:58Z
user-elastest
user-eu
Luis Miguel Danielsson
Cesar Sanchez
2019-10-01
<p>We study the problem of decentralized monitoring of stream runtime verification specifications. Decentralized monitoring uses dis- tributed monitors that communicate via a synchronous network, a com- munication setting common in many cyber-physical systems like auto- motive CPSs. Previous approaches to decentralized monitoring were re- stricted to logics like LTL logics that provide Boolean verdicts. We solve here the decentralized monitoring problem for the more general setting of stream runtime verification. Additionally, our solution handles net- work topologies while previous decentralize monitoring works assumed that every pair of nodes can communicate directly. We also introduce a novel property on specifications, called decentralized efficient moni- torability, that guarantees that the online monitoring can be performed with bounded resources. Finally, we report the results of an empiri- cal evaluation of an implementation and compare the expressive power and efficiency against state-of-the-art decentralized monitoring tools like Themis.</p>
https://doi.org/10.1007/978-3-030-32079-9 11
oai:zenodo.org:3529615
Springer
https://zenodo.org/communities/elastest
https://zenodo.org/communities/eu
info:eu-repo/semantics/openAccess
Creative Commons Attribution 4.0 International
https://creativecommons.org/licenses/by/4.0/legalcode
11757, (2019-10-01)
RV'19, 19th International Conference on Runtime Verification, Porto, Portugal
Runtime Verification, Stream Runtime Verification, Decentralized Monitoring
Decentralized Stream Runtime Verification
info:eu-repo/semantics/conferencePaper
oai:zenodo.org:3384577
2020-01-20T17:30:34Z
user-elastest
user-eu
Ribera Laszkowsksi, Juan Francisco
Edmonds, Andy
Harsh, Piyush
Gortazar, Francisco
Michael Bohnert, Thomas
2018-09-28
<p>As systems get more complex testing has also increased not only in complexity but in the total IT cost, which is estimated to increase even more by 2020. Testing large complex distributed applications is hard, time consuming and lacks tooling. <br>
Given that the digitalisation of business has proved to be a key aspect for improving the productivity of developers in the delivery of the service to end-users, in this paper we present early results showing how these capabilities can also be provided to testers of software and services, by adopting standard interfaces and leveraging the tools provided by an early research open-source platform, capable of efficiently testing large scale systems, ElasTest.</p>
https://doi.org/10.5281/zenodo.3384577
oai:zenodo.org:3384577
eng
Zenodo
https://zenodo.org/communities/elastest
https://zenodo.org/communities/eu
https://doi.org/10.5281/zenodo.3384576
info:eu-repo/semantics/openAccess
Creative Commons Attribution 4.0 International
https://creativecommons.org/licenses/by/4.0/legalcode
ElasTest: An elastic platform for E2E testing complex distributed large software systems cloud
info:eu-repo/semantics/conferencePaper
oai:zenodo.org:1306235
2020-01-20T15:34:40Z
user-elastest
user-eu
Boni
Francisco
Luis
Micael
Miguel
2018-07-05
<p>WebRTC comprises a set of novel technologies and standards that provide Real-Time Communication on Web browsers. WebRTC makes simple the embedding of voice and video communications in all types of applications. However, releasing those applications to production is still very challenging due to the complexity of their testing. Validating a WebRTC service requires assessing many functional (e.g. signaling logic, media connectivity, etc.) and non-functional (e.g. quality of experience, interoperability, scalability, etc.) properties on large, complex, distributed and heterogeneous systems that spawn across client devices, networks and cloud infrastructures. In this article, we present a novel methodology and an associated tool for doing it at scale and in an automated way. Our strategy is based on a black-box end-to-end approach through which we use an automated containerized cloud environment for instrumenting Web browser clients, which benchmark the SUT (System Under Test), and fake clients, that load it. Through these benchmarks, we obtain, in a reliable and statistically significant way, both network-dependent QoS (Quality of Service) metrics and media-dependent QoE (Quality of Experience) indicators. These are fed, at a second stage, to a number of testing assertions that validate the appropriateness of the functional and non-functional properties of the SUT under controlled and configurable load and fail conditions. To finish, we illustrate our experiences using such tool and methodology in the context of the Kurento open source software project and conclude that they are suitable for validating large and complex WebRTC systems at scale.</p>
https://doi.org/10.1109/MCOMSTD.2017.1700005
oai:zenodo.org:1306235
eng
Zenodo
https://zenodo.org/communities/elastest
https://zenodo.org/communities/eu
info:eu-repo/semantics/openAccess
Creative Commons Attribution 4.0 International
https://creativecommons.org/licenses/by/4.0/legalcode
WebRTC Testing: Challenges and Practical Solutions
info:eu-repo/semantics/article
oai:zenodo.org:3577833
2020-01-20T14:46:47Z
user-elastest
user-eu
ANTONIA BERTOLINO
GUGLIELMO DE ANGELIS
MICAEL GALLEGO
BONI GARCÍA
FRANCISCO GORTÁZAR
FRANCESCA LONETTI
EDA MARCHETTI
2019-09-01
<p>A systematic literature review is presented that surveyed the topic of cloud testing over the period 2012–2017.<br>
Cloud testing can refer either to testing cloud-based systems (testing of the cloud) or to leveraging the cloud<br>
for testing purposes (testing in the cloud): both approaches (and their combination into testing of the cloud in<br>
the cloud) have drawn research interest. An extensive paper search was conducted by both automated query<br>
of popular digital libraries and snowballing, which resulted in the final selection of 147 primary studies.<br>
Along the survey, a framework has been incrementally derived that classifies cloud testing research among<br>
six main areas and their topics. The article includes a detailed analysis of the selected primary studies to<br>
identify trends and gaps, as well as an extensive report of the state-of-the-art as it emerges by answering the<br>
identified Research Questions. We find that cloud testing is an active research field, although not all topics<br>
have received enough attention and conclude by presenting the most relevant open research challenges for<br>
each area of the classification framework.</p>
https://doi.org/10.1145/3331447
oai:zenodo.org:3577833
eng
Zenodo
https://zenodo.org/communities/elastest
https://zenodo.org/communities/eu
info:eu-repo/semantics/openAccess
Creative Commons Attribution 4.0 International
https://creativecommons.org/licenses/by/4.0/legalcode
ACM Computing Surveys, 52(5), 93:1--93:42, (2019-09-01)
Cloud Computing
testing
systematic literature review
A Systematic Review on Cloud Testing
info:eu-repo/semantics/article
oai:zenodo.org:3575189
2020-01-20T15:01:49Z
user-elastest
user-eu
Pietrantuono, Roberto
Bertolino, Antonia
De Angelis, Guglielmo
Miranda, Breno
Russo, Stefano
2019-05-27
<p>We introduce the DevOpRET approach for continuous reliability testing in DevOps. It leverages information monitored in operation to guide operational-profile based testing, which is conceived as part of the acceptance testing stage before each next release to production. We overview the envisaged test and monitoring pipeline, describe the approach and present a case-study evaluating how reliability assessment evolves over subsequent releases.</p>
https://doi.org/10.1109/AST.2019.00009
oai:zenodo.org:3575189
Zenodo
https://zenodo.org/communities/elastest
https://zenodo.org/communities/eu
info:eu-repo/semantics/openAccess
Creative Commons Attribution 4.0 International
https://creativecommons.org/licenses/by/4.0/legalcode
AST, 14th International Workshop on Automation of Software Test (AST), Montreal, Canada, 27 May 2019
Acceptance Test
DevOps
Operational Profile
Quality Gate
Software Reliability Testing
Towards continuous software reliability testing in DevOps
info:eu-repo/semantics/conferencePaper
oai:zenodo.org:1442896
2020-01-20T17:35:15Z
user-elastest
user-eu
Boni García
Micael Gallego
Francisco Gortázar
Antonia Bertolino
2018-10-01
<pre>WebRTC comprises a set of technologies and standards that provide real-time communication with web browsers, simplifying the embedding of voice and video communication in web applications and mobile devices. The perceived quality of WebRTC communication can be measured using Quality of Experience (QoE) indicators. QoE is defined as the degree of delight or annoyance of the user with an application or service. This paper is focused on the QoE assessment of WebRTC-based applications and its contribution is threefold. First, an analysis of how WebRTC topologies affect the quality perceived by users is provided. Second, a group of Key Performance Indicators for estimating the QoE of WebRTC users is proposed. Finally, a systematic survey of the literature on QoE assessment in the WebRTC arena is presented.</pre>
https://doi.org/10.1007/s00607-018-0669-7
oai:zenodo.org:1442896
eng
Zenodo
https://zenodo.org/communities/elastest
https://zenodo.org/communities/eu
info:eu-repo/semantics/openAccess
Creative Commons Attribution 4.0 International
https://creativecommons.org/licenses/by/4.0/legalcode
WebRTC
Quality of Experience
QoE Management
Understanding and estimating quality of experience in WebRTC applications
info:eu-repo/semantics/article
oai:zenodo.org:3387092
2020-01-20T13:54:43Z
user-elastest
user-eu
Pablo Chico de Guzmán
Felipe Gorostiaga
César Sánchez
2018-09-06
<p> Modern cloud applications are based on microservice architectures.<br>
The deployment of these microservice based applications often<br>
requires that every constituent service starts after all its<br>
dependencies are configured and running properly. It is also common<br>
that these dependencies generate dynamic data that needs to be<br>
supplied to other services too at starting time. More complex<br>
scenarios require additionally interchanging data in other phases of<br>
the microservices life-cycle.<br>
<br>
One alternative to solve these dependencies is to describe the<br>
deployment of microservice applications manually---using<br>
scripts---which allows IT operators to precisely define when a<br>
service is ready to start serving other components. However,<br>
synchronization by scripting is tedious, error prone and hard to<br>
maintain. Other solutions offer specific languages to describe<br>
service dependencies, along with tool support that interpret scripts<br>
in these languages to take care of starting services in the proper<br>
order. These tools are either very rich but complex to use, or fail<br>
in providing sophisticated ways to describe what it means for a<br>
service to be ready. Moreover, the communication layer between<br>
services, if supplied, is based on intermediate entities and<br>
non-trivial network protocols.</p>
<p> This paper proposes pipekit as a solution, by offering a container<br>
orchestration language which focuses on simplicity (pipekit is<br>
similar to Docker Compose) and is equipped with directives to define<br>
when a service is ready. The pipekit tool provides a communication<br>
layer for moving data between services, implemented using shared<br>
storage. This shared storage provides a very simple interface to<br>
move artifacts between services, and greatly simplifies the<br>
synchronization logic of pipekit by using semaphores at the file<br>
system level.<br>
</p>
https://doi.org/10.1109/ICWS.2018.00066
oai:zenodo.org:3387092
Zenodo
https://zenodo.org/communities/elastest
https://zenodo.org/communities/eu
info:eu-repo/semantics/openAccess
Creative Commons Attribution 4.0 International
https://creativecommons.org/licenses/by/4.0/legalcode
ICWS'18, IEEE International Conference on Web Services, 2018
orchestration; microservices; deployment; synchronization;
Pipekit: A Deployment Tool with Advanced Scheduling and Inter-Service Communication for Multi-Tier Applications
info:eu-repo/semantics/conferencePaper
oai:zenodo.org:3577769
2020-01-20T16:57:58Z
user-elastest
user-eu
Boni Garci'a
Francesca Lonetti
Micael Gallego
Breno Miranda
Eduardo Jime'nez
Guglielmo De Angelis
Carlos Santos
Eda Marchetti
2019-12-16
<p>This paper presents the concept of test orchestration,<br>
understood as a novel way to select, order, and execute in<br>
parallel a group of tests. Our view of test orchestration can<br>
be seen as a process in which different test cases are organized,<br>
assembled and executed following a topology that determines<br>
how their executions coordinate. We distinguish two types of<br>
orchestrations techniques: i) verdict-driven, which organizes tests<br>
using their outcome (i.e., passed or failed) to drive the workflow;<br>
and ii) data-driven, in which test data (input) and test outcomes<br>
(output) are handled within the graph. Both approaches are being<br>
implemented in the project ElasTest, an open source platform<br>
aimed to simplify the end-to-end test process of large software<br>
systems.</p>
https://doi.org/10.1109/QUATIC.2018.00016
oai:zenodo.org:3577769
eng
Zenodo
https://zenodo.org/communities/elastest
https://zenodo.org/communities/eu
info:eu-repo/semantics/openAccess
Creative Commons Attribution 4.0 International
https://creativecommons.org/licenses/by/4.0/legalcode
QUATIC, 11th International Conference on the Quality of Information and Communications Technology, Coimbra, Portugal, 4-7 Sept. 2018
Software testing
test composition
test parallelization
A Proposal to Orchestrate Test Cases
info:eu-repo/semantics/conferencePaper
oai:zenodo.org:1295561
2020-01-20T17:31:16Z
user-elastest
user-eu
Boni García
Luis López
Francisco Gortázar
Micael Gallego
Giuseppe Antonio Carella
2017-10-20
<p>In this paper, we introduce NUBOMEDIA, an open source elastic cloud Platform as a Service (PaaS) specifically designed for real-time interactive multimedia and WebRTC services. NUBOMEDIA exposes its capabilities through simple Application Programming Interfaces (APIs), making possible to deploy and execute developers’ applications. To that aim, NUBOMEDIA combines the simplicity and ease of development of API services with the flexibility of PaaS infrastructures. Once an application is implemented, developers just need to deploy it on top of NUBOMEDIA providing elasticity as a service and reliable communication.</p>
https://doi.org/10.5281/zenodo.1295561
oai:zenodo.org:1295561
Zenodo
https://zenodo.org/communities/elastest
https://zenodo.org/communities/eu
https://doi.org/10.5281/zenodo.1295560
info:eu-repo/semantics/openAccess
Creative Commons Attribution 4.0 International
https://creativecommons.org/licenses/by/4.0/legalcode
WebRTC, Platform as a Service, Application Programming Interface, Open Source.
NUBOMEDIA: The First Open Source WebRTC PaaS
info:eu-repo/semantics/conferencePaper
oai:zenodo.org:1006705
2020-01-20T15:08:24Z
user-elastest
user-eu
Breno Miranda
Antonia Bertolino
2017-09-22
<p>While the relation between code coverage measures and fault detection is actively studied, only few works have investigated the correlation between measures of coverage and of reliability. In this work, we introduce a novel approach to measuring code coverage, called the operational coverage, that takes into account how much the program's entities are exercised so to reflect the profile of usage into the measure of coverage. Operational coverage is proposed as (i) an adequacy criterion, i.e., to assess the thoroughness of a black box test suite derived from the operational profile, and as (ii) a selection criterion, i.e., to select test cases for operational profile-based testing. Our empirical evaluation showed that operational coverage is better correlated than traditional coverage with the probability that the next test case derived according to the user's profile will not fail. This result suggests that our approach could provide a good stopping rule for operational profile-based testing. With respect to test case selection, our investigations revealed that operational coverage outperformed the traditional one in terms of test suite size and fault detection capability when we look at the average results.</p>
https://doi.org/10.1007/s11219-017-9388-0
oai:zenodo.org:1006705
eng
Zenodo
https://doi.org/10.13039/100010661
https://zenodo.org/communities/elastest
https://zenodo.org/communities/eu
info:eu-repo/semantics/openAccess
Creative Commons Attribution 4.0 International
https://creativecommons.org/licenses/by/4.0/legalcode
Software Quality Journal, (2017-09-22)
Coverage testing
Operational coverage
Operational profile-based testing
Program Spectra
Relative coverage
An assessment of operational coverage as both an adequacy and a selection criterion for operational profile based testing
info:eu-repo/semantics/article
oai:zenodo.org:3529316
2020-01-20T16:46:12Z
user-elastest
user-eu
Antonia Bertolino
Guglielmo De Angelis
Francesca Lonetti
2019-11-05
<p>Great advances in network technology and software<br>
engineering have triggered the development and spread of Systems<br>
of Systems (SoSs). The dynamic and evolvable nature of<br>
SoSs poses important challenges on the validation of such systems<br>
and in particular on their regression testing, aiming at assessing<br>
that run-time changes and evolutions do not introduce regression<br>
in SoS behavior. This paper outlines issues and challenges of<br>
regression testing of SoSs, identifying the main kinds of evolution<br>
that can impact on their regression testing activity. Furthermore,<br>
it presents a conceptual framework for governing the regression<br>
testing of SoSs. The proposed framework leverages the concept<br>
of an orchestration graph that describes the flow of test cases and<br>
sketches a solution for deriving a regression test plan according<br>
to test cases dependencies.</p>
https://doi.org/10.1109/ISSREW.2019.00064
oai:zenodo.org:3529316
eng
Zenodo
https://zenodo.org/communities/elastest
https://zenodo.org/communities/eu
info:eu-repo/semantics/openAccess
Creative Commons Attribution 4.0 International
https://creativecommons.org/licenses/by/4.0/legalcode
System of Systems, Regression Testing, Governance, Test Cases Orchestration
Governing Regression Testing in Systems of Systems
info:eu-repo/semantics/conferencePaper
oai:zenodo.org:1295551
2020-01-20T13:36:25Z
user-elastest
user-eu
Boni García
Francisco Gortázar
Micael Gallego
Eduardo Jiménez
2018-01-31
<p>Testing large distributed heterogenous systems in cloud environments is a complex task. This situation<br>
becomes especially difficult when carrying out end-to-end tests, in which the whole system is exercised,<br>
typically through its graphical user interface (GUI) with impersonated users. These tests are typically<br>
expensive to write and time consuming to run. This paper contributes to the solution of this problem by<br>
proposing an open source framework called ElasTest, which can be seen as an elastic platform to carry out<br>
end-to-end testing for different types of applications, including web and mobile. In particular, this piece or<br>
research puts the accent on the capability to impersonate final users, presenting a real case study in which<br>
end-to-end tests have been carried out to assess the correctness of real-time communications among<br>
browsers using WebRTC.</p>
https://doi.org/10.5220/0006752207070714
oai:zenodo.org:1295551
eng
Zenodo
https://zenodo.org/communities/elastest
https://zenodo.org/communities/eu
info:eu-repo/semantics/openAccess
Creative Commons Attribution 4.0 International
https://creativecommons.org/licenses/by/4.0/legalcode
nd-to-End Testing, User Impersonation, Software as a Service, WebRTC
User Impersonation as a Service in End-to-End Testing
info:eu-repo/semantics/conferencePaper