ID,index,Title,Ref_Year,Ref_RQ3Results,Ref_RQ4,Ref_RQ6,SpecificMetrics,PeformanceMetrics,StatusCode,Schema_based_coverage,Derived_dependencies,model_based_coverage,Code_coverage,Fault500,Fault_inconsist_schema,OtherFaults,Security,SearchbasedTec,ModelbasedTec,PropertybasedTec,FormalVerficationTec,OnlyTestInputs,ig_random,ig_specified-or-example,ig_response-based,ig_dynamic,ig_mutation,oracle_status_code,oracle_response,oracle_others,handle-structure,handle-sut-state,employ-name-matching,Auth-support,Fuzzer,Schema
P_01,1,Automated black-box testing of nominal and error scenarios in RESTful APIs,2022,NA: New automated approach and its extension,Black Box,"robustness,system",,N,Y,N,N,Y,N,Y,Y,N,N,N,N,N,N,N,Y,Y,Y,Y,Y,Y,Y,,Y,N,Y,Y,RESTTestGen,
P_02,2,Automated Specification-Based Testing of REST APIs,2021,NA: New automated approach and its extension,Black Box,system,,Y,Y,Y,N,N,N,Y,N,N,N,N,N,N,N,N,Y,Y,N,N,N,Y,Y,,N,N,N,N,Other,
P_03,3,Resource and dependency based test case generation for RESTful Web services,2021,NA: New automated approach and its extension,White Box,system,,N,Y,N,Y,N,Y,Y,Y,N,N,Y,N,N,N,N,Y,N,N,Y,Y,Y,Y,,Y,N,Y,Y,EvoMaster,
P_04,4,A Discrete Dynamic Artificial Bee Colony with Hyper-Scout for RESTful web service API test suite generation,2021,NA: New automated approach and its extension,White Box,system,,N,Y,N,N,N,Y,Y,N,N,N,Y,N,N,N,N,Y,N,N,Y,Y,Y,Y,,Y,N,N,N,EvoMaster-NAL,
P_05,5,A Black Box Tool for Robustness Testing of REST Services,2021,NA: New automated approach and its extension,Black Box,"robustness,system",,N,Y,N,N,N,N,Y,Y,Y,Y,N,N,N,N,N,Y,Y,Y,Y,Y,Y,Y,,N,N,N,Y,bBOXRT,
P_06,6,Automated Black- and White-Box Testing of RESTful APIs With EvoMaster,2021,NA: New automated approach and its extension,Both,system,,N,Y,N,N,N,N,Y,Y,N,N,Y,N,N,N,N,Y,N,N,N,Y,Y,Y,,Y,N,N,N,EvoMaster,
P_07,7,Black-Box and White-Box Test Case Generation for RESTful APIs: Enemies or Allies?,2021,NA: New automated approach and its extension,Hybrid,system,,N,Y,Y,N,N,Y,Y,Y,N,N,Y,N,N,N,N,Y,Y,Y,N,Y,Y,Y,,Y,N,N,N,RESTest-EvoMaster,
P_08,8,Deep Learning-Based Prediction of Test Input Validity for RESTful APIs,2021,NA: New automated approach and its extension,Black Box,system,,N,N,N,Y,N,N,N,N,N,N,N,N,N,N,Y,N,N,N,N,N,N,N,,N,N,N,N,RESTest,
P_09,9,Empirical Comparison of Black-box Test Case Generation Tools for RESTful APIs,2021,EA: Empirical study on various automated approaches,Black Box,system,,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P_10,10,Improving Test Case Generation for REST APIs Through Hierarchical Clustering,2021,NA: New automated approach and its extension,White Box,system,,N,Y,N,N,N,Y,Y,Y,N,N,Y,N,N,N,N,Y,N,N,Y,Y,Y,Y,,Y,N,Y,Y,EvoMaster-NAL,
P_11,11,RESTest: automated black-box testing of RESTful web APIs,2021,NA: New automated approach and its extension,Black Box,system,,N,Y,Y,Y,Y,N,Y,N,N,N,N,Y,N,N,N,Y,Y,N,Y,Y,Y,Y,,N,N,Y,Y,,
P_12,12,"A simple, lightweight framework for testing RESTful services with TTCN-3",2020,NA: New automated approach and its extension,Black Box,system,,N,Y,N,Y,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P_13,13,AI-Driven Web API Testing,2020,PI: Proposal or idea,Black Box,system,,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P_14,14,Checking Security Properties of Cloud Service REST APIs,2020,NA: New automated approach and its extension,Black Box,security,,N,N,N,N,N,N,N,N,N,Y,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P_15,15,Increasing Reliability of Programming Interfaces Based on Fuzz Testing,2020,NA: New automated approach and its extension,Black Box,system,,N,Y,N,N,N,N,N,N,N,N,N,N,N,N,N,Y,N,Y,N,N,N,N,,N,N,N,Y,,
P_16,16,QuickREST: Property-based Test Generation of OpenAPI-Described RESTful APIs,2020,NA: New automated approach and its extension,Black Box,system,,N,Y,N,N,N,N,Y,N,Y,N,N,N,Y,N,N,Y,Y,Y,Y,N,Y,Y,,N,Y,N,N,,
P_17,17,RESTTESTGEN: Automated Black-Box Testing of RESTful APIs,2020,NA: New automated approach and its extension,Black Box,"robustness,system",,N,Y,N,N,Y,N,Y,Y,N,N,N,N,N,N,N,Y,Y,Y,Y,Y,Y,Y,,Y,N,Y,N,,
P_18,18,Intelligent REST API data fuzzing,2020,NA: New automated approach and its extension,Black Box,system,,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P_19,19,Semantic-oriented Automatic Generation Method of REST Interface Test Cases,2020,NA: New automated approach and its extension,Black Box,system,,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,Y,N,N,N,,N,N,N,N,,
P_20,20,Model-Driven Integration Testing of Hypermedia Systems,2019,NA: New automated approach and its extension,Black Box,"integration,system",,N,N,N,N,Y,N,N,N,Y,N,N,Y,N,N,N,N,N,N,Y,N,N,N,,N,N,N,Y,,
P_21,21,RESTler: Stateful REST API Fuzzing,2019,NA: New automated approach and its extension,Black Box,system,,N,Y,N,N,N,N,Y,N,N,N,N,N,N,N,N,Y,Y,Y,Y,N,Y,N,,N,N,N,N,Restler,
P_22,22,Generating Mock Skeletons for Lightweight Web-Service Testing,2019,NP: New analysis approach and potential solution,Black Box,system,,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P_23,23,RESTful API Automated Test Case Generation with EvoMaster,2019,NA: New automated approach and its extension,White Box,system,,N,Y,N,N,N,Y,Y,N,N,N,Y,N,N,N,N,Y,N,N,Y,Y,Y,Y,,Y,Y,N,Y,EvoMaster,
P_24,24,Test coverage criteria for RESTful web APIs,2019,NP: New analysis approach and potential solution,Black Box,system,,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P_25,25,Resource-based test case generation for RESTful web services,2019,NA: New automated approach and its extension,White Box,system,,N,Y,N,N,N,Y,Y,N,N,N,Y,N,N,N,N,Y,N,N,Y,Y,Y,Y,,Y,Y,Y,Y,EvoMaster,
P_27,26,Automatic Generation of Test Cases for REST APIs: A Specification-Based Approach,2018,NA: New automated approach and its extension,Black Box,system,,N,N,Y,N,N,N,Y,Y,N,N,N,Y,N,N,N,Y,Y,N,N,N,Y,Y,,N,N,N,Y,Unspecified,
P_28,27,Metamorphic testing of RESTful web APIs,2018,NA: New automated approach and its extension,Black Box,system,,N,N,N,N,N,N,N,N,Y,N,N,N,Y,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P_29,28,Quantitative security assurance metrics: REST API case studies,2018,NP: New analysis approach and potential solution,Black Box,security,,N,N,N,N,N,N,N,N,N,Y,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P_30,29,Model-driven Testing of RESTful APIs,2015,NA: New automated approach and its extension,Black Box,system,,Y,N,N,N,N,N,N,N,N,Y,N,Y,N,Y,N,N,N,N,N,N,N,N,,N,N,N,Y,,
P_31,30,Towards property-based testing of RESTful web services,2013,NA: New automated approach and its extension,Black Box,system,,N,N,N,N,Y,N,N,N,N,N,N,Y,Y,N,N,Y,Y,N,N,N,N,N,,N,N,N,N,,
P_32,31,Connectedness testing of RESTful web-services,2010,NA: New automated approach and its extension,Black Box,system,POST Class Graph (PCG),N,N,N,Y,N,N,N,N,N,N,N,N,Y,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P_33,32,Test-the-REST: An Approach to Testing RESTful Web-Services,2009,NP: New analysis approach and potential solution,Black Box,system,,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P_34,33,Restats: A Test Coverage Tool for RESTful APIs,2021,TD: Tool implementation or demostration,Black Box,system,,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P_35,34,Applying Change Impact Analysis Test to Migration Test Case Extraction Based on IDAU and Graph Analysis Techniques,2019,NA: New automated approach and its extension,White Box,"unit,system",,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P_37,35,Study on REST API Test Model Supporting Web Service Integration,2017,TD: Tool implementation or demostration,Hybrid,integration,,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P_42,36,Differential regression testing for REST APIs,2020,NA: New automated approach and its extension,Black Box,regression,,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P_53,37,Static analysis for web service security - Tools & techniques for a secure development life cycle,2015,NP: New analysis approach and potential solution,Static Analysis,security,,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P_54,38,Adaptive Hypermutation for Search-Based System Test Generation: A Study on REST APIs with EvoMaster,2021,NA: New automated approach and its extension,White Box,system,,N,Y,N,N,N,Y,Y,Y,N,N,Y,N,N,N,N,Y,N,N,Y,Y,Y,Y,,Y,Y,N,Y,EvoMaster,
P_55,39,Handling SQL Databases in Automated System Test Generation,2020,NA: New automated approach and its extension,White Box,system,,N,Y,N,N,N,Y,Y,Y,N,N,Y,N,N,N,N,Y,N,N,Y,Y,Y,Y,,Y,Y,N,Y,EvoMaster,
P02-r5,40,Open Problems in Fuzzing RESTful APIs: A Comparison of Tools,2022,EA: Empirical study on various automated approaches,Both,system,,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P03-Pinheiro,41,ARTE: Automated Generation of Realistic Test Inputs for Web APIs,2022,NA: New automated approach and its extension,Black Box,system,Valid inputs,N,Y,Y,N,N,N,Y,N,Y,N,N,N,N,N,Y,N,N,N,N,N,N,N,,N,N,N,N,ResTest,
P13-r16,42,An OpenAPI-based Testing Framework to Monitor Non-Functional Properties of REST APIs,2020,NA: New automated approach and its extension,Black Box,system,,Y,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P01-c1,43,Combinatorial Testing of RESTful APIs,2022,NA: New automated approach and its extension,Black Box,system,,N,Y,N,Y,N,N,Y,N,N,N,N,N,N,N,N,Y,Y,Y,Y,N,N,N,,Y,N,N,N,RestCT,
P02-c1,44,Automated Test Generation for REST APIs: No Time to Rest Yet,2022,EA: Empirical study on various automated approaches,Both,system,,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P03-c1,45,Enhancing Resource-Based Test Case Generation for RESTful APIs with SQL Handling,2021,NA: New automated approach and its extension,White Box,system,,N,Y,N,N,N,Y,Y,Y,N,N,Y,N,N,N,N,Y,N,N,Y,Y,Y,Y,,Y,N,N,Y,EvoMaster,
P03-c2,46,Model-based testing of restful web services using uml protocol state machines,2013,NA: New automated approach and its extension,Black Box,system,state and transition coverage,N,N,N,N,N,N,N,N,N,N,N,Y,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P05-c1,48,foREST: A Tree-based Approach for Fuzzing RESTful APIs,2022,NA: New automated approach and its extension,Black Box,system,,N,N,N,N,N,Y,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P05-c2,49,Automatic Detection of Access Control Vulnerabilities via API Specification Processing,2022,NA: New automated approach and its extension,Black Box,security,,N,N,N,N,N,N,N,N,N,Y,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P05-c3,50,Enhancing Search-based Testing with Testability Transformations for Existing APIs,2021,NA: New automated approach and its extension,White Box,system,,N,Y,N,N,N,Y,Y,Y,N,N,Y,N,N,N,N,Y,N,N,Y,Y,Y,Y,,Y,N,N,T,EvoMaster,
P06-c1,51,On the Faults Found in REST APIs by Automated Test Generation,2022,EI: Empirical study of REST APIs,,system,,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P06-c2,52,REST API Fuzzing by Coverage Level Guided Blackbox Testing,2021,NA: New automated approach and its extension,Black Box,system,,N,N,Y,N,N,Y,Y,N,N,N,N,N,N,N,N,N,Y,Y,Y,Y,N,N,,Y,N,N,N,,
P06-c3,53,ICSE: G: Automated Management of Inter-Parameter Dependencies in Web APIs,2021,NP: New analysis approach and potential solution,Black Box,system,,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,ResTest,
P08-c1,54,More Effective Test Case Generation with Multiple Tribes of AI,2022,NA: New automated approach and its extension,Black Box,system,,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P10-c1,55,Deriving Semantics-Aware Fuzzers from Web API Schemas,2021,NA: New automated approach and its extension,Black Box,system,,Y,Y,N,N,N,N,Y,N,N,Y,N,N,Y,N,N,Y,N,N,N,N,Y,Y,,Y,N,N,Y,Schemathesis,
P11-c1,56,Specification and automated analysis of inter-parameter dependencies in web APIs,2021,NP: New analysis approach and potential solution,Black Box,system,,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P12-c1,57,Quality Assurance of Micro-Services - When to trust your micro-service test results?,2021,NP: New analysis approach and potential solution,Black Box,integration,,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P13-c1,58,Solving the Instance Identification Problem in Micro-service Testing,2022,NP: New analysis approach and potential solution,Black Box,integration,,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P16-c2,60,Jsongen: a QuickCheck Based Library for Testing JSON Web Services,2014,NA: New automated approach and its extension,Black Box,system,a generic state machine,N,Y,N,Y,N,N,N,N,N,N,N,N,Y,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P17-c1,61,Analyzing OpenAPI Specifications for Security Design Issues,2021,NA: New automated approach and its extension,Black Box,security,"sensitivity level, exposure level",N,N,N,N,N,N,N,N,N,Y,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P11-r19,62,Efficient penetration of API sequences to test stateful RESTful services,2021,NA: New automated approach and its extension,Black Box,system,,N,N,Y,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,,Y,N,N,N,,
P64,63,Morest: Model-based RESTful API Testing with Execution Feedback,2022,NA: New automated approach and its extension,Black Box,system,RESTful-service Property Graph (RPG),N,Y,Y,Y,N,Y,Y,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,Morest,
P65,64,Pythia: Grammar-based fuzzing of REST APIs with coverage-guided feedback and learning-based mutations,2020,NA: New automated approach and its extension,White Box,system,,N,Y,N,N,N,Y,Y,N,N,N,N,N,N,N,N,Y,Y,Y,Y,Y,Y,N,,N,N,N,N,Restler,
P66,65,Bootstrapping Automated Testing for RESTful Web Services,2022,NP: New analysis approach and potential solution,Black Box,system,,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P67,66,Exploiting Input Sanitization for Regex Denial of Service,2022,NA: New automated approach and its extension,Black Box,system,,Y,N,N,N,N,N,Y,N,Y,Y,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P68,67,Call Sequence List Distiller for Practical Stateful API Testing.,2020,NP: New analysis approach and potential solution,Black Box,system,,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P69,68,Hazard Integrated: Understanding Security Risks in App Extensions to Team Chat Systems,2022,NA: New automated approach and its extension,Black Box,security,CSSP scenarios ,N,N,N,N,N,N,N,N,N,Y,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P70,69,A Framework for Automated API Fuzzing at Enterprise Scale,2022,NA: New automated approach and its extension,Black Box,system,,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P71,70,Testability transformations for existing APIs,2020,NA: New automated approach and its extension,White Box,system,,N,Y,N,N,N,Y,Y,Y,N,N,Y,N,N,N,N,Y,N,N,Y,Y,Y,N,,Y,Y,N,Y,EvoMaster,
P72,71,SQL data generation to enhance search-based system testing,2019,NA: New automated approach and its extension,White Box,system,,N,Y,N,N,N,Y,Y,Y,N,N,Y,N,N,N,N,Y,N,N,Y,Y,Y,N,,Y,Y,N,Y,EvoMaster,
P73,72,Exploratory test agents for stateful software systems,2019,PI: Proposal or idea,Black Box,system,,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P74,73,EvoMaster: A search-based system test generation tool,2021,TD: Tool implementation or demostration,Both,system,,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,EvoMaster,
P75,74,REST API composition for effectively testing the Cloud,2022,TD: Tool implementation or demostration,Black Box,system,,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P76,75,Design and Implementation of a Test Tool for PSD2 Compliant Interfaces,2021,TD: Tool implementation or demostration,Black Box,security,,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P77,76,MockRest—A Generic Approach for Automated Mock Framework for REST APIs Generation,2020,NP: New analysis approach and potential solution,Black Box,unit,,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P78,77,Development of Vulnerable Web Application Based on OWASP API Security Risks,2021,PI: Proposal or idea,None,security,,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P79,78,Software Tool to Perform Metamorphic Testing on RESTful Web APIs,2022,NA: New automated approach and its extension,Black Box,system,,N,N,N,N,N,N,N,N,N,N,N,N,Y,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P80,79,CPN Model Based Standard Feature Verification Method for REST Service Architecture,2018,NA: New automated approach and its extension,Black Box,architecture,rest-feature-constraints-models,N,N,N,N,N,N,N,N,N,N,N,Y,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P81,80,Automation of Integration Testing of RESTful Hypermedia Systems: A Model-driven Approach,2018,NA: New automated approach and its extension,Black Box,integration,,N,N,N,N,N,N,N,N,N,N,N,Y,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P82,81,RESTful API automated test case generation,2017,NA: New automated approach and its extension,White Box,system,,N,Y,Y,N,N,Y,Y,N,N,N,Y,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,EvoMaster,
P83,82,Unit and integration testing of modular cloud services,2017,TD: Tool implementation or demostration,Both,"unit,integration",,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P84,83,Tool Demonstration: Testing JSON Web Services Using JSONGEN,2018,TD: Tool implementation or demostration,Black Box,system,,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P85,84,Towards automated testing of web service choreographies,2011,PI: Proposal or idea,Black Box,"unit,integration,acceptance",,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P86,85,Optimized Test Data Generation for RESTful Web Service,2017,NA: New automated approach and its extension,Black Box,system,,N,N,N,N,N,N,N,N,N,N,Y,N,N,N,Y,N,N,N,N,N,N,N,,N,N,N,N,,WADL
P87,86,REST service testing based on inferred XML schemas,2014,NA: New automated approach and its extension,Black Box,system,,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,"XML, XSD"
P88,87,Predictive Simulation for Building Trust Within Service-Based Ecosystems,2022,NP: New analysis approach and potential solution,Black Box,,,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,,N,N,N,N,,
P89,88,ExVivoMicroTest: ExVivo Testing of Microservices,2022,NA: New automated approach and its extension,Black Box,regression,recorded-scenarios,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,N,Y,,N,Y,N,N,ExVivoMicroTest,
,90,Verification of microservices using metamorphic testing,2019,NA: New automated approach and its extension,Black Box,system,MRs,N,,,N,,,,,,,,,Y,,,,,,,,,,,,,,,,
,91,Testing cloud services using the TestCast tool,2018,NP: New analysis approach and potential solution,Both,"unit,integration",,,,,,,,,,,,,,,,,,,,,,,,,,,,,,
,92,RESTest: Black-Box Constraint-Based Testing of RESTful Web APIs,2020,NA: New automated approach and its extension,Black Box,system,inter-parameter dependencies,,Y,N,,,,Y,,,,,,,,,,,,,,,,,,,,,ResTest,
,94,Verification of Hypermedia Characteristic of RESTful Finite-State Machines,2018,NP: New analysis approach and potential solution,Black Box,system,,,,,,Y,,,,,,,Y,Y,,,,,,,,,,,,,,,,
,96,Metamorphic Security Testing for Web Systems,2020,NA: New automated approach and its extension,Black Box,security,MRs,,,,,,,,,,Y,,,Y,,,,,,,,,,,,,,,,
,97,A catalogue of inter-parameter dependencies in RESTful web APIs,2019,NP: New analysis approach and potential solution,Black Box,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,
,98,JavaScript Instrumentation for Search-Based Software Testing: A Study with RESTful APIs,2022,NA: New automated approach and its extension,White Box,system,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,