Difference between revisions of "Review:RTE"

From Pel
Jump to navigation Jump to search
 
(19 intermediate revisions by the same user not shown)
Line 1: Line 1:
 
<accesscontrol>reviewer,pel</accesscontrol>
 
<accesscontrol>reviewer,pel</accesscontrol>
  
== Robust Testing Environments (RTE) ==
+
= Robust Testing Environments (RTE) =
  
 
Currently much time is spent in setting up system tests, trying to understand exactly what is being tested, understanding errors that occur during tests and verifying the test results. These issues can be especially difficult for distributed enterprise applications made up of a large number of software components that run on a collection of heterogeneous servers or in cloud environments. Load generation for accurate simulation of complex user behaviour is a growing challenge when testing large-scale critical systems. For example, with more and more applications moving to cloud-based infrastructures, typical load generation designed for applications residing on a local area network may be ineffective for robust testing. Research is required to develop new load generation techniques that take into consideration new cloud-based infrastructures where applications may be physically distributed across different infrastructures in different geographical locations and where network bandwidth may be unknown or at different quality levels at various points. This research will develop a set of prototype tools to allow for the more efficient system testing of large enterprise applications.  
 
Currently much time is spent in setting up system tests, trying to understand exactly what is being tested, understanding errors that occur during tests and verifying the test results. These issues can be especially difficult for distributed enterprise applications made up of a large number of software components that run on a collection of heterogeneous servers or in cloud environments. Load generation for accurate simulation of complex user behaviour is a growing challenge when testing large-scale critical systems. For example, with more and more applications moving to cloud-based infrastructures, typical load generation designed for applications residing on a local area network may be ineffective for robust testing. Research is required to develop new load generation techniques that take into consideration new cloud-based infrastructures where applications may be physically distributed across different infrastructures in different geographical locations and where network bandwidth may be unknown or at different quality levels at various points. This research will develop a set of prototype tools to allow for the more efficient system testing of large enterprise applications.  
  
=== People involved ===
+
= People involved =
  
* Sandra Theodora Buda - PhD Student, UCD
 
 
* Vanessa Ayala - PhD Student, UCD
 
* Vanessa Ayala - PhD Student, UCD
 +
* Sandra Teodora Buda - PhD Student, UCD
 
* Se&aacute;n &Oacute; R&iacute;­ord&aacute;in - PhD Student, TCD
 
* Se&aacute;n &Oacute; R&iacute;­ord&aacute;in - PhD Student, TCD
 
* Thomas Cerqueus - Postdoc researcher, UCD
 
* Thomas Cerqueus - Postdoc researcher, UCD
 
* Patrick McDonagh - Postdoc researcher, DCU
 
* Patrick McDonagh - Postdoc researcher, DCU
 +
* Philip Perry - Postdoc researcher, UCD
 +
* Christina Thorpe - Postdoc researcher, UCD
 
* Anthony Ventresque - Postdoc researcher, UCD
 
* Anthony Ventresque - Postdoc researcher, UCD
* Christina Thorpe - Postdoc researcher, UCD
 
* Philip Perry - Postdoc researcher, UCD
 
* Simon Wilson - Professor, TCD
 
 
* John Murphy - Professor, UCD
 
* John Murphy - Professor, UCD
 
* Liam Murphy - Professor, UCD
 
* Liam Murphy - Professor, UCD
 +
* Simon Wilson - Professor, TCD
  
=== Collaborations ===  
+
= Collaborations =  
  
* IBM Dublin  
+
* Morten Kristiansen - IBM Dublin
* Eduardo Cunha de Almeida - PhD, Federal University of Paran&aacute; (Brazil)
+
* Eduardo Cunha de Almeida - Assistant Professor, Federal University of Paran&aacute; (Brazil)
* Gerson Suny&eacute; - PhD, University of Nantes (France)
+
* Gerson Suny&eacute; - Associate Professor, University of Nantes (France)
 
* Yves Le Traon, Professor, University of Luxembourg (Luxembourg)
 
* Yves Le Traon, Professor, University of Luxembourg (Luxembourg)
  
=== smthg ===
+
= Statement of work =
 +
 
 +
The following table presents the deliverables for the project.
  
 
{| border="1"
 
{| border="1"
 +
|- style="text-align: center;"
 +
! Quarter !! Deliverables !! Status
 
|-
 
|-
! &nbsp;Quarter&nbsp; !! &nbsp;Deliverables&nbsp; !! &nbsp;Status&nbsp;
+
| Q1 2013 || Survey of anonymization techniques based on k-anonymity for microdata || [[Media:RTE_D4.pdf|Done]]
|-
 
| Q2 2012  || Survey of data mining algorithms.  || &nbsp;Deliv.&nbsp;
 
|-
 
| 201 || Survey of anonymization techniques based on k-anonymity for microdata Sep-12 180 || &nbsp;Deliv.&nbsp;
 
 
|-
 
|-
| 201 || High-level architecture design of a privacy-preserving data publishing assisting tool <br/> Survey of data mining algorithms Mar-13 250 || &nbsp;Deliv.&nbsp;
+
| Q3 2013 || High-level architecture design of a privacy-preserving data publishing assisting tool <br/> Survey of data mining algorithms || In process
 
|-
 
|-
| 201 || Initial algorithm to automatically extract relationships between schemas in the DB <br/> Survey of algorithms for database sampling Jan-12 230 || &nbsp;Deliv.&nbsp;
+
| Q3 2012 || Initial algorithm to automatically extract relationships between schemas in the DB || [[Media:RTE_D1.pdf|Done]]
 +
|-
 +
| Q3 2012 || Survey of algorithms for database sampling || [[Media:RTE_D3.pdf|Done]]
 
|-
 
|-
| 201 || Design and specification of an algorithm for database sampling (table-level) Oct-12 150 || &nbsp;Deliv.&nbsp;
+
| Q1 2013 || Design and specification of an algorithm for database sampling (table-level) || [[Media:RTE_D2.pdf|Done]]
 
|-
 
|-
| 201 || Evaluation of scalability and performance of the DB sampling algorithm || &nbsp;Deliv.&nbsp;
+
| Q4 2013 || Evaluation of scalability and performance of the DB sampling algorithm || In process
 
|-
 
|-
| 201 || Evaluation of the DB sampling algorithm on real test case May-13 210 || &nbsp;Deliv.&nbsp;
+
| Q2 2014 || Evaluation of the DB sampling algorithm on real test case ||  
 
|-
 
|-
| 201 || Design and specification of an algorithm for database sampling (attribute-level)<br/>Survey of algorithms for database extrapolation Dec-13 160 || &nbsp;Deliv.&nbsp;
+
| Q3 2014 || Design and specification of an algorithm for database sampling (attribute-level)<br/>Survey of algorithms for database extrapolation ||  
 
|-
 
|-
| 201 || Design and specification of an algorithm for database extrapolation <br/> Survey of stress testing techniques May-14 150 || &nbsp;Deliv.&nbsp;
+
| Q3 2014 || Design and specification of an algorithm for database extrapolation <br/> Survey of stress testing techniques ||  
 
|-
 
|-
| 201 || Design of a stress testing methodology for Cloud applications <br/> Survey of self-tuning/automatic testing techniques Sep-13 400 || &nbsp;Deliv.&nbsp;
+
| Q3 2014 || Design of a stress testing methodology for Cloud applications <br/> Survey of self-tuning/automatic testing techniques ||  
 
|-
 
|-
| 201 || Design of a self-tuning methodology for Cloud applications Sep-13 400 || &nbsp;Deliv.&nbsp;
+
| Q3 2014 || Design of a self-tuning methodology for Cloud applications ||
 
|-
 
|-
| 201 || Review and implementation of previous approach <br/> An analysis of Firefox bug report data Jan-12 410 || &nbsp;Deliv.&nbsp;
+
| Q1 2013 || Review and implementation of previous approach <br/> An analysis of Firefox bug report data || [[Media:RTE_D5.pdf|Done]]
 
|-
 
|-
| 201 || Survey of the literature on statistical reliability in large scale software systems Mar-13 270 || &nbsp;Deliv.&nbsp;
+
| Q4 2013 || Survey of the literature on statistical reliability in large scale software systems || In process
 
|-
 
|-
| 201 || Questionnaire: Testing the Cloud Jul-12 90 || &nbsp;Deliv.&nbsp;
+
| Q3 2012 || Questionnaire: Testing the Cloud || [[Media:RTE_D6.pdf|Done]]
 
|-
 
|-
| 201 || Organisation of TTC workshop (ISSTA 2013) Oct-12 300 || &nbsp;Deliv.&nbsp;
+
| Q3 2013 || Organisation of the Testing The Cloud workshop (ISSTA 2013) || [http://ttc2013.ucd.ie Done]
 
|}
 
|}

Latest revision as of 22:15, 7 June 2013

<accesscontrol>reviewer,pel</accesscontrol>

Robust Testing Environments (RTE)

Currently much time is spent in setting up system tests, trying to understand exactly what is being tested, understanding errors that occur during tests and verifying the test results. These issues can be especially difficult for distributed enterprise applications made up of a large number of software components that run on a collection of heterogeneous servers or in cloud environments. Load generation for accurate simulation of complex user behaviour is a growing challenge when testing large-scale critical systems. For example, with more and more applications moving to cloud-based infrastructures, typical load generation designed for applications residing on a local area network may be ineffective for robust testing. Research is required to develop new load generation techniques that take into consideration new cloud-based infrastructures where applications may be physically distributed across different infrastructures in different geographical locations and where network bandwidth may be unknown or at different quality levels at various points. This research will develop a set of prototype tools to allow for the more efficient system testing of large enterprise applications.

People involved

  • Vanessa Ayala - PhD Student, UCD
  • Sandra Teodora Buda - PhD Student, UCD
  • Seán Ó Rí­ordáin - PhD Student, TCD
  • Thomas Cerqueus - Postdoc researcher, UCD
  • Patrick McDonagh - Postdoc researcher, DCU
  • Philip Perry - Postdoc researcher, UCD
  • Christina Thorpe - Postdoc researcher, UCD
  • Anthony Ventresque - Postdoc researcher, UCD
  • John Murphy - Professor, UCD
  • Liam Murphy - Professor, UCD
  • Simon Wilson - Professor, TCD

Collaborations

  • Morten Kristiansen - IBM Dublin
  • Eduardo Cunha de Almeida - Assistant Professor, Federal University of Paraná (Brazil)
  • Gerson Sunyé - Associate Professor, University of Nantes (France)
  • Yves Le Traon, Professor, University of Luxembourg (Luxembourg)

Statement of work

The following table presents the deliverables for the project.

Quarter Deliverables Status
Q1 2013 Survey of anonymization techniques based on k-anonymity for microdata Done
Q3 2013 High-level architecture design of a privacy-preserving data publishing assisting tool
Survey of data mining algorithms
In process
Q3 2012 Initial algorithm to automatically extract relationships between schemas in the DB Done
Q3 2012 Survey of algorithms for database sampling Done
Q1 2013 Design and specification of an algorithm for database sampling (table-level) Done
Q4 2013 Evaluation of scalability and performance of the DB sampling algorithm In process
Q2 2014 Evaluation of the DB sampling algorithm on real test case
Q3 2014 Design and specification of an algorithm for database sampling (attribute-level)
Survey of algorithms for database extrapolation
Q3 2014 Design and specification of an algorithm for database extrapolation
Survey of stress testing techniques
Q3 2014 Design of a stress testing methodology for Cloud applications
Survey of self-tuning/automatic testing techniques
Q3 2014 Design of a self-tuning methodology for Cloud applications
Q1 2013 Review and implementation of previous approach
An analysis of Firefox bug report data
Done
Q4 2013 Survey of the literature on statistical reliability in large scale software systems In process
Q3 2012 Questionnaire: Testing the Cloud Done
Q3 2013 Organisation of the Testing The Cloud workshop (ISSTA 2013) Done