Difference between revisions of "Code Coverage Tool for R"

From R Consortium Wiki
Jump to: navigation, search
 
Line 2: Line 2:
  
 
Code coverage helps to ensure greater software quality by reporting how thoroughly test suites cover the various code paths. Having a tool that supports the breadth of the R language across multiple platforms, and that is used by R package developers and R core teams, helps to improve software quality for the R Community. While a few code coverage tools exist for R, this Oracle-proposed ISC project aims to provide an enhanced tool that addresses feature and platform limitations of existing tools via an ISC-established working group. It also aims to promote the use of code coverage more systematically within the R ecosystem.
 
Code coverage helps to ensure greater software quality by reporting how thoroughly test suites cover the various code paths. Having a tool that supports the breadth of the R language across multiple platforms, and that is used by R package developers and R core teams, helps to improve software quality for the R Community. While a few code coverage tools exist for R, this Oracle-proposed ISC project aims to provide an enhanced tool that addresses feature and platform limitations of existing tools via an ISC-established working group. It also aims to promote the use of code coverage more systematically within the R ecosystem.
 +
 +
The Code Coverage group released a revised covr package over the summer 2017 ([https://www.r-consortium.org/blog/2017/06/28/code-coverage-tool-for-r-working-group-achieves-first-release]).
  
 
Github project: https://github.com/jimhester/covr/issues
 
Github project: https://github.com/jimhester/covr/issues
Line 14: Line 16:
 
* Chen Liang, Oracle
 
* Chen Liang, Oracle
 
* Willem Ligtenberg, Open Analytics
 
* Willem Ligtenberg, Open Analytics
* Andy Nicholls, Mango Solutions
 
 
* Vlad Sharanhovich, Oracle
 
* Vlad Sharanhovich, Oracle
 
* Tobias Verbeke, Open Analytics
 
* Tobias Verbeke, Open Analytics
Line 20: Line 21:
 
* Hadley Wickham, RStudio – ISC Sponsor
 
* Hadley Wickham, RStudio – ISC Sponsor
  
=== Status as of October 4, 2016 ===
+
=== Status as of August 10, 2017 ===
* Branch coverage with profile stats – in progress
+
* Branch coverage with profile stats – Deferred
* Define canonical performance benchmark suite – in progress
+
* Define canonical performance benchmark suite – Done
* #144 store test results as well as coverage – in progress
+
* #144 store test results as well as coverage – Deferred
* #134 ICC compatibility – TESTS COMPLETE
+
* #134 ICC compatibility – Done
 
* Make code coverage use more pervasive in R community – in progress
 
* Make code coverage use more pervasive in R community – in progress
 
* Correct behavior for parallel code execution – DONE
 
* Correct behavior for parallel code execution – DONE
Line 34: Line 35:
  
 
=== Meeting History ===
 
=== Meeting History ===
 +
* November 30, 2017
 +
* November 8, 2017
 +
* September 14, 2017
 +
* August 24, 2017
 +
* August 10, 2017
 +
* July 27, 2017
 +
* June 15, 2017
 +
* March 9, 2017
 +
* February 16, 2017
 +
* January 26, 2017
 +
* January 5, 2017
 +
* December 15, 2016
 +
* October 20, 2016
 
* October 4, 2016
 
* October 4, 2016
 
* September, 22, 2016
 
* September, 22, 2016

Latest revision as of 15:46, 12 April 2018

Working Group: Code Coverage Tool for R

Code coverage helps to ensure greater software quality by reporting how thoroughly test suites cover the various code paths. Having a tool that supports the breadth of the R language across multiple platforms, and that is used by R package developers and R core teams, helps to improve software quality for the R Community. While a few code coverage tools exist for R, this Oracle-proposed ISC project aims to provide an enhanced tool that addresses feature and platform limitations of existing tools via an ISC-established working group. It also aims to promote the use of code coverage more systematically within the R ecosystem.

The Code Coverage group released a revised covr package over the summer 2017 ([1]).

Github project: https://github.com/jimhester/covr/issues

Working Group Members

  • Shivank Agrawal, Oracle
  • Chris Campbell, Mango Solutions
  • Santosh Chaudhari, Oracle
  • Karl Forner, Quartz Bio
  • Jim Hester, RStudio
  • Mark Hornick, Oracle – Group Leader
  • Chen Liang, Oracle
  • Willem Ligtenberg, Open Analytics
  • Vlad Sharanhovich, Oracle
  • Tobias Verbeke, Open Analytics
  • Qin Wang, Oracle
  • Hadley Wickham, RStudio – ISC Sponsor

Status as of August 10, 2017

  • Branch coverage with profile stats – Deferred
  • Define canonical performance benchmark suite – Done
  • #144 store test results as well as coverage – Deferred
  • #134 ICC compatibility – Done
  • Make code coverage use more pervasive in R community – in progress
  • Correct behavior for parallel code execution – DONE
  • Resolve package dependency license issues – DONE
  • #174 R6 methods are not covered - DONE
  • #117 covr with a local jenkins builder – DONE
  • #99 Shiny Source Tab Indicate the Filename – DONE
  • Observations testing ORE with covr – DONE

Meeting History

  • November 30, 2017
  • November 8, 2017
  • September 14, 2017
  • August 24, 2017
  • August 10, 2017
  • July 27, 2017
  • June 15, 2017
  • March 9, 2017
  • February 16, 2017
  • January 26, 2017
  • January 5, 2017
  • December 15, 2016
  • October 20, 2016
  • October 4, 2016
  • September, 22, 2016
  • September 8, 2016
  • August 18, 2016
  • July 28, 2016
  • July 7, 2016
  • June 16, 2016
  • June 2, 2016
  • May 24, 2016
  • May 15, 2016