Difference between revisions of "Code Coverage Tool for R"

From R Consortium Wiki
Jump to: navigation, search
 
(2 intermediate revisions by the same user not shown)
Line 3: Line 3:
 
Code coverage helps to ensure greater software quality by reporting how thoroughly test suites cover the various code paths. Having a tool that supports the breadth of the R language across multiple platforms, and that is used by R package developers and R core teams, helps to improve software quality for the R Community. While a few code coverage tools exist for R, this Oracle-proposed ISC project aims to provide an enhanced tool that addresses feature and platform limitations of existing tools via an ISC-established working group. It also aims to promote the use of code coverage more systematically within the R ecosystem.
 
Code coverage helps to ensure greater software quality by reporting how thoroughly test suites cover the various code paths. Having a tool that supports the breadth of the R language across multiple platforms, and that is used by R package developers and R core teams, helps to improve software quality for the R Community. While a few code coverage tools exist for R, this Oracle-proposed ISC project aims to provide an enhanced tool that addresses feature and platform limitations of existing tools via an ISC-established working group. It also aims to promote the use of code coverage more systematically within the R ecosystem.
  
ISC Proposal Document
+
The Code Coverage group released a revised covr package over the summer 2017 ([https://www.r-consortium.org/blog/2017/06/28/code-coverage-tool-for-r-working-group-achieves-first-release]).
  
Meeting Minutes
+
Github project: https://github.com/jimhester/covr/issues
 +
 
 +
=== Working Group Members ===
 +
* Shivank Agrawal, Oracle
 +
* Chris Campbell, Mango Solutions
 +
* Santosh Chaudhari, Oracle
 +
* Karl Forner, Quartz Bio
 +
* Jim Hester, RStudio
 +
* Mark Hornick, Oracle – Group Leader
 +
* Chen Liang, Oracle
 +
* Willem Ligtenberg, Open Analytics
 +
* Vlad Sharanhovich, Oracle
 +
* Tobias Verbeke, Open Analytics
 +
* Qin Wang, Oracle
 +
* Hadley Wickham, RStudio – ISC Sponsor
 +
 
 +
=== Status as of August 10, 2017 ===
 +
* Branch coverage with profile stats – Deferred
 +
* Define canonical performance benchmark suite – Done
 +
* #144 store test results as well as coverage – Deferred
 +
* #134 ICC compatibility – Done
 +
* Make code coverage use more pervasive in R community – in progress
 +
* Correct behavior for parallel code execution – DONE
 +
* Resolve package dependency license issues – DONE
 +
* #174 R6 methods are not covered - DONE
 +
* #117 covr with a local jenkins builder – DONE
 +
* #99 Shiny Source Tab Indicate the Filename – DONE
 +
* Observations testing ORE with covr – DONE
 +
 
 +
=== Meeting History ===
 +
* November 30, 2017
 +
* November 8, 2017
 +
* September 14, 2017
 +
* August 24, 2017
 +
* August 10, 2017
 +
* July 27, 2017
 +
* June 15, 2017
 +
* March 9, 2017
 +
* February 16, 2017
 +
* January 26, 2017
 +
* January 5, 2017
 +
* December 15, 2016
 +
* October 20, 2016
 +
* October 4, 2016
 +
* September, 22, 2016
 +
* September 8, 2016
 +
* August 18, 2016
 +
* July 28, 2016
 +
* July 7, 2016
 +
* June 16, 2016
 +
* June 2, 2016
 +
* May 24, 2016
 +
* May 15, 2016

Latest revision as of 15:46, 12 April 2018

Working Group: Code Coverage Tool for R

Code coverage helps to ensure greater software quality by reporting how thoroughly test suites cover the various code paths. Having a tool that supports the breadth of the R language across multiple platforms, and that is used by R package developers and R core teams, helps to improve software quality for the R Community. While a few code coverage tools exist for R, this Oracle-proposed ISC project aims to provide an enhanced tool that addresses feature and platform limitations of existing tools via an ISC-established working group. It also aims to promote the use of code coverage more systematically within the R ecosystem.

The Code Coverage group released a revised covr package over the summer 2017 ([1]).

Github project: https://github.com/jimhester/covr/issues

Working Group Members

  • Shivank Agrawal, Oracle
  • Chris Campbell, Mango Solutions
  • Santosh Chaudhari, Oracle
  • Karl Forner, Quartz Bio
  • Jim Hester, RStudio
  • Mark Hornick, Oracle – Group Leader
  • Chen Liang, Oracle
  • Willem Ligtenberg, Open Analytics
  • Vlad Sharanhovich, Oracle
  • Tobias Verbeke, Open Analytics
  • Qin Wang, Oracle
  • Hadley Wickham, RStudio – ISC Sponsor

Status as of August 10, 2017

  • Branch coverage with profile stats – Deferred
  • Define canonical performance benchmark suite – Done
  • #144 store test results as well as coverage – Deferred
  • #134 ICC compatibility – Done
  • Make code coverage use more pervasive in R community – in progress
  • Correct behavior for parallel code execution – DONE
  • Resolve package dependency license issues – DONE
  • #174 R6 methods are not covered - DONE
  • #117 covr with a local jenkins builder – DONE
  • #99 Shiny Source Tab Indicate the Filename – DONE
  • Observations testing ORE with covr – DONE

Meeting History

  • November 30, 2017
  • November 8, 2017
  • September 14, 2017
  • August 24, 2017
  • August 10, 2017
  • July 27, 2017
  • June 15, 2017
  • March 9, 2017
  • February 16, 2017
  • January 26, 2017
  • January 5, 2017
  • December 15, 2016
  • October 20, 2016
  • October 4, 2016
  • September, 22, 2016
  • September 8, 2016
  • August 18, 2016
  • July 28, 2016
  • July 7, 2016
  • June 16, 2016
  • June 2, 2016
  • May 24, 2016
  • May 15, 2016