Difference between revisions of "Code Coverage Tool for R"

From R Consortium Wiki
Jump to: navigation, search
(Created page with "'''Working Group: Code Coverage Tool for R''' Code coverage helps to ensure greater software quality by reporting how thoroughly test suites cover the various code paths. Hav...")
 
 
(4 intermediate revisions by the same user not shown)
Line 2: Line 2:
  
 
Code coverage helps to ensure greater software quality by reporting how thoroughly test suites cover the various code paths. Having a tool that supports the breadth of the R language across multiple platforms, and that is used by R package developers and R core teams, helps to improve software quality for the R Community. While a few code coverage tools exist for R, this Oracle-proposed ISC project aims to provide an enhanced tool that addresses feature and platform limitations of existing tools via an ISC-established working group. It also aims to promote the use of code coverage more systematically within the R ecosystem.
 
Code coverage helps to ensure greater software quality by reporting how thoroughly test suites cover the various code paths. Having a tool that supports the breadth of the R language across multiple platforms, and that is used by R package developers and R core teams, helps to improve software quality for the R Community. While a few code coverage tools exist for R, this Oracle-proposed ISC project aims to provide an enhanced tool that addresses feature and platform limitations of existing tools via an ISC-established working group. It also aims to promote the use of code coverage more systematically within the R ecosystem.
 +
 +
The Code Coverage group released a revised covr package over the summer 2017 ([https://www.r-consortium.org/blog/2017/06/28/code-coverage-tool-for-r-working-group-achieves-first-release]).
 +
 +
Github project: https://github.com/jimhester/covr/issues
 +
 +
=== Working Group Members ===
 +
* Shivank Agrawal, Oracle
 +
* Chris Campbell, Mango Solutions
 +
* Santosh Chaudhari, Oracle
 +
* Karl Forner, Quartz Bio
 +
* Jim Hester, RStudio
 +
* Mark Hornick, Oracle – Group Leader
 +
* Chen Liang, Oracle
 +
* Willem Ligtenberg, Open Analytics
 +
* Vlad Sharanhovich, Oracle
 +
* Tobias Verbeke, Open Analytics
 +
* Qin Wang, Oracle
 +
* Hadley Wickham, RStudio – ISC Sponsor
 +
 +
=== Status as of August 10, 2017 ===
 +
* Branch coverage with profile stats – Deferred
 +
* Define canonical performance benchmark suite – Done
 +
* #144 store test results as well as coverage – Deferred
 +
* #134 ICC compatibility – Done
 +
* Make code coverage use more pervasive in R community – in progress
 +
* Correct behavior for parallel code execution – DONE
 +
* Resolve package dependency license issues – DONE
 +
* #174 R6 methods are not covered - DONE
 +
* #117 covr with a local jenkins builder – DONE
 +
* #99 Shiny Source Tab Indicate the Filename – DONE
 +
* Observations testing ORE with covr – DONE
 +
 +
=== Meeting History ===
 +
* November 30, 2017
 +
* November 8, 2017
 +
* September 14, 2017
 +
* August 24, 2017
 +
* August 10, 2017
 +
* July 27, 2017
 +
* June 15, 2017
 +
* March 9, 2017
 +
* February 16, 2017
 +
* January 26, 2017
 +
* January 5, 2017
 +
* December 15, 2016
 +
* October 20, 2016
 +
* October 4, 2016
 +
* September, 22, 2016
 +
* September 8, 2016
 +
* August 18, 2016
 +
* July 28, 2016
 +
* July 7, 2016
 +
* June 16, 2016
 +
* June 2, 2016
 +
* May 24, 2016
 +
* May 15, 2016

Latest revision as of 15:46, 12 April 2018

Working Group: Code Coverage Tool for R

Code coverage helps to ensure greater software quality by reporting how thoroughly test suites cover the various code paths. Having a tool that supports the breadth of the R language across multiple platforms, and that is used by R package developers and R core teams, helps to improve software quality for the R Community. While a few code coverage tools exist for R, this Oracle-proposed ISC project aims to provide an enhanced tool that addresses feature and platform limitations of existing tools via an ISC-established working group. It also aims to promote the use of code coverage more systematically within the R ecosystem.

The Code Coverage group released a revised covr package over the summer 2017 ([1]).

Github project: https://github.com/jimhester/covr/issues

Working Group Members

  • Shivank Agrawal, Oracle
  • Chris Campbell, Mango Solutions
  • Santosh Chaudhari, Oracle
  • Karl Forner, Quartz Bio
  • Jim Hester, RStudio
  • Mark Hornick, Oracle – Group Leader
  • Chen Liang, Oracle
  • Willem Ligtenberg, Open Analytics
  • Vlad Sharanhovich, Oracle
  • Tobias Verbeke, Open Analytics
  • Qin Wang, Oracle
  • Hadley Wickham, RStudio – ISC Sponsor

Status as of August 10, 2017

  • Branch coverage with profile stats – Deferred
  • Define canonical performance benchmark suite – Done
  • #144 store test results as well as coverage – Deferred
  • #134 ICC compatibility – Done
  • Make code coverage use more pervasive in R community – in progress
  • Correct behavior for parallel code execution – DONE
  • Resolve package dependency license issues – DONE
  • #174 R6 methods are not covered - DONE
  • #117 covr with a local jenkins builder – DONE
  • #99 Shiny Source Tab Indicate the Filename – DONE
  • Observations testing ORE with covr – DONE

Meeting History

  • November 30, 2017
  • November 8, 2017
  • September 14, 2017
  • August 24, 2017
  • August 10, 2017
  • July 27, 2017
  • June 15, 2017
  • March 9, 2017
  • February 16, 2017
  • January 26, 2017
  • January 5, 2017
  • December 15, 2016
  • October 20, 2016
  • October 4, 2016
  • September, 22, 2016
  • September 8, 2016
  • August 18, 2016
  • July 28, 2016
  • July 7, 2016
  • June 16, 2016
  • June 2, 2016
  • May 24, 2016
  • May 15, 2016