[ICANN-CSC] Explanation of qualification of monthly PTI performance as included in CSC Reports

[Bart Boswinkel]

Dear all,

One of the open actions  (Action 01 26 2019: Secretariat to complete overview of CSC qualifications of PTI performance) was to look-up how the CSC has defined the qualifications of its findings.

In November 2016, before publishing their first Findings of PTI performance, the CSC agreed on the need for a limited set of qualifications and these were defined as follows:

 

Excellent - PTI met all service level agreements (100 %) for the month of [Month Year].

 

Satisfactory - PTI met the service level agreement for [%] of defined metrics. Missed service level agreements were satisfactorily explained and the CSC has determined that these exceptions were no cause for concern. No persistent problems were identified and no further action is needed.

 

Need Improvement - Performance needs improvement due to a) severe degradation in meeting SLAs from previous months, b) a trend in complaints that indicate a persistent issue to be resolved, and c) a negative trend in compliance to SLAs over several months.

 

Further, until June 2017, the CSC Findings also included a description of how the % compliance with defined metrics SLA was arrived at. However in the July 2017 report ( On the PTI performance over June 2017) the CSC noted: 

The overall SLA compliance score is correctly identified in the PTI report as "Percentage of SLA thresholds met of those defined."  However, prior to this report (BB: CSC Findings June 2017)  the calculation has not followed this definition and has instead been based on the compliance of each individual request made, as documented in CSC reports. This calculation has changed for this report and subsequent reports to correctly meet the requirements of the SLA specification. The CSC has considered the reissuing of previous reports with the correct calculation but decided against it because the change would not be significant.

 

Ever since the description of how the % was arrived at is not included anymore, but follows the PTI report.

 

Kind regards,

Bart

 

 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mm.icann.org/pipermail/icann-csc/attachments/20190130/fd3a9701/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 4583 bytes
Desc: not available
URL: <http://mm.icann.org/pipermail/icann-csc/attachments/20190130/fd3a9701/smime.p7s>