<html xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
p.gmail-m-6023548906236593586msolistparagraph, li.gmail-m-6023548906236593586msolistparagraph, div.gmail-m-6023548906236593586msolistparagraph
{mso-style-name:gmail-m_-6023548906236593586msolistparagraph;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
span.EmailStyle19
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:1964538697;
mso-list-template-ids:-384927850;}
ol
{margin-bottom:0in;}
ul
{margin-bottom:0in;}
--></style>
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal">Hi Gaurav,<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">I added Brett’s points to the document we started and will incorporate them into the document before the next CSC check-in on this topic.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">For calculating the SLA on the ceremony events that are attached to a number of days, the threshold is proposed at 100% which means anything other than 100% would fail the threshold regardless of how close it is to 100%. The more I think
about this given your question, that more I am inclined to say that this should be a pass/fail SLA instead of a threshold up to 100%.
<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Let me incorporate this in the document for the next CSC check-in on this topic and see what others think.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Thank you,<o:p></o:p></p>
<p class="MsoNormal">Naela<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<div>
<p class="MsoNormal"><span style="mso-style-textfill-type:gradient;mso-style-textfill-fill-gradientfill-shadetype:linear;mso-style-textfill-fill-gradientfill-shade-linearshade-angle:2700000;mso-style-textfill-fill-gradientfill-shade-linearshade-fscaled:no;mso-style-textfill-fill-gradientfill-stoplist:"0 \#C6C6C6 -1 100000 tint=66000 satm=160000\,50000 \#E7E7E7 -1 100000 tint=44500 satm=160000\,100000 \#F9F9F9 -1 100000 tint=23500 satm=160000"">Naela
Sarras<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-style-textfill-type:gradient;mso-style-textfill-fill-gradientfill-shadetype:linear;mso-style-textfill-fill-gradientfill-shade-linearshade-angle:2700000;mso-style-textfill-fill-gradientfill-shade-linearshade-fscaled:no;mso-style-textfill-fill-gradientfill-stoplist:"0 \#C6C6C6 -1 100000 tint=66000 satm=160000\,50000 \#E7E7E7 -1 100000 tint=44500 satm=160000\,100000 \#F9F9F9 -1 100000 tint=23500 satm=160000"">Director,
IANA Operations<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-style-textfill-type:gradient;mso-style-textfill-fill-gradientfill-shadetype:linear;mso-style-textfill-fill-gradientfill-shade-linearshade-angle:2700000;mso-style-textfill-fill-gradientfill-shade-linearshade-fscaled:no;mso-style-textfill-fill-gradientfill-stoplist:"0 \#C6C6C6 -1 100000 tint=66000 satm=160000\,50000 \#E7E7E7 -1 100000 tint=44500 satm=160000\,100000 \#F9F9F9 -1 100000 tint=23500 satm=160000"">ICANN<o:p></o:p></span></p>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:12.0pt;color:black">From: </span></b><span style="font-size:12.0pt;color:black">Gaurav Vedi <gaurav.vedi@gmail.com><br>
<b>Date: </b>Wednesday, April 15, 2020 at 12:12 PM<br>
<b>To: </b>Naela Sarras <naela.sarras@iana.org><br>
<b>Cc: </b>"icann-csc@icann.org" <ICANN-CSC@icann.org><br>
<b>Subject: </b>[Ext] Re: [ICANN-CSC] Action Item - Proposed KPIs for KSK performance<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<div>
<p class="MsoNormal">Hi Naela,<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">I agree with Brett that this is a very good starting point :)<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">However, I do need some clarification regarding regarding the new new metrics that are qualitative in nature:<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">1) The first metric "<span lang="EN" style="font-size:12.0pt">KSK ceremony Performed</span>" is qualitative in nature with 100% SLA Threshold. How to do measure the success of the metric if lets say ceremony is delayed by few days ?
<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> a) Scenario #1: Ceremony completed successfully no later than 33 days prior to signature expiration. Success = 100%<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> b) Scenario#2: Ceremony completed successfully with 3 days delay and 30 days prior to signature expiration. Will the success be measured at 90% (= 30 * (100/33)) ? OR just 0%.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Just trying to understand how these metrics will be calculated.
<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Regards,<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Gaurav<o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal">On Wed, Apr 15, 2020 at 2:37 PM Brett Carr <<a href="mailto:brett.carr@nominet.uk">brett.carr@nominet.uk</a>> wrote:<o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-GB">Thanks Naela,<o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-GB"> <o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-GB"> As mentioned this is a great starting point.<o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-GB"> <o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-GB"> Just to get some additional suggestions on the record for when we do pick this up again.<o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-GB"> <o:p></o:p></span></p>
<ol start="1" type="1">
<li class="gmail-m-6023548906236593586msolistparagraph" style="mso-list:l0 level1 lfo1">
<span lang="EN-GB">I wonder If there is something we can track/assess in relation to the management IANA do of the ZSK Operator.<o:p></o:p></span></li><li class="gmail-m-6023548906236593586msolistparagraph" style="mso-list:l0 level1 lfo1">
<span lang="EN-GB">When the discussions have concluded on how often the KSK should be rolled we should track that activity.<o:p></o:p></span></li><li class="gmail-m-6023548906236593586msolistparagraph" style="mso-list:l0 level1 lfo1">
<span lang="EN-GB">I’d also like to suggest we track the TCR Churn, as a lot of the management and monitoring is done by the TCRs I think it’s important that new TCRs are regularly added and long term TCRs are retired.<o:p></o:p></span></li></ol>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-GB"> <o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-GB">Brett<o:p></o:p></span></p>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-GB"><br>
--<br>
Brett Carr<br>
Manager DNS and Network Engineering<br>
Nominet UK<o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-GB"> <o:p></o:p></span></p>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-GB"> <o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-GB"> <o:p></o:p></span></p>
<div style="border:none;border-top:solid windowtext 1.0pt;padding:3.0pt 0in 0in 0in;border-color:currentcolor currentcolor">
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
<b><span lang="EN-GB" style="color:black">From: </span></b><span lang="EN-GB" style="color:black">ICANN-CSC <<a href="mailto:icann-csc-bounces@icann.org" target="_blank">icann-csc-bounces@icann.org</a>> on behalf of Naela Sarras <<a href="mailto:naela.sarras@iana.org" target="_blank">naela.sarras@iana.org</a>><br>
<b>Date: </b>Thursday, 2 April 2020 at 17:31<br>
<b>To: </b>"<a href="mailto:icann-csc@icann.org" target="_blank">icann-csc@icann.org</a>" <<a href="mailto:icann-csc@icann.org" target="_blank">icann-csc@icann.org</a>><br>
<b>Subject: </b>[ICANN-CSC] Action Item - Proposed KPIs for KSK performance</span><span lang="EN-GB"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
<span lang="EN-GB"> <o:p></o:p></span></p>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
<span lang="EN-GB">Dear CSC,<o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
<span lang="EN-GB"> <o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
<span lang="EN-GB">During the March 2020 CSC meeting, Kim Davies gave a presentation on IANA’s role in managing the Root Key Signing Key (KSK). I have attached the presentation again for your reference if needed.<o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
<span lang="EN-GB"> <o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
<span lang="EN-GB">Following the presentation and discussion, we were tasked with an action item to come up with possible key performance indicators to monitor performance of the KSK.<o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
<span lang="EN-GB"> <o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
<span lang="EN-GB">Please find attached a document regarding with proposed measurements for CSC consideration.<o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
<span lang="EN-GB"> <o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
<span lang="EN-GB">We look forward to discussing the attached with you. <o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
<span lang="EN-GB"> <o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
<span lang="EN-GB">Best regards,<o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
<span lang="EN-GB"> <o:p></o:p></span></p>
<div>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
<span lang="EN-GB">Naela Sarras<o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
<span lang="EN-GB">Director, IANA Operations<o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
<span lang="EN-GB">ICANN<o:p></o:p></span></p>
</div>
</div>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:.5in">
<span lang="EN-GB"> <o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal">_______________________________________________<br>
ICANN-CSC mailing list<br>
<a href="mailto:ICANN-CSC@icann.org" target="_blank">ICANN-CSC@icann.org</a><br>
<a href="https://mm.icann.org/mailman/listinfo/icann-csc" target="_blank">https://mm.icann.org/mailman/listinfo/icann-csc</a><br>
<br>
_______________________________________________<br>
By submitting your personal data, you consent to the processing of your personal data for purposes of subscribing to this mailing list accordance with the ICANN Privacy Policy (<a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__www.icann.org_privacy_policy&d=DwMFaQ&c=FmY1u3PJp6wrcrwll3mSVzgfkbPSS6sJms7xcl4I5cM&r=8c8RYKmiPpn7lsCOi9BhKC0DIP-xommeEY1pfBdnNpk&m=cgceMUaFuX9o6ClqfBYW4sxXpzex-q_3aqNQFVwHgnc&s=pK-7amC2zjWUvgRv_SRkQ_B4os82xl1wlkMokX48smY&e=" target="_blank">https://www.icann.org/privacy/policy
[icann.org]</a>) and the website Terms of Service (<a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__www.icann.org_privacy_tos&d=DwMFaQ&c=FmY1u3PJp6wrcrwll3mSVzgfkbPSS6sJms7xcl4I5cM&r=8c8RYKmiPpn7lsCOi9BhKC0DIP-xommeEY1pfBdnNpk&m=cgceMUaFuX9o6ClqfBYW4sxXpzex-q_3aqNQFVwHgnc&s=ZlF0-Zb0Q63Kt90enqUPATTao6YHyNRmEsbaYXFaYno&e=" target="_blank">https://www.icann.org/privacy/tos
[icann.org]</a>). You can visit the Mailman link above to change your membership status or configuration, including unsubscribing, setting digest-style delivery or disabling delivery altogether (e.g., for a vacation), and so on.<o:p></o:p></p>
</blockquote>
</div>
<p class="MsoNormal"><br clear="all">
<br>
-- <o:p></o:p></p>
<div>
<p class="MsoNormal">Regards,<br>
Gaurav Vedi<o:p></o:p></p>
</div>
</div>
</body>
</html>