[ICANN-CSC] [Ext] Re: Action Item - Proposed KPIs for KSK performance

Fri Apr 17 21:23:29 UTC 2020

Hi Gaurav,

I added Brett’s points to the document we started and will incorporate them into the document before the next CSC check-in on this topic.

For calculating the SLA on the ceremony events that are attached to a number of days, the threshold is proposed at 100% which means anything other than 100% would fail the threshold regardless of how close it is to 100%. The more I think about this given your question, that more I am inclined to say that this should be a pass/fail SLA instead of a threshold up to 100%.

Let me incorporate this in the document for the next CSC check-in on this topic and see what others think.

Thank you,
Naela

Naela Sarras
Director, IANA Operations
ICANN

From: Gaurav Vedi <gaurav.vedi at gmail.com>
Date: Wednesday, April 15, 2020 at 12:12 PM
To: Naela Sarras <naela.sarras at iana.org>
Cc: "icann-csc at icann.org" <ICANN-CSC at icann.org>
Subject: [Ext] Re: [ICANN-CSC] Action Item - Proposed KPIs for KSK performance

Hi Naela,

I agree with Brett that this is a very good starting point :)

However, I do need some clarification regarding regarding the new new metrics that are qualitative in nature:

1) The first metric "KSK ceremony Performed" is qualitative in nature with 100% SLA Threshold. How to do measure the success of the metric if lets say ceremony is delayed by few days ?
   a) Scenario #1: Ceremony completed successfully no later than 33 days prior to signature expiration. Success = 100%
   b) Scenario#2: Ceremony completed successfully with 3 days delay and 30 days prior to signature expiration. Will the success be measured at 90% (= 30 * (100/33)) ? OR just 0%.

Just trying to understand how these metrics will be calculated.

Regards,
Gaurav

On Wed, Apr 15, 2020 at 2:37 PM Brett Carr <brett.carr at nominet.uk<mailto:brett.carr at nominet.uk>> wrote:
Thanks Naela,

                As mentioned this is a great starting point.

            Just to get some additional suggestions on the record for when we do pick this up again.

  1.  I wonder If there is something we can track/assess in relation to the management IANA do of the ZSK Operator.
  2.  When the discussions have concluded on how often the KSK should be rolled we should track that activity.
  3.  I’d also like to suggest we track the TCR Churn, as a lot of the management and monitoring is done by the TCRs I think it’s important that new TCRs are regularly added and long term TCRs are retired.

Brett

--
Brett Carr
Manager DNS and Network Engineering
Nominet UK

From: ICANN-CSC <icann-csc-bounces at icann.org<mailto:icann-csc-bounces at icann.org>> on behalf of Naela Sarras <naela.sarras at iana.org<mailto:naela.sarras at iana.org>>
Date: Thursday, 2 April 2020 at 17:31
To: "icann-csc at icann.org<mailto:icann-csc at icann.org>" <icann-csc at icann.org<mailto:icann-csc at icann.org>>
Subject: [ICANN-CSC] Action Item - Proposed KPIs for KSK performance

Dear CSC,

During the March 2020 CSC meeting, Kim Davies gave a presentation on IANA’s role in managing the Root Key Signing Key (KSK). I have attached the presentation again for your reference if needed.

Following the presentation and discussion, we were tasked with an action item to come up with possible key performance indicators to monitor performance of the KSK.

Please find attached a document regarding with proposed measurements for CSC consideration.

We look forward to discussing the attached with you.

Best regards,

Naela Sarras
Director, IANA Operations
ICANN

_______________________________________________
ICANN-CSC mailing list
ICANN-CSC at icann.org<mailto:ICANN-CSC at icann.org>
https://mm.icann.org/mailman/listinfo/icann-csc

_______________________________________________
By submitting your personal data, you consent to the processing of your personal data for purposes of subscribing to this mailing list accordance with the ICANN Privacy Policy (https://www.icann.org/privacy/policy [icann.org]<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.icann.org_privacy_policy&d=DwMFaQ&c=FmY1u3PJp6wrcrwll3mSVzgfkbPSS6sJms7xcl4I5cM&r=8c8RYKmiPpn7lsCOi9BhKC0DIP-xommeEY1pfBdnNpk&m=cgceMUaFuX9o6ClqfBYW4sxXpzex-q_3aqNQFVwHgnc&s=pK-7amC2zjWUvgRv_SRkQ_B4os82xl1wlkMokX48smY&e=>) and the website Terms of Service (https://www.icann.org/privacy/tos [icann.org]<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.icann.org_privacy_tos&d=DwMFaQ&c=FmY1u3PJp6wrcrwll3mSVzgfkbPSS6sJms7xcl4I5cM&r=8c8RYKmiPpn7lsCOi9BhKC0DIP-xommeEY1pfBdnNpk&m=cgceMUaFuX9o6ClqfBYW4sxXpzex-q_3aqNQFVwHgnc&s=ZlF0-Zb0Q63Kt90enqUPATTao6YHyNRmEsbaYXFaYno&e=>). You can visit the Mailman link above to change your membership status or configuration, including unsubscribing, setting digest-style delivery or disabling delivery altogether (e.g., for a vacation), and so on.

--
Regards,
Gaurav Vedi
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mm.icann.org/pipermail/icann-csc/attachments/20200417/dd846d29/attachment-0001.html>