[Gnso-rpm-data] [Ext] Re: Close to Final Survey Questions - Comment by Thu 02 Aug 16:00 UTC

Sun Aug 5 01:21:19 UTC 2018

Dear Data Sub Team members,

Please find attached the finalized TM/brand owner survey, with both clean and redline versions for your reference.

Thank you,
Mary, Julie, Ariel, and Berry

From: Ariel Liang <ariel.liang at icann.org>
Date: Friday, August 3, 2018 at 7:25 PM
To: "gnso-rpm-data at icann.org" <gnso-rpm-data at icann.org>
Subject: Re: [Gnso-rpm-data] [Ext] Re: Close to Final Survey Questions - Comment by Thu 02 Aug 16:00 UTC

Dear Data Sub Team members,

Thank you, Michael, for inserting the suggested changes and comments in the Google doc. We have asked Analysis Group to check the Google doc and incorporate your suggestions. They will share the finalized survey in redline and clean versions soon.

Please find attached the finalized surveys for registry operators, registrars, and actual/potential registrants, incorporating edits/comments from the lead authors. These finalized surveys are considered closed for further comments/edits. Both clean and redline versions are attached for your reference.

We are also forwarding Analysis Group’s responses to Rebecca’s questions/comments posted in the email thread:

  *   From Rebecca: "…Although I don't object to the new question about the respondent's employment status, I'm surprised that something was added, from my perspective, out of the blue.  Who added it and why?"

AG: This was added because as part of the outreach plan, we will redirect any willing participants from the other surveys to the registrant survey. This question is intended to help us understand whether respondents may consequently represent the experiences of other target groups, such as trademark owners.

  *   From Rebecca: "Separately, let me reiterate that allowing respondents to choose is worse than randomly assigning them to a survey type where we are splitting the surveys, and if we're expanding that split then we should also randomize who gets which one in the other groups.  I don't recall that we agreed to let respondents choose which branch of the survey they wanted to take."

AG: We understand this concern but in this context and with these populations, we have no concern about introducing any bias. In particular, forcing individuals to answer survey questions in which they have little interest or knowledge is likely to lead to respondent drop-out and data that is unreliable. Also, since respondents can't preview the questions in a particular subsection of the survey, any type of selection bias should be minimal.

  *   From Rebecca: “I would like to make sure that the online panel will qualify both actual and potential registrants--that is, if a person on the SSI panel says ‘I've registered a domain name in a new gTLD,’ not just ‘I'm interested in registering/I tried to register in a new gTLD’ they should qualify for the rest of the survey.  Calling them just potential registrants makes me nervous.”

AG: SSI's online panel will include both actual and potential registrants and will direct them to the appropriate survey to fill out based on their response to the gating question.
Finally, with respect to the timing and next steps:

  *   So far we have six (6) RPM WG members volunteered to be beta testers (none of them is Data Sub Team member). Beta testing will take place next week (week of 6 August) as scheduled.
  *   AG plan to begin launching the surveys (after beta testing next week) on 13 August. They had originally discussed launching surveys toward the end of the week of 6 August, but do not think it is a good idea to send survey announcements to potential respondents towards the end of a week.
  *   AG plan to close the surveys in mid-September or so, taking into consideration of the summer holiday in August and the response rate.
  *   AG aim to present initial survey results to the WG on 12 September.
A big THANK YOU to all the Data Sub Team members, especially the lead authors – Kristine, Susan, Michael, and Rebecca – for the tremendous work and time that you have put into this effort!

Have a great weekend everyone!

Best Regards,
Mary, Julie, Ariel, and Berry

From: "Michael Graham (ELCA)" <migraham at expedia.com>
Date: Friday, August 3, 2018 at 6:24 PM
To: Ariel Liang <ariel.liang at icann.org>, "gnso-rpm-data at icann.org" <gnso-rpm-data at icann.org>
Subject: RE: [Gnso-rpm-data] [Ext] Re: Close to Final Survey Questions - Comment by Thu 02 Aug 16:00 UTC

I have inserted changes and comments in the Google document.  Be glad to respond to any questions.

Michael R.

From: Gnso-rpm-data [mailto:gnso-rpm-data-bounces at icann.org] On Behalf Of Ariel Liang
Sent: Wednesday, August 01, 2018 3:08 PM
To: gnso-rpm-data at icann.org
Subject: Re: [Gnso-rpm-data] [Ext] Re: Close to Final Survey Questions - Comment by Thu 02 Aug 16:00 UTC

Hello Rebecca, Kristine, and all,

Thank you, Rebecca and Kristine, for commenting on the Google Docs! We also forwarded Rebecca’s questions/comments below to AG and will pass their responses asap.

As a gentle reminder -- other lead authors/interested Sub Team members please provide your comments/suggested edits on the Google docs by Thu, 02 Aug 16:00 UTC.

Staff would like to highlight AG’s suggestion of letting respondents for the registrar, registry operator, and TM/band owner surveys choose which subsections of the surveys they would like to address. We have noted Rebecca’s concerns regarding whether respondents should choose vs. be randomly assigned to take different subsections of the survey. Sub Team members -- if you have any input/opinion about this point, please comment on the mailing list.

Thank you,
Mary, Julie, Ariel, and Berry

From: "Tushnet, Rebecca" <rtushnet at law.harvard.edu<mailto:rtushnet at law.harvard.edu>>
Date: Wednesday, August 1, 2018 at 1:01 PM
To: Ariel Liang <ariel.liang at icann.org<mailto:ariel.liang at icann.org>>, "gnso-rpm-data at icann.org<mailto:gnso-rpm-data at icann.org>" <gnso-rpm-data at icann.org<mailto:gnso-rpm-data at icann.org>>
Subject: [Ext] Re: [Gnso-rpm-data] Close to Final Survey Questions - Comment by Thu 02 Aug 16:00 UTC

I have made comments on the Google doc.  Although I don't object to the new question about the respondent's employment status, I'm surprised that something was added, from my perspective, out of the blue.  Who added it and why?

Separately, let me reiterate that allowing respondents to choose is worse than randomly assigning them to a survey type where we are splitting the surveys, and if we're expanding that split then we should also randomize who gets which one in the other groups.  I don't recall that we agreed to let respondents choose which branch of the survey they wanted to take.

Rebecca Tushnet
Frank Stanton Professor of First Amendment Law, Harvard Law School
703 593 6759
________________________________
From: Gnso-rpm-data <gnso-rpm-data-bounces at icann.org<mailto:gnso-rpm-data-bounces at icann.org>> on behalf of Ariel Liang <ariel.liang at icann.org<mailto:ariel.liang at icann.org>>
Sent: Tuesday, July 31, 2018 11:18:18 AM
To: gnso-rpm-data at icann.org<mailto:gnso-rpm-data at icann.org>
Subject: [Gnso-rpm-data] Close to Final Survey Questions - Comment by Thu 02 Aug 16:00 UTC

Dear Data Sub Team members,

Analysis Group has further revised the draft Sunrise & Claims surveys based on the input/feedback from the Sub Team. They continue to be concerned about the length of the registrar and registry operator surveys, and suggest that respondents for each of those surveys be given a choice of which subsections of the survey they would like to address. This could be implemented in a similar way to how the trademark owner survey has been divided.

IMPORTANT: Lead authors please review the revised surveys and provide your feedback by Thursday, 02 August at 16:00 UTC (48 hours). Others in the Sub Team are welcome to review as well. This deadline is set per timeline requirement, as the survey questions need to be finalized this week for AG to proceed with the programming of the surveys.

To facilitate the review process, staff have converted the clean version of the revised surveys into Google Docs; the Google Docs have been shared with AG so they can view the comments/suggested edits at the same time. You may also find the redline version (.word files) attached for reference:

  *   Registry Operators (Lead: Kristine Dorrain): https://docs.google.com/document/d/1-S-7tk3BZMkD15XWnno7VQP4PtJVr60B9ltLnfMCW-s/edit?usp=sharing<https://urldefense.proofpoint.com/v2/url?u=https-3A__docs.google.com_document_d_1-2DS-2D7tk3BZMkD15XWnno7VQP4PtJVr60B9ltLnfMCW-2Ds_edit-3Fusp-3Dsharing&d=DwMGaQ&c=WO-RGvefibhHBZq3fL85hQ&r=E-M4OQvQBo8UWqE1LwEiDR3PcWlfM0I-0jiI1c4ous0&m=3hcITB1xO_D28gYzR6YIpWrMulucf_h0WrGa-H5rC24&s=jPfOapHmF8sJFulrundpyX99ZdiuWoXB-COfR2vRnY4&e=>
  *   Registrars (Lead: Susan Payne): https://docs.google.com/document/d/139E06nx1-dlkbTfQg7S9N_f3AZQ9Tr57RJKCTU2NFH0/edit?usp=sharing<https://urldefense.proofpoint.com/v2/url?u=https-3A__docs.google.com_document_d_139E06nx1-2DdlkbTfQg7S9N-5Ff3AZQ9Tr57RJKCTU2NFH0_edit-3Fusp-3Dsharing&d=DwMGaQ&c=WO-RGvefibhHBZq3fL85hQ&r=E-M4OQvQBo8UWqE1LwEiDR3PcWlfM0I-0jiI1c4ous0&m=3hcITB1xO_D28gYzR6YIpWrMulucf_h0WrGa-H5rC24&s=vGcO6qxvd8VBDcz8E5npuM1ZOKFi9mrgRrC9gdz0mjo&e=>
  *   Brand/Trademark Owners(Lead: Michael Graham): https://docs.google.com/document/d/1ky5nRqI2VEHX3cWptYG5gAU1HMMRrLXf83f922Rh_Rg/edit?usp=sharing<https://urldefense.proofpoint.com/v2/url?u=https-3A__docs.google.com_document_d_1ky5nRqI2VEHX3cWptYG5gAU1HMMRrLXf83f922Rh-5FRg_edit-3Fusp-3Dsharing&d=DwMGaQ&c=WO-RGvefibhHBZq3fL85hQ&r=E-M4OQvQBo8UWqE1LwEiDR3PcWlfM0I-0jiI1c4ous0&m=3hcITB1xO_D28gYzR6YIpWrMulucf_h0WrGa-H5rC24&s=UTVpc-epITKAgCgAo7lQ6lzhMvCXPDgxNnqPz6uH8j4&e=>
  *   Actual/Potential Registrants (Lead: Rebecca Tushnet): https://docs.google.com/document/d/1UVVzM8lTSiMC7N89OoY8VWPbVg8KVb8N3xRQlZJo3w0/edit?usp=sharing<https://urldefense.proofpoint.com/v2/url?u=https-3A__docs.google.com_document_d_1UVVzM8lTSiMC7N89OoY8VWPbVg8KVb8N3xRQlZJo3w0_edit-3Fusp-3Dsharing&d=DwMGaQ&c=WO-RGvefibhHBZq3fL85hQ&r=E-M4OQvQBo8UWqE1LwEiDR3PcWlfM0I-0jiI1c4ous0&m=3hcITB1xO_D28gYzR6YIpWrMulucf_h0WrGa-H5rC24&s=jz8OciqxxejIh7A7JhvuggItvB-rYWUCJ_CHbsiu6Ak&e=>

Based on the discussion last week, the lead authors/Sub Team members will conduct this final review online. Sub Team call is hence not scheduled. Once the final survey questions are signed off by the Sub Team, they will be forwarded to the full WG as a FYI.

Thank you all for your hard work pushing toward the finishing line of launching the surveys!

Best Regards,

Mary, Julie, Ariel, and Berry

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mm.icann.org/pipermail/gnso-rpm-data/attachments/20180805/94d0b315/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: 2018.08.03 Trademark Owners Survey_clean.docx
Type: application/vnd.openxmlformats-officedocument.wordprocessingml.document
Size: 38327 bytes
Desc: 2018.08.03 Trademark Owners Survey_clean.docx
URL: <http://mm.icann.org/pipermail/gnso-rpm-data/attachments/20180805/94d0b315/2018.08.03TrademarkOwnersSurvey_clean-0001.docx>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: 2018.08.03 Trademark Owners Survey_redline.docx
Type: application/vnd.openxmlformats-officedocument.wordprocessingml.document
Size: 43773 bytes
Desc: 2018.08.03 Trademark Owners Survey_redline.docx
URL: <http://mm.icann.org/pipermail/gnso-rpm-data/attachments/20180805/94d0b315/2018.08.03TrademarkOwnersSurvey_redline-0001.docx>