[gtld-tech] [weirds] Search Engines Indexing RDAP Server Content

Francisco Arias francisco.arias at icann.org
Fri Jan 29 16:54:49 UTC 2016

Hi Scott,

In all the cross-posting, it seems you may have left out the list where people have currently in scope doing something about this https://community.icann.org/display/gTLDRDS/Next-Generation+gTLD+Registration+Directory+Services+to+Replace+Whois



On 1/29/16, 5:34 AM, "weirds on behalf of Hollenbeck, Scott" <weirds-bounces at ietf.org on behalf of shollenbeck at verisign.com> wrote:

>(cross-posting to multiple lists - sorry if that's inconvenient)
>So I saw a tweet from Gavin Brown (@GavinBrown) that describes how one particular search engine has indexed the RDAP server of a gTLD registry operator:
>This is all the more reason to work on a client authentication specification that includes support for varying responses based on client identity and authorization. I've been working on such a specification and welcome feedback on the approach:
>It also begs the question of the need for a BCP describing operational practices for server operators. There are ways for web servers to influence or restrict crawler behavior, but what's appropriate in this context?
>weirds mailing list
>weirds at ietf.org

More information about the gtld-tech mailing list