[gtld-tech] [weirds] Search Engines Indexing RDAP Server Content

[Francisco Arias]

Hi Scott,

In all the cross-posting, it seems you may have left out the list where people have currently in scope doing something about this https://community.icann.org/display/gTLDRDS/Next-Generation+gTLD+Registration+Directory+Services+to+Replace+Whois

Regards,

-- 
Francisco







On 1/29/16, 5:34 AM, "weirds on behalf of Hollenbeck, Scott" <weirds-bounces at ietf.org on behalf of shollenbeck at verisign.com> wrote:

>(cross-posting to multiple lists - sorry if that's inconvenient)
>
>So I saw a tweet from Gavin Brown (@GavinBrown) that describes how one particular search engine has indexed the RDAP server of a gTLD registry operator:
>
>https://twitter.com/GavinBrown/status/692718904058191872
>
>This is all the more reason to work on a client authentication specification that includes support for varying responses based on client identity and authorization. I've been working on such a specification and welcome feedback on the approach:
>
>https://datatracker.ietf.org/doc/draft-hollenbeck-weirds-rdap-openid/
>
>It also begs the question of the need for a BCP describing operational practices for server operators. There are ways for web servers to influence or restrict crawler behavior, but what's appropriate in this context?
>
>Scott
>
>_______________________________________________
>weirds mailing list
>weirds at ietf.org
>https://www.ietf.org/mailman/listinfo/weirds