Here is a great article discussing the issues and workarounds in Silverlight when you need to access data from a site that does not have a crossdomain or clientaccesspolicy xml file.
http://weblogs.asp.net/jgalloway/archive/2008/12/12/silverlight-crossdomain-access-workarounds.aspx