User-agent: * Disallow: /assets Disallow: /banners Disallow: /hostedimages Disallow: /rw_common Disallow: /ssp_director