User-agent: * Disallow: /new Disallow: /get/* Disallow: /download/* Disallow: /inline/* Disallow: /asset/* Disallow: /redir/* Disallow: /api/* Disallow: /rest/*