User-agent: * Disallow: /api/ Disallow: /administration/ Disallow: /login Disallow: /register