# www.robotstxt.org/ # Allow crawling of all content User-agent: * Disallow: /cockpit/ Disallow: /api/ User-agent: adidxbot Disallow: /cockpit/ Disallow: /api/