User-agent: Mediapartners-Google Allow: / User-agent: Yandex Disallow: / User-agent: WBSearchBot Disallow: / User-agent: Baiduspider Disallow: / User-agent: * Crawl-Delay: 90