User-agent: twiceler Disallow: / User-agent: * Disallow: /dir/ Disallow: /dir Disallow: /dir/?c=0&o=1&start=1570