User-agent: *
allow: /
Disallow: /products/
Disallow: */index.html
Disallow: /index.php/
Disallow: /*?*