User-agent: * Disallow: Disallow: /cgi-bin Disallow: /index.html Disallow: /contact.html Disallow: /supplier.html