User-agent: * Allow: / User-agent: facebookexternalhit Disallow: Disallow: /cgi-bin/ Disallow: /enroll-now?previousurl=/ Disallow: /undefined/