User-agent: * Disallow: /extensions/ Disallow: /job_feeds/ Disallow: /user_files/ Disallow: /csv_importer/ Disallow: /ADMIN/