User-agent: * # Added sitemap path. Block all crawlers from using the browse indexes and irrelevant pages. / GUBUA Disallow: /browse Disallow: /browse-date Disallow: /browse-author Disallow: /browse-title Disallow: /browse-subject Disallow: /items-by-author Disallow: /items-by-date Disallow: /items-by-subject Disallow: /items-by-title Disallow: /search Disallow: /simple-search Disallow: /subject-search Disallow: /advanced-search Disallow: /subscribe Disallow: /profile Disallow: /feed Disallow: /feedback Disallow: /mydspace Disallow: /stats Sitemap: http://bada.hb.se/sitemap.xml.gz