User-agent:* Disallow: /cart.php Disallow: /download.php Disallow: /fixtures/ Disallow: /pdf/ Disallow: /en/fixtures/ Disallow: /it/fixtures/ Disallow: /pdf/ Disallow: /*.fdf$ Disallow: /*.pdf$ User-agent: MJ12bot Disallow: / User-agent: 008 Disallow: / User-agent: SemrushBot Disallow: / User-agent: AhrefsBot Disallow: /