User-agent: * Disallow: /storage/temp/* Disallow: /download/media/* Disallow: /media/*