User-agent: * Disallow: /internal/ Disallow: /internal/bin Disallow: /internal/docs Disallow: /internal/images Disallow: /internal/import Disallow: /internal/lang Disallow: /internal/old Disallow: /internal/simple_cache Disallow: /internal/simple_store Disallow: /internal/src Disallow: /private_area/ Disallow: /media/