User-agent: * Disallow: /directory_name/ Disallow: /page_name.html

User-agent: ia_archiver Disallow: /