User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Allow: /wp-admin/images/* Disallow: /wp-includes/ Allow: /wp-includes/js Allow: /wp-includes/css #Disallow: /wp-content/plugins/ #Disallow: /wp-content/themes/ Disallow: /trackback/ Disallow: /xmlrpc.php Disallow: /feed/ Disallow: /*/feed/* Disallow: /*/*?s=* Disallow: /*/*.inc$ Disallow: /transfer/ Disallow: /refer/ Disallow: /*/cgi-bin/* Disallow: /*/blackhole/* Disallow: /*/trackback/* Disallow: /*/xmlrpc.php Disallow: /suggest/?* Disallow: /readme.html # protect my site from HTTrack or other software's ripping? User-agent: AhrefsBot User-agent: Baiduspider User-agent: EasouSpider User-agent: Ezooms User-agent: YandexBot User-agent: MJ12bot User-agent: SiteSucker User-agent: HTTrack User-agent: HTTrack Website Copier User-agent: Teleport User-agent: TeleportPro User-agent: EmailCollector User-agent: EmailSiphon User-agent: WebBandit User-agent: WebZIP User-agent: WebReaper User-agent: WebStripper User-agent: Web Downloader User-agent: WebCopier User-agent: Offline Explorer Pro User-agent: Offline Commander User-agent: Leech User-agent: WebSnake User-agent: BlackWidow User-agent: HTTP Weazel Disallow: / User-agent: Nutch Disallow: / User-agent: MJ12bot Crawl-delay: 10 User-agent: pinerest Crawl-delay: 1 Sitemap: https://lapmang.vn/sitemap.xml User-agent: ia_archiver Disallow: /