# BEGIN BLOCK META CRAWLERS User-agent: meta-externalagent Disallow: / User-agent: meta-webindexer Disallow: / User-agent: meta-externalfetcher Disallow: / User-agent: meta-externalads Disallow: / User-agent: facebookexternalhit Disallow: / # END BLOCK META CRAWLERS