User-agent: *
Disallow: /wp-admin/
Disallow: /wp-content/
Disallow: /wp-includes/
Disallow: /tag
Disallow: /author
Disallow: /category
Crawl-delay: 5
Request-rate: 1/5
Sitemap: http://rugmonster.org/sitemap.xml.gz