It does indeed sound like you do not have enough memory allocated for your website. You’ll want to first try allocating more memory as I suspect this will resolve the issue. This article outlines 5 ways you can do this on your server: http://www.dailyblogging.org/wordpress/increase-wordpress-memory-limit/
If none of those work you’ll need to contact your web host to see about having them doing it for you.