Solved
I followed the advice on the codex article about chaning WP_MEMORY_LIMIT. This did not solve the problem.
My provider, for php memory issues recommended upgrading to php 5.4 or above which changes how it does memory allocation. I upgraded from php 5.3 to php 5.5 and that seemed to resolve the issue.
Thank you for your help!