I'm having the same issues as stated in this thread http://www.gravityhelp.com/forums/topic/ajax-error-while-deleting-field-in-form.
I've had this before and immediately made sure the memory limit was increased both in WP and PHP to 64MB. Still having the same issues.
Anything else that can cause this?