Think you can try IUI again, since your husband wish to. Actually, one should try IUI 3 times before going to IVF - that's why lots of people (in forum or doctors) told me. For me, I dun want to try 3rd time, as I was not working. I wish to go through all these asap, so that I know when I want to start working again.
You need to discuss with your husband again, to let him know your concerns. After all, both are involved in this matter.