A problem occurred while trying to set the "References" parameter for the IDE's in-process compiler. Error HRESULT E_FAIL has been returned from a call to a COM component.

I resolve my issue with the help from the workaround here.

In my case it was about adding a reference to itself. Removed it and it is working fine now.