CKEditor 4 inserting <p> inside image source (not outside) due to enterMode config

My current config looks like this:

config.enterMode = CKEDITOR.ENTER_P;
config.shiftEnterMode = CKEDITOR.ENTER_BR;

When I insert an image, the end result looks like this:

src="<p>{{ url:site }}files/large/fc5005d99f33f26</p>"

Yet, if I change my editorConfig to:

config.enterMode = CKEDITOR.ENTER_BR;
config.shiftEnterMode = CKEDITOR.ENTER_BR;

It works as it should. The image tag is built properly. Yet, the problem is that enter makes a BR instead of a P.