Yes, it will show an activity for the form submit on the newly created Contact record. You can try/test it yourself by submitting a form using a an email address not currently tracked in your instance - a dummy email or one of your personal email addresses. You should then see a Contact created for the new email address and the form submit.
I hope that helps!