Human Memory is Finite

Recently I have been accidentally stopping mid conversation and thinking of the word I want to say in Japanese even though the conversation is in English. This has been causing me to stutter a lot and converse less fluently in English in some conversations - even though English is my native language. This could be because the word itself conveys a very nuanced feeling in which there is no 1-to-1 translation of from Japanese to English, and with the recent excessive exposure to Japanese, my brain might be automatically searching the Japanese search space instead of the English search space. Obviously I will be taking precautions from here on out with regards to practicing so many languages.