Unfortunately, I don't know of any way to shut off JUST the SMS portion of the Bluetooth connection. Whatever Nokia is doing to the text, it's not simple ASCII.
I is probably a difference between standard ASCII (8 bit) and 2 byte Unicode. That would certainly create a mess. If your Nokia is sending 16-bit UCS2 mode, and the TomTom is expecting 8 bit ASCII ...