Trying to remove it from its current location only copies it, not a complete removal...
That happens because you are not allowed to change the Kernel Extenstions folder without typing a password. If you want to remove something from the Kernel Extensions folder, do not drag it to a different place. Drag it to the Trash. You will be asked to type your password. (If you want to keep it, you can then drag it out of the Trash to some other place later.)