Even if it did work the list of files in content explorer also defines what files get sent to the xbox so you wouldn't be able to run on there.
Why do you want to remove them? They won't be rebuilt every time unless you do a rebuild all or they change.
I though the original question above was simply asking if assets that you have already compiled will be deleted if you remove them from the project.