Debe funcionar, después de eliminar de cache debes hacer commit de ello también.
Aquí el problema que puedes estar teniendo es que el nombre del archivo contiene caracteres especiales y eso arruina las instrucciones.
Pensaba que al estar usando Windows ese no sería un problema, pero veo que si.
Hice la prueba y aquí está el log.
Código BASH:
Ver original[~]$ cd Sites/
[Sites]$ mkdir fuu
[Sites]$ cd fuu/
[fuu]$ git init
Initialized empty Git repository in fuu/.git/
[fuu (master)]$ touch candy.txt
[fuu (master)]$ touch \~\$candy.txt
[fuu (master)]$ git s
# On branch master
#
# Initial commit
#
# Untracked files:
# (use "git add <file>..." to include in what will be committed)
#
# candy.txt
# ~$candy.txt
nothing added to commit but untracked files present (use "git add" to track)
[fuu (master)]$ git add .
[fuu (master)]$ git s
# On branch master
#
# Initial commit
#
# Changes to be committed:
# (use "git rm --cached <file>..." to unstage)
#
# new file: candy.txt
# new file: ~$candy.txt
#
[fuu (master)]$ git ci -m "bar"
[master (root-commit) 28d50e2] bar
0 files changed
create mode 100644 candy.txt
create mode 100644 ~$candy.txt
[fuu (master)]$ git s
# On branch master
nothing to commit, working directory clean
[fuu (master)]$ rm \~\$candy.txt
[fuu (master)]$ git s
# On branch master
# Changes not staged for commit:
# (use "git add/rm <file>..." to update what will be committed)
# (use "git checkout -- <file>..." to discard changes in working directory)
#
# deleted: ~$candy.txt
#
no changes added to commit (use "git add" and/or "git commit -a")
[fuu (master)]$ git rm --cached \~\$candy.txt
rm '~$candy.txt'
[fuu (master)]$ git s
# On branch master
# Changes to be committed:
# (use "git reset HEAD <file>..." to unstage)
#
# deleted: ~$candy.txt
#
[fuu (master)]$ git ci -m "candy"
[master a3d0308] candy
0 files changed
delete mode 100644 ~$candy.txt
[fuu (master)]$ git s
# On branch master
nothing to commit, working directory clean
[fuu (master)]$ ls -a
. .. .git candy.txt