And then there is always
find . <some criteria> -exec rm {} \;
You can use crude but effective tools like "od -bch ." to see what the
true name of a file is. I think the problem with funny names is getting
them past the shell; rm doesn't care.