What colour of bag would go with a purple velvet dress and a black shoe?

Any bright primary color would work. With the purple velvet and the black shoe you’ve already got more than enough “neutrals” going.