in my humble opinion it would be better for any down voting should have a reason and the down voter should provide one so it help the one who asking to fix his/her question and the one who provided answer to fix his/her answer also
same thing for flag any thing
as in my few days here i find some people downvote whatever they like without finding any issue
and have a nice day :)