The best location I found is Gloombound Mine which is part of an orc camp south-east of Windhelm:
Gloombound Mine Location
I found 42 ebony ore and some iron ore as well as some diamonds and other gemstones. You aren’t welcome in the mine, but the orcs won’t do anything to get you out of the mine.
Sometimes I find that an ore vein is occupied. I usually like to kill the occupant so I don’t have to wait for them to move, which they will do eventually. Be sure to be on the look out for any air distortions because that could mean that there is flamable gas around. It usually looks like:
Signs of Flammable Gas in Mines
It is hard to tell on the image, but if you look at the video below it will be quite obvious. If you do ignite the gas it does a little damage, but it didn’t kill me. I did have very good armor and was a high level so if you are a lower level you have to be more careful with it.
After you have collected the ore you need to find a smelter to turn the ore into ingots. Usually there is a smelter near mines, just look around for a bit. Again if you are having trouble finding it look at the video below, it shows you the location of the smelter at Gloombound Mine.
auluftwaffles.com, short video game guides 
Thank you for this! I was able to make a full set of Ebony gear and weps plus some. For me, I had to do a peliminary quest with the orcs in order to get access to the mine. It was pretty easy and it was in a place I cleared before for a quest with the Companions.