I think the last point is the most important!
Consider scrapping the whole conference thing and just run an unconference instead, like BarCamp or PodCamp or BloggerCon.
There is a time and a place for conferences but if you really want a conversation - a unconference makes sense.