Evan Williams has an absolutely wonderful post up about evaluating a new product idea . I think Marc is spot on - the "personally compelling" criteria is the one that stands out. Last on the list, but probably the first question I ask myself is: How important to me is it that this product exists...