I actually think it’s a fair restriction for spells that require sight. It imposes a somewhat interesting limit on casters, especially since a lot of spells still do something on a miss.