Initialization Improves LLM-Driven Discovery