Is there a crawl space accessible up there above the hole? Sometimes you can just put a tarp up there to allay the drip until the storm is over, and sometimes the tarp will just keep the water from ever bothering you again. Sometimes you might need a drip pan to catch the water, cheap aluminum lasagna/serving trays from costco work great for that cause. Ask me sometime how I know :)