Answer: November 5
The poem is known as "The Bonfire Prayer." The segment of it that we hear more than once in the film is: "Remember, remember, the fifth of November, gunpowder treason and plot. I see no reason why the gunpowder treason should ever be forgot." This is, of course, a reference to Guy Fawkes, who attempted to destroy Parliament on November 5, 1605.