Peel the peaches or nectarines or apricots and the pineapple, and cut it into dice the size that come with your Monopoly set. Slice the bananas about a quarter-inch thick.
Put all the fruits into a two-quart non-metallic baking dish. Pour the sherry over the fruits. Cover and marinate for two to four hours. Don't refrigerate.
About a half-hour before you're ready to serve, preheat the oven to 350 degrees. Add the brown sugar, almonds, and half of the crushed cookies to the fruit. Cut the butter into chips and add. With a big spoon, lightly toss the contents of the dish.
Top the fruit mixture with the remaining cookie crumbs. Put the baking dish into the 350-degree oven, uncovered, and bake for 12-15 minutes, until the top is browned.
At the table, pour the brandy over the hot fruit and touch a flame to it. (Be careful that nothing overhead is inflammable. Don't flame if you don't feel safe about it.) Spoon the fruit over scoops of ice cream and serve.