After removing empty batteries, you should of course also store them securely and cover the terminals with adhesive tape. However, the most important thing is that batteries should not be thrown out with general household waste or tossed into nature. Apart from recyclable materials, batteries contain substances that are hazardous to human health and the environment.
People are legally required to dispose of used batteries at retail outlets or special collection points.