It is entirely safe, they will not be harmed by it.
As the temperature falls, the pressure inside the chargers will fall, but it will still remain higher than atmospheric pressure until you got below the boiling point of nitrous oxide (-88C/-126F). There is no low temperature at which the cartridges would explode (even if it were chilled enough to freeze the nitrous oxide, that would just further lower the pressure, because (like almost every material other than water), nitrous oxide takes up less volume as a solid than as a liquid - but even if that was an issue (which it's not), it wouldn't matter unless you happen to live at the north/south pole (the record-low temperatures at the poles are around the freezing point for N2O, ~ -91 C / -132 F).
You only have to worry about exposing nitrous chargers to high temperatures, because higher temperatures = higher pressures, and at some temperature (i suspect a very high one, since these can be shipped around without particular caution, and carriers abuse the hell out of packages). I'm not sure if they'd explode before the gasket softened and gave out, allowing the contents to leak out in a rapid, but non explosive, manner.