You know, this would actually be rad if the DM started using it as a plot point. Extra-dimensional police start hunting the PC for multiverse-level crimes, or some dunamancer in another reality kills an NPC in the PCs’ reality to heal one of their friends, and the PCs have to do some dimension-hopping to hunt them down and get them to stop.