Heidi,
A police scanner can not be tracked in a traditional sense since it only receives information. It would be like tracking someone who is listening to their FM radio. I suppose you could track the electronic inteference emitted from the scanner, but you would already have to be awful close to pick it up.
As far as police radios that can receive and transmit information, those could be tracked. But it is unlikely that either a scanner or police radio would work at the "cabin" since that describes a remote area and there may not be radio towers in the area (but not impossible).
Anything electronic that receives and/or emits electonic signals is susceptible to radio inteference, which means it could be tracked. From which distance the tracking can be started is another matter and probably better left up to an expert, but, again, I would say you would have to be close.
GPS is probably your better route. Whether it be a mobile phone, vehicle mapping or I think even satellite radio, I think you can get your story to go where you need. Whether the phone needs to be on or off shouldn't be addressed here.
Integrity is doing the right thing even when people aren't looking.