Yes, you might end up in the middle of nowhere with a punctured tyre. Rocks, water, pebbles, muck, you might end up calling anything under your tyres, road. However, what is almost always certain is that you will find yourself amidst beautiful, unfamiliar lands with breath-taking scenery.
Sticking to main roads and highways will definitely get you to your destination safe and sound. But it won’t give you something to take back from the trip.
Bottom line, if you see a mysterious and interesting looking route, take the risk and go for it! You never know what is out there and trust me it will be totally worth it.