I think it depends on where you are flying, if I am on private property and fly 6000 feet away it is not irresponsible, as far as against the law…FAA is not going to chase you down on your or a friends property, I have flown over 6000 feet away on my property in NC before I have to turn around, I start at 100 ft. up (2300' above sea level) and then follow terrain features on the screen. At 6000 ft. I am not off our property, I do have an aftermarket antenna.
Flying responsibly is the key, VLOS is a rule the FAA enacted, if you hit someone or something then they can say you were in violation of the rule.
There are other places you can legally fly and be responsible beyond VLOS, flying a warehouse or a house and turn a corner you are out of VLOS, to my knowledge in the US the FAA has not started VLOS fines, I lose track of the little Spark at a few hundred feet.
Next time I go to NC I plan to push the limit on the distance, there is just no place in FL to do it safely and responsibly.