Bhagavata Purana 11.21.17

The same activities that would degrade an elevated person do not cause falldown for those who are already fallen. Indeed, one who is lying on the ground cannot possibly fall further. The material association that is dictated by one’s own nature is considered a good quality.