Joely Richardson said no agent would take her on after turning 50