The music superstar attended Easter service at one of Atlanta’s famed churches.