Can people living at my address affect my score?

Living with someone doesn’t make them a financial association. You're only ever financially associated to someone if you've applied for a joint credit account with them, or if you share a joint financial account with them.