Yes, you need to fix the possible "tunnels" that rats go into your house and also you probably want to use extermination services.
I had rats in my house a few years ago as they came in from the hole for the heating system. They multiply fast. Act fast... Find one with garantee so that they come back to make sure everything is ok.