I would definitely do a partial water change every week, especially since you have 2 of them. They're messy!

You don't have to empty the entire tank though. The filter seems small, but since you say you have 2 of them, I'm assuming they're doing a better job together. Eventually you'll want a larger tank and some sort of canister filter.