I've been doing this for years and years. The main problem is that the mat gets wet in the canoe and then isn't much fun to kneel or sit on and it also picks up a lot of sand.
KUIU's Pro Pant in Verde Camo features densely-woven Primeflex fabric, behind-the-ankle seams & knee protection that's great for all-seasons & terrains.