To swipe on the trackpad to open the Charms and App tray, you have to swipe onto the trackpad. Start with your finger on the fabric, and swipe onto the trackpad, then release.
Touch select?
As for the pen, I find the pen loop to be a pretty poor solution and don't like the way it looks. I keep...