It actually can be Surface 3 specific. I have found that IE 11 cannot handle heavy scripts pulling remote content and displaying ads on websites such as cnn.com without hanging with lots of lag and long running script and browser not responding warnings that a Surface Pro 3 might be able to power through without a problem.
Just because a web page works one way in a browser on a Surface Pro 3, it doesn't mean it will perform the same on Surface 3.
Chrome works better on somethings and IE works better on others.
CNN.com doesn't hang on Chrome on a Surface 3 like IE 11 does, but IE 11 handles other things better such as playing 4k videos on youtube. A Surface Pro may play 4K video fine on both browsers.
On the sites that IE 11 can handle without crashing on, it may use less RAM, CPU and battery than opening the same sites in Chrome.