The feed-date is fetched from Google by using the Google AJAX Feed API.
So the performance relies heavily on Google. The pageload should only be affected in a minimal way.
However, as the widget relies heavily on remote data and the performance of remote servers hosting the feeds, it may happen that you will suffer from poor performance from time to time. In those cases you can deactivate the display of the date-information at the options-panel.