It is only only crucial that you keep track of what search terms you used, which databases you searched with what combinations of terms, etc. - but you also need to keep track of your search results right from the start.
This is where RefWorks comes in as your new BFF.