Generally speaking you will need permission every time you use a “substantial part” of another work. This does not mean that the part needs to be large; the law looks to the importance of the part to the entire work. A very small part of a song can be substantial. It is therefore advisable to seek permission whenever you sample another song, no matter how small the part may be.