I don't know why it works like that, but you can prevent it by adding this code to the <head> section of your website:
<meta name="robots" content="noodp,noydir" />
That code will prevent it from pulling information from DMOZ or the Yahoo! Directory.