Appending into associative arrays

I want to sort directories according there modification time and thought accociative arrays would be perfect. But when I add an element like $dirs = array (filemtime($d) => $d) the previous ones are lost. I tried array_push but that doesn't seems to work, at least I always get syntax errors. Next try was array_merge(array (...)). So what next? O. Wyss