Can the PHP binaries be moved through different folders on Linux/OSX?

As most of you know, on Windows PHP does not require any specific path to run, and can be places in any path you want. Now, I'm planning to do a similar thing on Linux, and later OS X, which both will work the same. Now, my question: because autoconf requires prefixes for installation, will using the prefix like /home/user/temp/php, and later moving to another location, work correctly? If not, what problems can I expect? -- Bas