Req #69042 [Com]: Regular snapshot builds of php/php-src

Edit report at https://bugs.php.net/bug.php?id=69042&edit=1 ID: 69042 Comment by: jacob@php.net Reported by: hiro+php at travis-ci dot org Summary: Regular snapshot builds of php/php-src Status: Assigned Type: Feature/Change Request Package: *General Issues Operating System: N/A PHP Version: master-Git-2015-02-12 (snap) Assigned To: jacob Block user comment: N Private report: N New Comment: Hey, Apologies on the delay in getting back to you on this - I've had a tough time trying to get all of the right people online at the same time! Thanks for those usage stats, they came in handy. I haven't been able to get a definite answer on the uploading the php/php-src build artifact to another source for download and from the feedback I received, it wasn't something people were interested in using (for the development team anyway). Outside of the internals team, the nightly build probably isn't something we would be encouraging people to use as it's sometimes quite unstable and prone to breakage. I would still like to probe further into this one as I can see benefit however I'm not sure when, if ever, this would be implemented so I would rather not leave this ticket lingering. Are you ok for me to close this one off? Or do you have further questions? NB: The references to http://snaps.php.net have been removed from across the PHP site to eliminate any further confusion. Previous Comments: ------------------------------------------------------------------------ [2015-02-14 22:12:23] hiro+php at travis-ci dot org Hi, Jacob, We compile all other versions with php-build at image provisioning time, so we are all set for those. The bandwidth requirement is a bit hard to estimate; it depends on how popular "php 7 nightly" is going to be. Currently, on .org (for public repositories) we run about 10000 PHP builds over the course of a calendar month. Of these, I believe about 25% include builds with 5.6, which seems a good upper bound for what we can expect to have for the "php 7 nightly". We run slightly fewer PHP builds on .com, but I suspect that demands for the bleeding edge versions are a lot less (almost negligible, even) there. The archive is about 18MB, That adds up to about 450 GB of bandwidth in a month. Let's say 500 GB to overestimate the cost. Do note that about 1/3 of the builds mentioned above seem to be running on the new container builds on EC2, so if we put stuff on S3, we'll save some bandwidth. ------------------------------------------------------------------------ [2015-02-14 05:58:45] jacob@php.net > Thanks for looking into it. Our needs are limited; at the moment, we only need > an archive for Ubuntu Precise (also on Trusty in the near future) on x86_64. > (And I don't see this expanding much before PHP 7 is released.) Could you use the 5.4[1] and 5.5[2] PPA's for Precise (and down the track Trusty)? Or would you only be interested in the source? If you use apt-get, you could look at using an apt cacher to only download it once but serve to multiple builds and save bandwidth. > Since php/php-src is building on Travis CI already, one thing we can try is to > upload the resulting archive to a place where Travis (and perhaps some brave > souls among your user base) can download subsequently. Sure! Let me shoot out an email to the internals and see whether it's something everyone can see some benefit in adding. In doing this, we may also get some insight for your next point. > Do you have a place suitable for such storage? I am not sure on as most mirrors for PHP are sponsored so I would need to investigate what is involved in getting this setup. Do you know what sort of bandwidth this would consume? [1]: https://launchpad.net/~ondrej/+archive/ubuntu/php5-oldstable [2]: https://launchpad.net/~ondrej/+archive/ubuntu/php5 ------------------------------------------------------------------------ [2015-02-14 03:40:10] hiro+php at travis-ci dot org (I changed the PHP version inadvertently) ------------------------------------------------------------------------ [2015-02-14 03:36:51] hiro+php at travis-ci dot org Hi, Jacob, Thanks for looking into it. Our needs are limited; at the moment, we only need an archive for Ubuntu Precise (also on Trusty in the near future) on x86_64. (And I don't see this expanding much before PHP 7 is released.) Since php/php-src is building on Travis CI already, one thing we can try is to upload the resulting archive to a place where Travis (and perhaps some brave souls among your user base) can download subsequently. One can deploy via S3 (http://docs.travis-ci.com/user/deployment/s3/), Google Cloud Storage (http://docs.travis-ci.com/user/deployment/gcs/), or a custom "after_success" section (http://docs.travis-ci.com/user/deployment/custom/). One can also use artifacts (http://docs.travis-ci.com/user/uploading-artifacts/) to upload to S3. Do you have a place suitable for such storage? The upload setup is easy, and I'm willing to work on a PR. The hard part is to find a place for it. ------------------------------------------------------------------------ [2015-02-14 03:16:46] jacob@php.net > While it seems to work (as far as compilation goes; this doesn't include other > modules or phpunit we offer in other PHP versions), but it adds significant > amount of time (10+ minutes). This is definitely less than ideal as this could quickly blow out to a long build if you need to be doing this for multiple versions of PHP. > It would be great if a precompiled binary package of reasonably recent > development version existed. There are precompiled versions out in the wild however they vary from distribution to distribution and having a single source for this would be a huge maintainance task. After some discussions it would appear the reasoning behind removing http://snaps.php.net was because there are better alternatives available and it isn't worth the maintenance involved in keeping it running. I've also discovered that http://php.net/releases contains historical releases (don't think this solves any issues though - it's more of a heads up). I'm not sure where to go from here with this as it doesn't look like http://snaps.php.net will be coming back and we haven't got any closer to a solution. What do you think? ------------------------------------------------------------------------ The remainder of the comments for this report are too long. To view the rest of the comments, please view the bug report online at https://bugs.php.net/bug.php?id=69042 -- Edit this bug report at https://bugs.php.net/bug.php?id=69042&edit=1