Prepare 2.0.12

- re2c is upgraded manually to 1.0.2

.gitattributes

@@ -0,0 +1,7 @@
+*.m4  text eol=lf
+*.awk text eol=lf
+*.c   text eol=lf
+*.h   text eol=lf
+*.php text eol=lf
+*.json text eol=lf
+*.md text eol=lf

.gitignore

@@ -4,6 +4,7 @@ php55
 php56
 php70
 php71
+php72
 phpmaster
 php
 !lib/php
@@ -18,3 +19,4 @@ oracle
 # either these two become submodules, or uncomment them
 #pgo-build
 #rmtools*
+phpsdk-local.bat

LICENSE

@@ -0,0 +1,9 @@
+Copyright 2017 Anatol Belski
+
+Redistribution and use in source and binary forms, with or without modification, are permitted provided that the following conditions are met:
+
+1. Redistributions of source code must retain the above copyright notice, this list of conditions and the following disclaimer.
+
+2. Redistributions in binary form must reproduce the above copyright notice, this list of conditions and the following disclaimer in the documentation and/or other materials provided with the distribution.
+
+THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.

README.md

@@ -1,110 +1,118 @@
-# PHP SDK
-
-PHP SDK is a tool kit for Windows PHP builds
-
-# License
-
-The PHP SDK itself and the SDK own tools are licensed under the BSD 2-Clause license. With the usage of the other tools, you accept the respective licenses.
-
-# Overview
-
-The PHP SDK 2.0 is compatible with PHP 7.0 and above. The compatibility with older versions, eq. php-sdk-binary-tools-20110915.zip available from windows.php.net previously, is kept. Though, some irrelevant tools was removed. Newer tools are now available, better workflows are now possible. The toolset consists on a mix of the hand written scripts, selected MSYS2 parts and standalone programs.
-
-# Requirements
-
-- `Visual C++ 2015` must be installed prior SDK usage
-- if `Cygwin` is installed, please read notes in the pitfalls section
-- if a 64-bit build is intended, a 64-bit system is required. Cross compilation of 64-bit on 32-bit system is not supported at the moment
-
-# Tools
-
-All the tools included are either scripts or 32-bit binaries. They are therefore runable on any of x86 or x64 Windows system.
-
-## SDK
-
-- starter scripts, named phpsdk-<crt>-<arch>.bat
-- `phpsdk_buildtree` - initialize the development filesystem structure
-- `phpsdk_deps`      - handle dependency libraries
-- `phpsdk_version`   - show SDK version
-- `phpsdk_dllmap`    - create a JSON listing of DLLs contained in zip files
-- `task.exe`         - wrapper to hide the given command line
-
-## Other tools
-
-- `bison` 3.0.2, `re2c` 0.15.3
-- `awk`, `gawk`, `sed`, `grep`
-- `diff`, `diff3`, `patch`
-- `md5sum`, `sha1sum`, `sha224sum`, `sha256sum`, `sha384sum`, `sha512sum`
-- `7za`, `zip`, `unzip`, `unzipsfx`
-- `wget`
-
-## Optional, not included
-
-These are not included with the PHP SDK, but might be useful. While Visual C++ is the only required, the others might enable some additional functionality. Care yourself about making them available on your system, if relevant.
-
-- `Git`        - useful for PHP source management
-- `Cppcheck`   - used for static analysis
-- `clang`      - useful for experimental builds and for static analysis
-- `ICC`        - useful for experimental builds
-
-# Usage
-
-The PHP SDK should be unzipped into the shortest possible path, preferrably somewhere near the drive root.
-
-Usually, the first step to start the PHP SDK is by invoking one of the suitable starter scripts. This automatically puts the console on the correct environment relevant for the desired PHP build configuration.
-
-It is not required to hold the source in the PHP SDK directory. It could be useful, for example, to simplify the SDK updates.
-
-## Basic usage example
-
-- `git clone https://github.com/OSTC/php-sdk-binary-tools.git c:\php-sdk`
-- `cd c:\php-sdk`
-- `git checkout new_binary_tools`
-- either run or click on `phpsdk-vc14-x64.bat` in the PHP SDK root
-- `cd` to c:\php-sdk and click on `phpsdk-vc14-x64.bat` in the PHP SDK root
-- `phpsdk_buildtree phpmaster`
-- `git clone https://github.com/php/php-src.git && cd php-src`, or fetch a zipball
-- `phpsdk_deps --update --branch master`
-- do the build, eg. `buildconf && configure --enable-cli && nmake`
-
-TODO more extensive documentation on the wiki.
-
-## The old way
-
-- `git clone https://github.com/OSTC/php-sdk-binary-tools.git c:\php-sdk`
-- follow the instructions on the PHP [wiki page](https://wiki.php.net/internals/windows/stepbystepbuild "PHP wiki page")
-
-# Customizing
-
-## Custom environment setup
-
-A sript called phpsdk-local.bat has to be put into the PHP SDK root. If present, it will be automatically picked up by the starter script. A template for such a script is included with the PHP SDK. This allows to meet any required preparations, that are not foreseen by the standard PHP SDK startup. Be careful while creating your own phpsdk-local. It's your responsibility to ensure the regular PHP SDK startup isn't broken after phpsdk-local was injected into the startup process.
-
-## Console emulator integration
-
-The starter scripts can be also easy integrated with the consoles other than standard cmd.exe. For the reference, here's an example ConEmu task
-
-`C:\php-sdk\phpsdk-vc14-x64.bat -cur_console:d:C:\php-sdk\php70\vc14\x64\php-src`
-
-## Unattended builds
-
-An elementary functionality to run unattended builds is included. See an example on how to setup a simple unattended build task in the doc directory.
-
-# Upgrading
-
-- backup phpsdk-local.bat
-- backup the source trees and any other custom files in the PHP SDK root
-- move the PHP SDK folder into trash
-- download, unpack and the new PHP SDK version under the same path
-
-# Extending
-
-The SDK tools are based on the KISS principle and should be kept so. Basic tools are implemented as simple batch script. The minimalistic `PHP` is available for internal SDK purposes. It can be used, if more complexity is required. If you have an idea for some useful tool or workflow, please open a ticket or PR, so it can be discussed, implemented and added to the SDK. By contributing an implementation, you should also accept the SDK license.
-
-# Pitfalls
-
-- SDK or PHP sources put into paths including spaces might cause issue.
-- SDK or PHP sources put into too long paths, will cause an issue.
-- If Cygwin is installed, it might cause issues. If it's unavoidable, to have Cygwin on the same machine, ensure SDK preceeds it on the PATH.
-- Tools, based on MSYS2, only accept paths with forward slashes.
-
+# PHP SDK
+
+PHP SDK is a tool kit for Windows PHP builds
+
+# License
+
+The PHP SDK itself and the SDK own tools and code are licensed under the BSD 2-Clause license. With the usage of the other tools, you accept the respective licenses.
+
+# Overview
+
+The PHP SDK 2.0 is compatible with PHP 7.0 and above. The compatibility with [older versions](http://windows.php.net/downloads/php-sdk/php-sdk-binary-tools-20110915.zip "php-sdk-binary-tools-20110915.zip") is kept, also available from the [legacy branch](https://github.com/OSTC/php-sdk-binary-tools/tree/legacy). The toolset was significantly revamped. Newer tools are now available, better workflows are now possible. The toolset consists on a mix of the hand written scripts, selected MSYS2 parts and standalone programs. 
+
+# Requirements
+
+- `Visual C++ 2015` or `Visual C++ 2017` must be installed prior SDK usage
+- if `Cygwin` is installed, please read notes in the pitfalls section
+- if a 64-bit build is intended, a 64-bit system is required. Cross compilation of 64-bit on 32-bit system is not supported at the moment
+- The PHP SDK was successfully tested on Windows 7 or later, earlier versions might work but are not recommended
+
+# Tools
+
+All the tools included are either scripts or 32-bit binaries. They are therefore runable on any of x86 or x64 supported Windows system.
+
+## SDK
+
+- starter scripts, named phpsdk-<crt>-<arch>.bat
+- `phpsdk_buildtree` - initialize the development filesystem structure
+- `phpsdk_deps`      - handle dependency libraries
+- `phpsdk_version`   - show SDK version
+- `phpsdk_dllmap`    - create a JSON listing of DLLs contained in zip files
+- `task.exe`         - wrapper to hide the given command line
+
+## Other tools
+
+- `bison` 3.0.4, `re2c` 1.0.2, `lemon`
+- `awk`, `gawk`, `sed`, `grep`
+- `diff`, `diff3`, `patch`
+- `md5sum`, `sha1sum`, `sha224sum`, `sha256sum`, `sha384sum`, `sha512sum`
+- `7za`, `zip`, `unzip`, `unzipsfx`
+- `wget`, `pwgen`
+
+## Optional, not included
+
+These are not included with the PHP SDK, but might be useful. While Visual C++ is the only required, the others might enable some additional functionality. Care yourself about making them available on your system, if relevant.
+
+- `Git`        - useful for PHP source management
+- `Cppcheck`   - used for static analysis
+- `clang`      - useful for experimental builds and for static analysis
+- `ICC`        - useful for experimental builds
+
+# Usage
+
+The PHP SDK should be unzipped into the shortest possible path, preferrably somewhere near the drive root.
+
+Usually, the first step to start the PHP SDK is by invoking one of the suitable starter scripts. This automatically puts the console on the correct environment relevant for the desired PHP build configuration.
+
+It is not required to hold the source in the PHP SDK directory. It could be useful, for example, to simplify the SDK updates.
+
+## Basic usage example
+
+- `git clone https://github.com/OSTC/php-sdk-binary-tools.git c:\php-sdk`
+- `cd c:\php-sdk`
+- `git checkout php-sdk-2.0.0` or later
+- invoke `phpsdk-vc15-x64.bat`
+- `phpsdk_buildtree phpmaster`
+- `git clone https://github.com/php/php-src.git && cd php-src`, or fetch a zipball
+- `phpsdk_deps --update --branch master`, use PHP-X.Y for a non master branch
+- do the build, eg. `buildconf && configure --enable-cli && nmake`
+
+More extensive documentation can be found on the [wiki](https://wiki.php.net/internals/windows/stepbystepbuild_sdk_2 "PHP wiki page").
+
+## The old way
+
+- `git clone https://github.com/OSTC/php-sdk-binary-tools.git c:\php-sdk`
+- follow the instructions on the PHP [wiki page](https://wiki.php.net/internals/windows/stepbystepbuild "PHP wiki page")
+
+# Customizing
+
+## Custom environment setup
+
+A sript called phpsdk-local.bat has to be put into the PHP SDK root. If present, it will be automatically picked up by the starter script. A template for such a script is included with the PHP SDK. This allows to automatically meet any required preparations, that are not foreseen by the standard PHP SDK startup. Be careful while creating your own phpsdk-local. It's your responsibility to ensure the regular PHP SDK startup isn't broken after phpsdk-local.bat was injected into the startup sequence.
+
+## Console emulator integration
+
+The starter scripts can be also easy integrated with the consoles other than standard cmd.exe. For the reference, here's an example ConEmu task
+
+`C:\php-sdk\phpsdk-vc14-x64.bat -cur_console:d:C:\php-sdk\php70\vc14\x64\php-src`
+
+## Unattended builds
+
+An elementary functionality to run unattended builds is included. See an example on how to setup a simple unattended build task in the doc directory.
+
+# Upgrading
+
+- backup phpsdk-local.bat
+- backup the source trees and any other custom files in the PHP SDK root, if any present
+- move the PHP SDK folder into trash
+- download, unpack and the new PHP SDK version under the same path
+- move the custom files back in their respective places
+
+If the PHP SDK is kept as a git checkout, merely what is needed instead is to git fetch and to checkout an updated git tag.
+
+# Extending
+
+The SDK tools are based on the KISS principle and should be kept so. Basic tools are implemented as simple batch script. The minimalistic `PHP` is available for internal SDK purposes. It can be used, if more complexity is required. If you have an idea for some useful tool or workflow, please open a ticket or PR, so it can be discussed, implemented and added to the SDK. By contributing an implementation, you should also accept the SDK license.
+
+# Pitfalls
+
+- SDK or PHP sources put into paths including spaces might cause issue.
+- SDK or PHP sources put into too long paths, will cause an issue.
+- If Cygwin, MSYS2 or MinGW flavors are exposed in global PATH, it might cause issues. If it's unavoidable, ensure SDK preceeds it on the PATH.
+- When fetching the binary SDK from git, git `core.autocrlf` configuration directive set to `false` is recommended.
+- Tools, based on MSYS2, only accept paths with forward slashes.
+- Both Visual C++ toolset and the Windows SDK components have to be installed for the PHP SDK to work properly. 
+- The VC++ toolset is still requried, even if another compiler, fe. clang, is intended to be used.
+- task.exe is not a console application, some systems might not propagate exit code except the batch is explicitly run from `cmd /c`, etc.
+
+

VERSION

@@ -1 +1 @@
-2.0.0alpha5
+2.0.12

bin/php/do_php.bat

@@ -1,3 +1,3 @@
 @echo ofF
 
-%~dp0php.exe -c %~dp0php.ini -d extension_dir=%~dp0ext %*
+%~dp0php.exe -c %~dp0php.ini -d curl.cainfo=%PHP_SDK_ROOT_PATH%\msys2\usr\ssl\cert.pem -d extension_dir=%~dp0ext %*

bin/php/php.ini

@@ -3,4 +3,10 @@ extension=php_curl.dll
 extension=php_ftp.dll
 extension=php_sqlite3.dll
 extension=php_openssl.dll
-memory_limit=1G
+extension=php_mbstring.dll
+extension=php_mysqli.dll
+memory_limit=1G
+
+error_reporting=-1
+display_errors=1
+display_startup_errors=1

bin/phpsdk_buildtree.bat

@@ -7,6 +7,8 @@ IF "%2" EQU ""   SET _=%CD%\%1
 rem if we're in the starter script shell, create the only struct that corresponds to the current env
 rem otherwise - retain the old behavior, create structs for all the known build combinations and don't cd
 
+cmd /c "exit /b 0"
+
 if "%PHP_SDK_ARCH%" NEQ "" (
 	if "%PHP_SDK_VC%" NEQ "" (
 		MD %_%\%PHP_SDK_VC%\%PHP_SDK_ARCH%\deps\bin
@@ -35,3 +37,5 @@ echo phpsdk_buildtree ^<nameofthetree^> [PATH]
 echo  Create the common directory structure used by the PHP SDK
 
 :EXIT
+exit /b %errorlevel%
+

bin/phpsdk_deps.bat

@@ -1,5 +1,7 @@
 @echo off
 
+cmd /c "exit /b 0"
+
 if "%PHP_SDK_PHP_CMD%"=="" (
 	call %~dp0phpsdk_setvars.bat
 	if "!PHP_SDK_PHP_CMD!"=="" (
@@ -10,5 +12,5 @@ if "%PHP_SDK_PHP_CMD%"=="" (
 
 call %PHP_SDK_PHP_CMD% %PHP_SDK_BIN_PATH%\phpsdk_deps.php %*
 
-exit /b
+exit /b %errorlevel%
 

bin/phpsdk_deps.php

@@ -2,10 +2,9 @@
 
 include dirname(__FILE__) . "/../lib/php/libsdk/autoload.php";
 
-use SDK\Config;
-use SDK\Exception;
+use SDK\{Config, Exception};
 
-$sopt = "s:cuhb:a:d:t:";
+$sopt = "s:cuhb:a:d:t:fnp";
 $lopt = array(
 	"branch:",
 	"update",
@@ -15,6 +14,9 @@ $lopt = array(
 	"crt:",
 	"help",
 	"deps:",
+	"force",
+	"no-backup",
+	"pack",
 );
 
 $cmd = NULL;
@@ -22,9 +24,13 @@ $stability = NULL;
 $arch = NULL;
 $branch = NULL;
 $crt = NULL;
+$force = false;
+$backup = true;
 
 try {
 
+	$branch = NULL;
+
 	$opt = getopt($sopt, $lopt);
 	foreach ($opt as $name => $val) {
 		switch ($name) {
@@ -39,22 +45,18 @@ try {
 
 			case "b":
 			case "branch":
+				/* Branch config depends on other information. We can set it
+					right away, because the option order can't be  guaranteed. */
 				$branch = $val;
 				break;
 
 			case "s":
 			case "stability":
-				if ("stable" != $val && "staging" != $val) {
-					throw new Exception("Unknown stability keyword, either stable or staging is accepted");
-				}
 				Config::setCurrentStabilityName($val);
 				break;
 
 			case "a":
 			case "arch":
-				if ("x64" != $val && "x86" != $val) {
-					throw new Exception("Unknown arch keyword, either x86 or x64 is accepted");
-				}
 				Config::setCurrentArchName($val);
 				break;
 
@@ -76,84 +78,57 @@ try {
 			case "crt":
 				Config::setCurrentCrtName($val);
 				break;
+
+			case "f":
+			case "force":
+				$force = true;
+				break;
+
+			case "n":
+			case "no-backup":
+				$backup = false;
+				break;
+
+			case "p":
+			case "pack":
+				$cmd = "pack";
+				break;
 		}
 	}
 
+	if (NULL == $branch) {
+		$branch = Config::guessCurrentBranchName();
+		if (NULL == $branch) {
+			throw new Exception("Couldn't determine current branch name, expect an explicit input.");
+		}
+	}
+	Config::setCurrentBranchName($branch);
+
 	if (NULL === $cmd) {
 		usage();
 	}
 
-	if (!Config::getDepsLocalPath()) {
-		if (file_exists("../deps")) {
-			Config::setDepsLocalPath(realpath("../deps"));
-		} else if (file_exists("main/php_version.h")) {
-			/* Deps dir might not exist. */
-			Config::setDepsLocalPath(realpath("..") . DIRECTORY_SEPARATOR . "deps");
-		} else {
-			usage(3);
-		}
+	if (NULL === Config::getDepsLocalPath()) {
+		usage(3);
 	}
 
-	if ($branch) {
-		Config::setCurrentBranchName($branch);
-	}
-	if (!Config::getCurrentBranchName()) {
-		/* Try to figure out the branch. For now it only works if CWD is in php-src. */
-		$fl = "main/php_version.h";
-		if (file_exists($fl)) {
-			$s = file_get_contents($fl);
-			$major = $minor = NULL;
-
-			if (preg_match(",PHP_MAJOR_VERSION (\d+),", $s, $m)) {
-				$major = $m[1];
-			}
-			if (preg_match(",PHP_MINOR_VERSION (\d+),", $s, $m)) {
-				$minor = $m[1];
-			}
-
-			if (is_numeric($major) && is_numeric($minor)) {
-				Config::setCurrentBranchName("$major.$minor");
-			} else {
-				usage(3);
-			}
-		} else {
-			usage(3);
-		}
+	$branch = Config::getCurrentBranchName();
+	if (NULL == $branch) {
+		usage(3);
 	}
 
-	if (NULL === Config::getCurrentArchName()) {
-		/* XXX this might be not true for other compilers! */
-		passthru("where cl.exe >nul", $status);
-		if (!$status) {
-			exec("cl.exe /? 2>&1", $a, $status);
-			if (!$status) {
-				if (preg_match(",x64,", $a[0])) {
-					Config::setCurrentArchName("x64");
-				} else {
-					Config::setCurrentArchName("x86");
-				}
-			} else {
-				usage(3);
-			}
-		} else {
-			usage(3);
-		}
-		$arch = Config::getCurrentArchName();
+	$arch = Config::getCurrentArchName();
+	if (NULL === $arch) {
+		usage(3);
 	}
 
 	if (NULL === Config::getCurrentCrtName()) {
-		$all_branches = Config::getKnownBranches();
-
-		if (!isset($all_branches[Config::getCurrentBranchName()])) {
-			throw new Exception("Couldn't find any configuration for branch '" . Config::getCurrentBranchName() . "'");
-		}
-
-		$branch = $all_branches[Config::getCurrentBranchName()];
-		if (count($branch) > 1) {
-			throw new Exception("Multiple CRTs are available for this branch, please choose one from " . implode(",", array_keys($branch)));
-		} else {
-			Config::setCurrentCrtName(array_keys($branch)[0]);
-		}
+		usage(3);
+	}
+	/* The current CRT needs to match the config one. */
+	$active_crt = getenv("PHP_SDK_VC");
+	if (Config::getCurrentCrtName() != $active_crt && !$force) {
+		throw new Exception("Active CRT '$active_crt' differs from the branch CRT '" . Config::getCurrentCrtName() . "'.");
 	}
 
 	if (NULL === Config::getCurrentStabilityName()) {
@@ -168,7 +143,7 @@ try {
 	echo "\nConfiguration: " . Config::getCurrentBranchName() . "-$branch_data[crt]-$branch_data[arch]-$branch_data[stability]\n\n";
 
 	/* Let the dep manager to run the command. */
-	$dm = new SDK\Dependency\Manager(Config::getDepsLocalPath(), $branch_data["stability"], $branch_data["arch"]);
+	$dm = new SDK\Build\Dependency\Manager(Config::getDepsLocalPath(), $branch_data["stability"], $branch_data["arch"]);
 	switch ($cmd) {
 		default:
 			throw new Exception("Unknown command '$cmd'");
@@ -182,9 +157,22 @@ try {
 			}
 			break;
 		case "update":
-			$dm->performUpdate($msg);
+			if ($force) {
+				print "Replacing the current deps by the force option.\n\n";
+			}
+			$dm->performUpdate($msg, $force, $backup);
 			msg($msg);
 			break;
+		case "pack":
+			$path_to_pack = Config::getDepsLocalPath();
+			$pack_path = dirname($path_to_pack) . DIRECTORY_SEPARATOR . "deps-$branch-$branch_data[crt]-$branch_data[arch].7z";
+			print "Packaging '$path_to_pack' as '$pack_path'.\n\n";
+			if ($force && is_file($pack_path)) {
+				unlink($pack_path);
+			}
+			system("7za a $pack_path $path_to_pack", $st);
+			exit((int)$st);
+			break;
 	}
 
 } catch (Throwable $e) {
@@ -199,15 +187,18 @@ function usage(int $code = -1)
 	echo "PHP SDK dependency handling tool.", PHP_EOL;
 	echo "Usage: ", PHP_EOL, PHP_EOL;
 	echo "Configuration:", PHP_EOL;
-	echo "  -b --branch    Branch name, eg. 7.0, 7.1, etc. If omited, CWD is used to guess.", PHP_EOL;
+	echo "  -b --branch    Branch name, eg. 7.0, 7.1, etc. If omited, several guess methods apply.", PHP_EOL;
 	echo "  -a --arch      Architecture, x86 or x64. If omited, cl.exe is used to guess.", PHP_EOL;
 	echo "  -t --crt       CRT, marked by the corresponding VC++ version, eg. vc11, vc14, etc.", PHP_EOL;
 	echo "  -s --stability One of stable or staging.", PHP_EOL, PHP_EOL;
 	echo "Commands:", PHP_EOL;
 	echo "  -c --check     Check for dependency updates. If updates are available, the exit code is set to 7.", PHP_EOL;
-	echo "  -u --update    Update dependencies. If deps directory already exists, backup copy is created automatically.", PHP_EOL, PHP_EOL;
+	echo "  -u --update    Update dependencies. If deps directory already exists, backup copy is created automatically.", PHP_EOL;
+	echo "  -p --pack      Archive the dependency directory.", PHP_EOL, PHP_EOL;
 	echo "Misc:", PHP_EOL;
 	echo "  -d --deps      Path to the dependencies directory. If omited, CWD is used to guess.", PHP_EOL;
+	echo "  -f --force     Force the operation even if there are no upgrades available.", PHP_EOL;
+	echo "  -n --no-backup Replace the current dependencies without creating backup.", PHP_EOL;
 	echo "  -h --help      Show help message.", PHP_EOL, PHP_EOL;
 	echo "Example: ", PHP_EOL;
 	echo "  phpsdk_deps -c -b master", PHP_EOL;

bin/phpsdk_dllmap.bat

@@ -1,5 +1,7 @@
 @echo off
 
+cmd /c "exit /b 0"
+
 if "%PHP_SDK_PHP_CMD%"=="" (
 	call %~dp0phpsdk_setvars.bat
 	if "!PHP_SDK_PHP_CMD!"=="" (
@@ -10,5 +12,5 @@ if "%PHP_SDK_PHP_CMD%"=="" (
 
 call %PHP_SDK_PHP_CMD% %PHP_SDK_BIN_PATH%\phpsdk_dllmap.php %*
 
-exit /b
+exit /b %errorlevel%
 

bin/phpsdk_dllmap.php

@@ -6,7 +6,7 @@
 	- create mappings between dll filename and zip filename
 
 	Usage:
-	php dllmap.php path0 [ path1 ... ] > dllmapping.json
+	php dllmap.php [--pretty] path0 [ path1 ... ] > dllmapping.json
 */
 
 
@@ -20,8 +20,25 @@
 	"C:\\tmp\\libs",
 );*/
 
+$sopt = "p";
+$lopt = array(
+	"pretty",
+);
+
+$flags = 0;
+$opt = getopt($sopt, $lopt);
+foreach ($opt as $name => $val) {
+	switch ($name) {
+			case "p":
+			case "pretty":
+				$flags = JSON_PRETTY_PRINT;
+				break;
+	}
+}
+
+
 $dirs = array();
-foreach (array_slice($_SERVER["argv"], 1) as $item) {
+foreach (array_slice($_SERVER["argv"], (0 == $flags ? 1 : 2)) as $item) {
 	if (file_exists($item) && is_dir($item)) {
 		$dirs[] = $item;
 	}
@@ -32,26 +49,7 @@ if (empty($dirs)) {
 	die;
 }
 
-
-$out = array(
-	"vc9" => array(
-		"x86" => array(),
-		"x64" => array(),
-	),
-	"vc11" => array(
-		"x86" => array(),
-		"x64" => array(),
-	),
-	"vc12" => array(
-		"x86" => array(),
-		"x64" => array(),
-	),
-	"vc14" => array(
-		"x86" => array(),
-		"x64" => array(),
-	),
-);
-
+$out = array();
 
 foreach ($dirs as $path) {
 	$dir = new DirectoryIterator($path);
@@ -74,6 +72,13 @@ foreach ($dirs as $path) {
 		$crt = $m[1];
 		$arch = $m[2];
 
+		if (!isset($out[$crt])) {
+			$out[$crt] = array();
+		}
+		if (!isset($out[$crt][$arch])) {
+			$out[$crt][$arch] = array();
+		}
+
 		$zip = new ZipArchive();
 
 		$zip->open($pathname);
@@ -100,7 +105,7 @@ foreach ($dirs as $path) {
 	}
 }
 
-echo json_encode($out);
+echo json_encode($out, $flags);
 
 /*
  * Local variables:

bin/phpsdk_dumpenv.bat

@@ -5,6 +5,10 @@ if "%PHP_SDK_OS_ARCH%"=="" (
 	exit /b 3
 )
 
+cmd /c "exit /b 0"
+
+echo.
+
 call %PHP_SDK_BIN_PATH%\phpsdk_version.bat
 echo.
 
@@ -20,9 +24,9 @@ if "%PHP_SDK_ARCH%"=="x64" (
 	echo Build architecture: 32-bit 
 )
 
-echo Visual C++:         %PHP_SDK_VC:~2%
-echo PHP-SDK path:       %PHP_SDK_PATH%
+echo Visual C++:         %PHP_SDK_VC_NUM%
+echo PHP-SDK path:       %PHP_SDK_ROOT_PATH%
 
 
-exit /b
+exit /b %errorlevel%
 

bin/phpsdk_setshell.bat

@@ -13,10 +13,34 @@ if "%1"=="-h" goto :help
 if "%1"=="--help" goto :help
 if "%2"=="" goto :help
 
-if /i not "%1"=="vc14" (
-		echo Unsupported runtime "%1"
-		goto out_error
+cmd /c "exit /b 0"
+
+set PHP_SDK_VC=%1
+if /i not "%PHP_SDK_VC:~0,2%"=="vc" (
+:malformed_vc_string
+	echo Malformed CRT string "%1"
+	set PHP_SDK_VC=
+	goto out_error
 )
+if ""=="%PHP_SDK_VC:~2%" (
+	goto malformed_vc_string
+)
+set /a TMP_CHK=%PHP_SDK_VC:~2%
+if 14 gtr %TMP_CHK% (
+	if "0"=="%TMP_CHK%" (
+		if not "0"=="%PHP_SDK_VC:~2%" (
+			set TMP_CHK=
+			goto malformed_vc_string
+		)
+	)
+
+	echo At least vc14 is required
+	set PHP_SDK_VC=
+	set TMP_CHK=
+	goto out_error
+)
+set PHP_SDK_VC_NUM=%TMP_CHK%
+set TMP_CHK=
 
 if /i not "%2"=="x64" (
 	if /i not "%2"=="x86" (
@@ -25,7 +49,6 @@ if /i not "%2"=="x64" (
 	)
 )
 
-set PHP_SDK_VC=%1
 set PHP_SDK_ARCH=%2
 
 rem check OS arch
@@ -43,41 +66,67 @@ if not errorlevel 1 (
 set TMPKEY=
 
 rem get vc base dir
-if /i "%PHP_SDK_OS_ARCH%"=="x64" (
-	set TMPKEY=HKLM\SOFTWARE\Wow6432Node\Microsoft\VisualStudio\%PHP_SDK_VC:~2%.0\Setup\VC
-) else (
-	set TMPKEY=HKLM\SOFTWARE\Microsoft\VisualStudio\%PHP_SDK_VC:~2%.0\Setup\VC
-)
-reg query !TMPKEY! /v ProductDir >nul 2>&1
-if errorlevel 1 (
-	echo Couldn't determine VC%PHP_SDK_VC:~2% directory
-	goto out_error;
-)
-for /f "tokens=2*" %%a in ('reg query !TMPKEY! /v ProductDir') do set PHP_SDK_VC_DIR=%%b
-set TMPKEY=
-
-rem get sdk dir
-if /i "%PHP_SDK_OS_ARCH%"=="x64" (
-	set TMPKEY=HKEY_LOCAL_MACHINE\SOFTWARE\Wow6432Node\Microsoft\Microsoft SDKs\Windows\v8.1
-) else (
-	set TMPKEY=HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Microsoft SDKs\Windows\v8.1
-)
-for /f "tokens=2*" %%a in ('reg query "!TMPKEY!" /v InstallationFolder') do (
-	if exist "%%b\Include\um\Windows.h" (
-		set PHP_SDK_WIN_SDK_DIR=%%b
+if 15 gtr %PHP_SDK_VC_NUM% (
+	if /i "%PHP_SDK_OS_ARCH%"=="x64" (
+		set TMPKEY=HKLM\SOFTWARE\Wow6432Node\Microsoft\VisualStudio\%PHP_SDK_VC:~2%.0\Setup\VC
+	) else (
+		set TMPKEY=HKLM\SOFTWARE\Microsoft\VisualStudio\%PHP_SDK_VC:~2%.0\Setup\VC
 	)
-)
-if not defined PHP_SDK_WIN_SDK_DIR (
-	echo Windows SDK not found.
-	goto out_error;
+	reg query !TMPKEY! /v ProductDir >nul 2>&1
+	if errorlevel 1 (
+		echo Couldn't determine VC%PHP_SDK_VC:~2% directory
+		goto out_error;
+	)
+	for /f "tokens=2*" %%a in ('reg query !TMPKEY! /v ProductDir') do set PHP_SDK_VC_DIR=%%b
+) else (
+	rem vc15 support only for now, could parse out and pass on later
+	for /f "tokens=1* delims=: " %%a in ('%~dp0\vswhere -nologo -version %PHP_SDK_VC_NUM% -requires Microsoft.VisualStudio.Component.VC.Tools.x86.x64 -property installationPath -format text') do set PHP_SDK_VC_DIR=%%b\VC
+	if not exist "!PHP_SDK_VC_DIR!" (
+		for /f "tokens=1* delims=: " %%a in ('%~dp0\vswhere -nologo -version %PHP_SDK_VC_NUM% -products Microsoft.VisualStudio.Product.BuildTools -requires Microsoft.VisualStudio.Component.VC.Tools.x86.x64 -property installationPath -format text') do set PHP_SDK_VC_DIR=%%b\VC
+		if not exist "!PHP_SDK_VC_DIR!" (
+			rem check for a preview release
+			for /f "tokens=1* delims=: " %%a in ('%~dp0\vswhere -nologo -version %PHP_SDK_VC_NUM% -prerelease -requires Microsoft.VisualStudio.Component.VC.Tools.x86.x64 -property installationPath -format text') do set PHP_SDK_VC_DIR=%%b\VC
+			if not exist "!PHP_SDK_VC_DIR!" (
+				echo Could not determine '%PHP_SDK_VC%' directory
+				goto out_error;
+			)
+		)
+	)
+	set VSCMD_ARG_no_logo=nologo
 )
 set TMPKEY=
 
+if 15 gtr %PHP_SDK_VC_NUM% (
+	rem get sdk dir
+	if /i "%PHP_SDK_OS_ARCH%"=="x64" (
+		set TMPKEY=HKEY_LOCAL_MACHINE\SOFTWARE\Wow6432Node\Microsoft\Microsoft SDKs\Windows\v8.1
+	) else (
+		set TMPKEY=HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Microsoft SDKs\Windows\v8.1
+	)
+	for /f "tokens=2*" %%a in ('reg query "!TMPKEY!" /v InstallationFolder') do (
+		if exist "%%b\Include\um\Windows.h" (
+			set PHP_SDK_WIN_SDK_DIR=%%b
+		)
+	)
+	if not defined PHP_SDK_WIN_SDK_DIR (
+		echo Windows SDK not found.
+		goto out_error;
+	)
+	set TMPKEY=
+)
 
 if /i "%PHP_SDK_ARCH%"=="x64" (
-	set PHP_SDK_VC_SHELL_CMD="!PHP_SDK_VC_DIR!\vcvarsall.bat" amd64
+	if 15 gtr %PHP_SDK_VC_NUM% (
+		set PHP_SDK_VC_SHELL_CMD="!PHP_SDK_VC_DIR!\vcvarsall.bat" amd64
+	) else (
+		set PHP_SDK_VC_SHELL_CMD="!PHP_SDK_VC_DIR!\Auxiliary\Build\vcvarsall.bat" amd64
+	)
 ) else (
-	set PHP_SDK_VC_SHELL_CMD="!PHP_SDK_VC_DIR!\vcvarsall.bat" x86
+	if 15 gtr %PHP_SDK_VC_NUM% (
+		set PHP_SDK_VC_SHELL_CMD="!PHP_SDK_VC_DIR!\vcvarsall.bat" x86
+	) else (
+		set PHP_SDK_VC_SHELL_CMD="!PHP_SDK_VC_DIR!\Auxiliary\Build\vcvarsall.bat" x86
+	)
 )
 
 rem echo Visual Studio path %PHP_SDK_VC_DIR%

bin/phpsdk_setvars.bat

@@ -1,19 +1,21 @@
 @echo off
 
+cmd /c "exit /b 0"
+
 rem Add necessary dirs to the path 
 
 set PHP_SDK_BIN_PATH=%~dp0
 rem remove trailing slash
 set PHP_SDK_BIN_PATH=%PHP_SDK_BIN_PATH:~0,-1%
 
-for %%a in ("%PHP_SDK_BIN_PATH%") do set PHP_SDK_PATH=%%~dpa
+for %%a in ("%PHP_SDK_BIN_PATH%") do set PHP_SDK_ROOT_PATH=%%~dpa
 rem remove trailing slash
-set PHP_SDK_PATH=%PHP_SDK_PATH:~0,-1%
+set PHP_SDK_ROOT_PATH=%PHP_SDK_ROOT_PATH:~0,-1%
 
-set PHP_SDK_MSYS2_PATH=%PHP_SDK_PATH%\msys2\usr\bin
+set PHP_SDK_MSYS2_PATH=%PHP_SDK_ROOT_PATH%\msys2\usr\bin
 set PHP_SDK_PHP_CMD=%PHP_SDK_BIN_PATH%\php\do_php.bat
 
 set PATH=%PHP_SDK_BIN_PATH%;%PHP_SDK_MSYS2_PATH%;%PATH%
 
-exit /b
+exit /b %errorlevel%
 

bin/phpsdk_version.bat

@@ -1,5 +1,7 @@
 @echo off
 
+cmd /c "exit /b 0"
+
 if "%PHP_SDK_PHP_CMD%"=="" (
 	call %~dp0phpsdk_setvars.bat
 	if "!PHP_SDK_PHP_CMD!"=="" (
@@ -8,7 +10,7 @@ if "%PHP_SDK_PHP_CMD%"=="" (
 	)
 )
 
-%PHP_SDK_PHP_CMD% -r "echo 'PHP SDK ' . file_get_contents(getenv('PHP_SDK_PATH') . '\\VERSION');"
+%PHP_SDK_PHP_CMD% -r "echo 'PHP SDK ' . file_get_contents(getenv('PHP_SDK_ROOT_PATH') . '\\VERSION');"
 
-exit /b
+exit /b %errorlevel%
 

doc/phpsdk-local.bat.example

@@ -1,5 +1,9 @@
 @echo off
 
+rem edit if PGO scripts are present and are to be used
+rem set PHP_SDK_PGO_TOOLS_ROOT_PATH=%PHP_SDK_ROOT_PATH%\pgo
+rem set PATH=%PHP_SDK_PGO_TOOLS_ROOT_PATH%\bin;%PATH%
+
 set PGSQL_TEST_CONNSTR=host=127.0.0.1 dbname=test port=5432 user=test password=test
 set PDO_PGSQL_TEST_DSN=pgsql:host=127.0.0.1 port=5432 dbname=test user=test password=test
 

doc/unattended-build-task.bat.example

@@ -6,12 +6,19 @@ rem Program/script: C:\php-sdk\bin\task.exe
 rem Add arguments: "C:\php-sdk\phpsdk-starter.bat -c vc14 -a x64 -t C:\php-sdk\unattended-build-task.bat"
 rem Run the task
 
+set LOG_NAME=%PHP_SDK_VC%-%PHP_SDK_ARCH%-task.log
+
 pushd C:\php-sdk\php70\vc14\x64\php-src
 
-git pull --rebase
+git pull --rebase > %LOG_NAME% 2>&1
 
-nmake clean
-nmake > vs.log 2>&1
+call phpsdk_deps -u -s staging >> %LOG_NAME% 2>&1
+
+call buildconf >> %LOG_NAME% 2>&1
+call configure --enable-snapshot-build --enable-debug-pack >> %LOG_NAME% 2>&1
+
+nmake clean >> %LOG_NAME% 2>&1
+nmake >> %LOG_NAME% 2>&1
 
 popd
 

lib/php/libsdk/SDK/Build/Dependency/Fetcher.php

@@ -1,12 +1,13 @@
 <?php
 
-namespace SDK\Dependency;
+namespace SDK\Build\Dependency;
 
-use SDK\Config;
-use SDK\Exception;
+use SDK\{Config, Exception, FileOps};
 
 class Fetcher
 {
+	use FileOps;
+
 	protected $host;
 	protected $port;
 	protected $stability;
@@ -27,7 +28,7 @@ class Fetcher
 		return $this->series;
 	}/*}}}*/
 
-	public function setSeries(Series $series)
+	public function setSeries(Series $series) : void
 	{/*{{{*/
 		$this->series = $series;
 	}/*}}}*/
@@ -37,13 +38,8 @@ class Fetcher
 	public function getByUri($uri) : string
 	{/*{{{*/
 		$url = "http://{$this->host}:{$this->port}$uri";
-		$s = file_get_contents($url);
 
-		if (false === $s) {
-			throw new Exception("failed to fetch $url");
-		}
-
-		return $s;
+		return $this->download($url);
 	}/*}}}*/
 
 	/*protected function fetch($uri) : string

lib/php/libsdk/SDK/Build/Dependency/Manager.php

@@ -1,11 +1,8 @@
 <?php
 
-namespace SDK\Dependency;
+namespace SDK\Build\Dependency;
 
-use SDK\Config;
-use SDK\Cache;
-use SDK\Exception;
-use SDK\FileOps;
+use SDK\{Config, Cache, Exception, FileOps, Lock};
 
 class Manager
 {
@@ -35,23 +32,33 @@ class Manager
 		$this->series = $series;
 	}/*}}}*/
 
-	protected function getTmpSeriesPath()
+	protected function getTmpSeriesPath() : string
 	{/*{{{*/
 		return Config::getTmpDir() . DIRECTORY_SEPARATOR . $this->series->getname();
 	}/*}}}*/
 
 	public function updatesAvailable() : bool
 	{/*{{{*/
-		return $this->series->updatesAvailable();
+		return $this->series->updatesAvailable() || !file_exists(Config::getDepsLocalPath());
 	}/*}}}*/
 
-	/* TODO and implement --force. */
 	/* FIXME implement rollback */
-	public function performUpdate(string &$msg = NULL)
+	public function performUpdate(string &$msg = NULL, bool $force = false, bool $backup = true) : void
 	{/*{{{*/
-		if (!$this->updatesAvailable()) {
-			$msg = "No updates are available";
-			return;
+		if (!$force) {
+			if (!$this->updatesAvailable()) {
+				$msg .= "No updates are available";
+				return;
+			}
+
+			$lock = new Lock(Config::getDepsLocalPath());
+			if (!$lock->locked()) {
+				$msg .= "Dependencies was updated by another process.";
+				echo "Another process is updating same dependency path. I'm just going to wait for it to finish and then exit.", PHP_EOL;
+				$lock->exclusive(true);
+				unset($lock);
+				return;
+			}
 		}
 
 		$series_data = $this->series->getData();
@@ -82,17 +89,32 @@ class Manager
 		}
 
 		if (file_exists($this->path)) {
-			$suffix = date("YmdHi");
-			$new_path = "{$this->path}.$suffix";
+			if ($backup) {
+				$suffix = date("YmdHi");
+				$new_path = "{$this->path}.$suffix";
 
-			/* This is fine, it's gonna be on the same drive. */
-			if (!$this->mv($this->path, $new_path)) {
-				throw new Exception("Unable to rename '{$this->path}' to '$new_path'");
+				/* This is fine, it's gonna be on the same drive. */
+				if (!$this->mv($this->path, $new_path)) {
+					if (!$force) {
+						unset($lock);
+					}
+					throw new Exception("Unable to rename '{$this->path}' to '$new_path'");
+				}
+			} else {
+				if (!$this->rm($this->path)) {
+					if (!$force) {
+						unset($lock);
+					}
+					throw new Exception("Unable to remove the current dependency dir at '{$this->path}'");
+				}
 			}
 		} else {
 			$up = dirname($this->path);
 			if (!file_exists($up)) {
 				if (!$this->md($up)) {
+					if (!$force) {
+						unset($lock);
+					}
 					throw new Exception("Unable to create '{$this->path}'");
 				}
 			}
@@ -106,9 +128,17 @@ class Manager
 		$this->series->cache();
 
 		/* save new series file, move the updated deps and backup the old ones, cleanup.*/
-		$msg = "Updates performed successfully. " . PHP_EOL;
-		if (isset($new_path)) {
-			$msg .= "Old dependencies backed up into '$new_path'.";
+		$msg .= "Updates performed successfully. " . PHP_EOL;
+		if ($backup) {
+			if (isset($new_path)) {
+				$msg .= "Old dependencies backed up into '$new_path'.";
+			}
+		} else {
+			$msg .= "No backup was created.";
+		}
+
+		if (!$force) {
+			unset($lock);
 		}
 	}/*}}}*/
 }

lib/php/libsdk/SDK/Build/Dependency/Package.php

@@ -1,6 +1,6 @@
 <?php
 
-namespace SDK\Dependency;
+namespace SDK\Build\Dependency;
 
 use SDK\Config;
 use SDK\Exception;
@@ -28,7 +28,7 @@ class Package
 		return "$base/{$branch_data['crt']}/$arch/{$this->name}";
 	}/*}}}*/
 
-	public function retrieve(string $path)
+	public function retrieve(string $path) : void
 	{/*{{{*/
 		$this->filepath = $path . DIRECTORY_SEPARATOR . $this->name;
 
@@ -39,7 +39,7 @@ class Package
 		fclose($fd);
 	}/*}}}*/
 
-	public function unpack(string $path)
+	public function unpack(string $path) : void
 	{/*{{{*/
 		if (!$this->filepath || !file_exists($this->filepath)) {
 			throw new Exception("Invalid filepath '{$this->filepath}'");
@@ -55,7 +55,7 @@ class Package
 		}
 	}/*}}}*/
 
-	public function cleanup()
+	public function cleanup() : void
 	{/*{{{*/
 		unlink($this->filepath);		
 	}/*}}}*/

lib/php/libsdk/SDK/Build/Dependency/Series.php

@@ -1,6 +1,6 @@
 <?php
 
-namespace SDK\Dependency;
+namespace SDK\Build\Dependency;
 
 use SDK\Config;
 use SDK\Cache;
@@ -27,7 +27,7 @@ class Series
 		return $this->fetcher;
 	}/*}}}*/
 
-	public function setFetcher(Fetcher $fetcher)
+	public function setFetcher(Fetcher $fetcher) : void
 	{/*{{{*/
 		$this->fetcher = $fetcher;
 	}/*}}}*/
@@ -37,7 +37,7 @@ class Series
 		return $this->arch;
 	}/*}}}*/
 
-	public function setArch(string $arch)
+	public function setArch(string $arch) : void
 	{/*{{{*/
 		$this->arch = $arch;
 	}/*}}}*/
@@ -52,7 +52,7 @@ class Series
 		return $file;
 	}/*}}}*/
 
-	protected function getUri() : string
+	protected function getUri() : string 
 	{/*{{{*/
 		$base = Config::getDepsBaseUri();
 		$file = $this->getName();
@@ -79,12 +79,12 @@ class Series
 		return $ret;
 	}/*}}}*/
 
-	public function getSavePath()
+	public function getSavePath() : string
 	{/*{{{*/
 		return Config::getCacheDir() . DIRECTORY_SEPARATOR . $this->getname();
 	}/*}}}*/
 
-	public function updatesAvailable()
+	public function updatesAvailable() : bool
 	{/*{{{*/
 		$series_data = $this->getData(true);
 		$series_file = $this->getSavePath();
@@ -92,7 +92,7 @@ class Series
 		return $this->cache->cachedContentDiffers($series_file, $series_data);
 	}/*}}}*/
 
-	public function cache(string $path = NULL)
+	public function cache(string $path = NULL) : void
 	{/*{{{*/
 		if (!$path) {
 			$path = $this->getSavePath();

lib/php/libsdk/SDK/Cache.php

@@ -36,6 +36,7 @@ class Cache
 		return file_exists($this->getCacheablePath($path, $relative));
 	}/*}}}*/
 
+	/* TODO Sometimes a timestamp comparison might make sense. */
 	public function cachedContentDiffers(string $path, string $content, bool $relative = false) : bool
 	{/*{{{*/
 		$p = $this->getCacheablePath($path, $relative);
@@ -50,16 +51,35 @@ class Cache
 		return $old_sum != $new_sum;
 	}/*}}}*/
 
-	public function cacheContent(string $path, string $content, bool $relative = false)
+	public function cacheContent(string $path, string $content, bool $relative = false) : void
 	{/*{{{*/
 		$p = $this->getCacheablePath($path, $relative);
 
-		if (strlen($content) !== file_put_contents($p, $content)) {
+		$to_write = strlen($content);
+		$wrote = 0;
+
+		$fd = fopen($p, "wb");
+
+		flock($fd, LOCK_EX);
+
+		do {
+			$got = fwrite($fd, substr($content, $wrote));
+			if (false == $got) {
+				break;
+			}
+			$wrote += $got;
+		} while ($wrote < $to_write);
+
+		flock($fd, LOCK_UN);
+
+		fclose($fd);
+
+		if ($to_write !== $wrote) {
 			throw new Exception("Couldn't cache '$p'");
 		}
 	}/*}}}*/
 
-	public function getCachedContent(string $path, bool $relative = false)
+	public function getCachedContent(string $path, bool $relative = false) : ?string
 	{/*{{{*/
 		$p = $this->getCacheablePath($path, $relative);
 
@@ -67,7 +87,7 @@ class Cache
 			return file_get_contents($p);
 		}
 
-		return "";
+		return NULL;
 	}/*}}}*/
 }
 

lib/php/libsdk/SDK/Config.php

@@ -2,7 +2,7 @@
 
 namespace SDK;
 
-use SDK\Dependency\Fetcher;
+use SDK\Build\Dependency\Fetcher;
 use SDK\Cache;
 use SDK\Exception;
 
@@ -39,33 +39,84 @@ class Config
 		return self::$depsBaseUri;
 	}/*}}}*/
 
-	public static function setCurrentArchName(string $arch)
+	public static function setCurrentArchName(string $arch) : void
 	{/*{{{*/
+		$arch = strtolower($arch);
+
+		if ("x64" != $arch && "x86" != $arch) {
+			throw new Exception("Unknown arch keyword, either x86 or x64 is accepted");
+		}
+
 		self::$currentArchName = $arch;
 	}	/*}}}*/
 
-	public static function getCurrentArchName() 
+	public static function getCurrentArchName() : string
 	{/*{{{*/
+		if (NULL === self::$currentArchName) {
+			/* XXX this might be not true for other compilers! */
+			passthru("where cl.exe >nul", $status);
+			if ($status) {
+				throw new Exception("Couldn't execute cl.exe.");
+			}
+
+			exec("cl.exe /? 2>&1", $out);
+
+			if (preg_match(",x64,", $out[0])) {
+				self::setCurrentArchName("x64");
+			} elseif (preg_match(",x86,", $out[0])) {
+				self::setCurrentArchName("x86");
+			} else {
+				throw new Exception("Couldn't determine Arch.");
+			}
+		}
+
 		return self::$currentArchName;
 	}	/*}}}*/
 
-	public static function setCurrentCrtName(string $crt)
+	public static function setCurrentCrtName(string $crt) : void
 	{/*{{{*/
 		self::$currentCrtName = $crt;
 	}	/*}}}*/
 
-	public static function getCurrentCrtName()
+	public static function getCurrentCrtName() : ?string
 	{/*{{{*/
+		if (NULL === self::$currentCrtName) {
+			$all_branches = Config::getKnownBranches();
+
+			if (!isset($all_branches[Config::getCurrentBranchName()])) {
+				throw new Exception("Couldn't find any configuration for branch '" . Config::getCurrentBranchName() . "'");
+			}
+
+			$branch = $all_branches[Config::getCurrentBranchName()];
+			if (count($branch) > 1) {
+				throw new Exception("Multiple CRTs are available for this branch, please choose one from " . implode(",", array_keys($branch)));
+			}
+
+			self::setCurrentCrtName(array_keys($branch)[0]);
+		}
+
 		return self::$currentCrtName;
 	}	/*}}}*/
 
-	public static function setCurrentStabilityName(string $stability)
+	public static function setCurrentStabilityName(string $stability) : void
 	{/*{{{*/
+		if ("stable" != $stability && "staging" != $stability) {
+			throw new Exception("Unknown stability keyword, either stable or staging is accepted");
+		}
+
 		self::$currentStabilityName = $stability;
 	}	/*}}}*/
 
-	public static function getCurrentStabilityName()
+	public static function getCurrentStabilityName() : ?string
 	{/*{{{*/
+		if (NULL === self::$currentStabilityName) {
+			if ("master" == Config::getCurrentBranchName()) {
+				Config::setCurrentStabilityName("staging");
+			} else {
+				Config::setCurrentStabilityName("stable");
+			}
+		}
+
 		return self::$currentStabilityName;
 	}	/*}}}*/
 
@@ -93,6 +144,9 @@ class Config
 			} else {
 				/* It might be ok to use cached branches list, if a fetch failed. */
 				$tmp = $cache->getCachedContent($cache_file, true);
+				if (NULL == $tmp) {
+					throw new Exception("No cached branches list found");
+				}
 				$data = json_decode($tmp, true);
 			}
 
@@ -105,17 +159,62 @@ class Config
 		return self::$knownBranches;
 	}/*}}}*/
 
-	public static function setCurrentBranchName(string $name)
+	public static function setCurrentBranchName(string $name) : void
 	{/*{{{*/
 		if (!array_key_exists($name, self::getKnownBranches())) {
-		//	throw new Exception("Unsupported branch '$name'");
+			throw new Exception("Unsupported branch '$name'");
 		}
 
 		self::$currentBranchName = $name;
 	}/*}}}*/
 
-	public static function getCurrentBranchName()
+	public static function guessCurrentBranchName() : ?string
 	{/*{{{*/
+		$branch = NULL;
+		$found = false;
+
+		/* Try to figure out the branch. The worky scenarios are
+			- CWD is in php-src 
+			- phpize is on the path
+			FIXME for the dev package, there should be a php-config utility
+		 */
+		$fl = "main/php_version.h";
+		$found = file_exists($fl);
+
+		if (!$found) {
+			exec("where phpize", $out, $status);
+			if (!$status) {
+				$fl = dirname($out[0]) . DIRECTORY_SEPARATOR . "include" . DIRECTORY_SEPARATOR . $fl;
+				$found = file_exists($fl);
+			}
+		}
+
+		if ($found) {
+			$s = file_get_contents($fl);
+			$major = $minor = NULL;
+
+			if (preg_match(",PHP_MAJOR_VERSION (\d+),", $s, $m)) {
+				$major = $m[1];
+			}
+			if (preg_match(",PHP_MINOR_VERSION (\d+),", $s, $m)) {
+				$minor = $m[1];
+			}
+
+			if (is_numeric($major) && is_numeric($minor)) {
+				$branch = "$major.$minor";
+			}
+		}
+
+		return $branch;
+	}/*}}}*/
+
+	public static function getCurrentBranchName() : string
+	{/*{{{*/
+		if (NULL == self::$currentBranchName) {
+			$branch = self::guessCurrentBranchName();
+			self::setCurrentBranchName($branch);
+		}
+	
 		return self::$currentBranchName;
 	}/*}}}*/
 
@@ -124,30 +223,37 @@ class Config
 		$ret = array();
 		$branches = self::getKnownBranches();
 
-		if (!array_key_exists(self::$currentBranchName, $branches)) {
-			throw new Exception("Unknown branch '" . self::$currentBranchName . "'");
+		$current_branch_name = self::getCurrentBranchName();
+		if (!array_key_exists($current_branch_name, $branches)) {
+			throw new Exception("Unknown branch '$current_branch_name'");
 		}
 
 		$cur_crt = Config::getCurrentCrtName();
-		if (count($branches[self::$currentBranchName]) > 1) {
+		if (count($branches[$current_branch_name]) > 1) {
 			if (NULL === $cur_crt) {
-				throw new Exception("More than one CRT is available for branch '" . self::$currentBranchName . "', pass one explicitly.");
+				throw new Exception("More than one CRT is available for branch '$current_branch_name', pass one explicitly.");
 			}
 
-			$crt = array_keys($branches[self::$currentBranchName])[0];
-			if ($cur_crt != $crt) {
-				throw new Exception("The passed CRT '$cur_crt' doesn't match any availbale for branch '" . self::$currentBranchName . "'");
+			$cur_crt_usable = false;
+			foreach (array_keys($branches[$current_branch_name]) as $crt) {
+				if ($cur_crt == $crt) {
+					$cur_crt_usable = true;
+					break;
+				}
 			}
-			$data = $branches[self::$currentBranchName][$cur_crt];
+			if (!$cur_crt_usable) {
+				throw new Exception("The passed CRT '$cur_crt' doesn't match any availbale for branch '$current_branch_name'");
+			}
+			$data = $branches[$current_branch_name][$cur_crt];
 		} else {
 			/* Evaluate CRTs, to avoid ambiquity. */
-			list($crt, $data) = each($branches[self::$currentBranchName]);
+			list($crt, $data) = each($branches[$current_branch_name]);
 			if ($crt != $cur_crt) {
-				throw new Exception("The passed CRT '$cur_crt' doesn't match any availbale for branch '" . self::$currentBranchName . "'");
+				throw new Exception("The passed CRT '$cur_crt' doesn't match any availbale for branch '$current_branch_name'");
 			}
 		}
 
-		$ret["name"] = self::$currentBranchName;
+		$ret["name"] = $current_branch_name;
 		$ret["crt"] = $crt;
 
 		/* Last step, filter by arch and stability. */
@@ -175,12 +281,12 @@ class Config
 		return self::$sdkNugetFeedUrl;
 	}/*}}}*/
 
-	public static function getSdkPath()
+	public static function getSdkPath() : string
 	{/*{{{*/
-		$path = getenv("PHP_SDK_PATH");
+		$path = getenv("PHP_SDK_ROOT_PATH");
 
 		if (!$path) {
-			throw new Exception("PHP_SDK_PATH isn't set!");
+			throw new Exception("PHP_SDK_ROOT_PATH isn't set!");
 		}
 
 		$path = realpath($path);
@@ -202,12 +308,45 @@ class Config
 		return file_get_contents($path);
 	}/*}}}*/
 
-	public static function getDepsLocalPath()
+	public static function getDepsLocalPath() : ?string
 	{/*{{{*/
+		if (NULL == self::$depsLocalPath) {
+			if (file_exists("Makefile")) {
+				$s = file_get_contents("Makefile");
+
+				if (preg_match(",PHP_BUILD=(.+),", $s, $m)) {
+					if (isset($m[1])) {
+						self::setDepsLocalPath(trim($m[1]));
+					}
+				}
+			}
+		}
+
+		if (NULL == self::$depsLocalPath) {
+			$tmp = dirname(getcwd()) . DIRECTORY_SEPARATOR . "deps";
+			if (is_dir($tmp)) {
+				self::setDepsLocalPath($tmp);
+			}
+		}
+		
+		if (NULL == self::$depsLocalPath) {
+			$tmp = realpath("../deps");
+			if (is_dir($tmp)) {
+				self::setDepsLocalPath($tmp);
+			}
+		}
+
+		if (NULL == self::$depsLocalPath) {
+			if (file_exists("main/php_version.h")) {
+				/* Deps dir might not exist. */
+				self::setDepsLocalPath(realpath("..") . DIRECTORY_SEPARATOR . "deps");
+			}
+		}
+
 		return self::$depsLocalPath;
 	}/*}}}*/
 
-	public static function setDepsLocalPath(string $path)
+	public static function setDepsLocalPath(string $path) : void
 	{/*{{{*/
 		self::$depsLocalPath = $path;
 	}/*}}}*/

lib/php/libsdk/SDK/FileOps.php

@@ -1,127 +1,163 @@
-<?php
-
-namespace SDK;
-
-use SDK\Config;
-use SDK\Exception;
-
-trait FileOps
-{
-	protected function md(string $name = "", bool $tmp = false) : string
-	{/*{{{*/
-		$ret = $name;
-
-		if (!$name) {
-			if ($tmp) {
-				$pre = Config::getTmpDir();
-				$ret = $pre . DIRECTORY_SEPARATOR . md5(uniqid());
-			} else {
-				throw new Exception("Dir name is empty");
-			}
-		}
-
-
-		if (!is_dir($ret)) {
-			if (!mkdir($ret, 0755, true)) {
-				throw new Exception("Unable to create '$ret'");
-			}
-		}
-
-		return $ret;
-	}/*}}}*/
-
-	/* TODO is link and more checks. */
-	protected function rm(string $path) : bool
-	{/*{{{*/
-		if (!file_exists($path)) {
-			return false;
-		} else if (is_file($path)) {
-			return unlink($path);
-		}
-
-		$ret = true;
-
-		$iterator = new \RecursiveIteratorIterator(
-			new \RecursiveDirectoryIterator(
-				$path,
-				\FilesystemIterator::SKIP_DOTS
-			),
-			\RecursiveIteratorIterator::CHILD_FIRST
-		);
-		foreach ($iterator as $item) {
-			if ($item->isDir()) {
-				$ret = $ret && rmdir($item->getPathname());
-			} else {
-				$ret = $ret && unlink($item->getPathname());
-			}
-		}
-		return $ret && rmdir($path);
-	}/*}}}*/
-
-	/* TODO islink and more checks */
-	protected function cp_or_mv(string $src, string $dst, callable $cb) : bool
-	{/*{{{*/
-		if (!file_exists($src)) {
-			return false;
-		} else if (is_file($src)) {
-			return call_user_func($cb, $src, $dst);
-		}
-
-		if (!file_exists($dst)) {
-			$this->md($dst);
-		}
-
-		$iterator = new \RecursiveIteratorIterator(
-			new \RecursiveDirectoryIterator(
-				$src,
-				\FilesystemIterator::SKIP_DOTS
-			),
-			\RecursiveIteratorIterator::CHILD_FIRST
-		);
-		$cut_len = strlen($src)+1;
-		foreach ($iterator as $item) {
-			$src_path = $item->getPathname();
-			$sub = substr($src_path, $cut_len);
-			$dst_path = $dst . DIRECTORY_SEPARATOR . $sub;
-			$dst_parent = dirname($dst_path);
-
-			if (!is_dir($dst_parent)) {
-				if (!$this->md($dst_parent)) {
-					throw new Exception("Unable to create '$dst_parent'");
-				}
-			}
-
-			if ($item->isFile()) {
-				if (!call_user_func($cb, $src_path, $dst_path)) {
-					throw new Exception("Unable to $cb '$src_path' to '$dst_path'");
-				}
-			}
-			
-		}
-
-		return true;
-	}/*}}}*/
-
-	protected function cp(string $src, string $dst) : bool
-	{/*{{{*/
-		return $this->cp_or_mv($src, $dst, "copy");
-	}/*}}}*/
-
-	protected function mv(string $src, string $dst) : bool
-	{/*{{{*/
-		$ret = $this->cp_or_mv($src, $dst, "rename");
-
-		$ret = $ret && $this->rm($src);
-
-		return $ret;
-	}/*}}}*/
-}
-
-/*
- * Local variables:
- * tab-width: 4
- * c-basic-offset: 4
- * End:
- * vim600: sw=4 ts=4 fdm=marker
- * vim<600: sw=4 ts=4
- */
+<?php
+
+namespace SDK;
+
+use SDK\Config;
+use SDK\Exception;
+
+trait FileOps
+{
+	protected function md(string $name = "", bool $tmp = false) : string
+	{/*{{{*/
+		$ret = $name;
+
+		if (!$name) {
+			if ($tmp) {
+				$pre = Config::getTmpDir();
+				$ret = $pre . DIRECTORY_SEPARATOR . md5(uniqid());
+			} else {
+				throw new Exception("Dir name is empty");
+			}
+		}
+
+
+		if (!is_dir($ret)) {
+			if (!mkdir($ret, 0755, true)) {
+				throw new Exception("Unable to create '$ret'");
+			}
+		}
+
+		return $ret;
+	}/*}}}*/
+
+	/* TODO is link and more checks. */
+	protected function rm(string $path) : bool
+	{/*{{{*/
+		if (!file_exists($path)) {
+			return false;
+		} else if (is_file($path)) {
+			return unlink($path);
+		}
+
+		$ret = true;
+
+		$iterator = new \RecursiveIteratorIterator(
+			new \RecursiveDirectoryIterator(
+				$path,
+				\FilesystemIterator::SKIP_DOTS
+			),
+			\RecursiveIteratorIterator::CHILD_FIRST
+		);
+		foreach ($iterator as $item) {
+			if ($item->isDir()) {
+				$ret = $ret && rmdir($item->getPathname());
+			} else {
+				$ret = $ret && unlink($item->getPathname());
+			}
+		}
+		return $ret && rmdir($path);
+	}/*}}}*/
+
+	/* TODO islink and more checks */
+	protected function cp_or_mv(string $src, string $dst, callable $cb) : bool
+	{/*{{{*/
+		if (!file_exists($src)) {
+			return false;
+		} else if (is_file($src)) {
+			return call_user_func($cb, $src, $dst);
+		}
+
+		if (!file_exists($dst)) {
+			$this->md($dst);
+		}
+
+		$iterator = new \RecursiveIteratorIterator(
+			new \RecursiveDirectoryIterator(
+				$src,
+				\FilesystemIterator::SKIP_DOTS
+			),
+			\RecursiveIteratorIterator::CHILD_FIRST
+		);
+		$cut_len = strlen($src)+1;
+		foreach ($iterator as $item) {
+			$src_path = $item->getPathname();
+			$sub = substr($src_path, $cut_len);
+			$dst_path = $dst . DIRECTORY_SEPARATOR . $sub;
+			$dst_parent = dirname($dst_path);
+
+			if (!is_dir($dst_parent)) {
+				if (!$this->md($dst_parent)) {
+					throw new Exception("Unable to create '$dst_parent'");
+				}
+			}
+
+			if ($item->isFile()) {
+				if (!call_user_func($cb, $src_path, $dst_path)) {
+					throw new Exception("Unable to $cb '$src_path' to '$dst_path'");
+				}
+			}
+			
+		}
+
+		return true;
+	}/*}}}*/
+
+	protected function cp(string $src, string $dst) : bool
+	{/*{{{*/
+		return $this->cp_or_mv($src, $dst, "copy");
+	}/*}}}*/
+
+	protected function mv(string $src, string $dst) : bool
+	{/*{{{*/
+		$ret = $this->cp_or_mv($src, $dst, "rename");
+
+		$ret = $ret && $this->rm($src);
+
+		return $ret;
+	}/*}}}*/
+
+	protected function download(string $url, string $dest = NULL) : ?string
+	{/*{{{*/
+		$fd = NULL;
+		$ch = curl_init($url);
+
+		if ($dest) {
+			$fd = fopen($dest, "w+");
+			curl_setopt($ch, CURLOPT_FILE, $fd); 
+		} else {
+			curl_setopt($ch, CURLOPT_RETURNTRANSFER, true);
+		}
+
+		curl_setopt($ch, CURLOPT_FOLLOWLOCATION, true);
+		curl_setopt($ch, CURLOPT_SSL_VERIFYHOST, false);
+		curl_setopt($ch, CURLOPT_SSL_VERIFYPEER, false);
+
+		$ret = curl_exec($ch);
+		if (false === $ret) {
+			$err = curl_error();
+			curl_close($ch);
+			if ($dest) {
+				fclose($fd);
+			}
+			throw new Exception($err);
+		}
+
+		curl_close($ch);
+
+		if ($dest) {
+			fclose($fd);
+			return NULL;
+		}
+
+		return $ret;
+	}/*}}}*/
+}
+
+/*
+ * Local variables:
+ * tab-width: 4
+ * c-basic-offset: 4
+ * End:
+ * vim600: sw=4 ts=4 fdm=marker
+ * vim<600: sw=4 ts=4
+ */

lib/php/libsdk/SDK/Lock.php

@@ -0,0 +1,107 @@
+<?php
+
+namespace SDK;
+
+use SDK\{Config, Exception};
+
+class Lock
+{
+	protected $fd;
+	protected $fn;
+	protected $locked = false;
+	protected $wouldBlock = false;
+	protected $shared = false;
+
+	public function __construct(string $tag, bool $auto = true, bool $autoShared = false)
+	{/*{{{*/
+		$hash = hash("sha256", $tag);
+		$this->fn = Config::getTmpDir() . DIRECTORY_SEPARATOR . $hash . ".lock";
+
+		if ($auto) {
+			if ($autoShared) {
+				$this->shared();
+			} else {
+				$this->exclusive();
+			}
+		}
+	}/*}}}*/
+
+	public function __destruct()
+	{/*{{{*/
+		$this->unlock();
+		/* We don't really know no one else waits on the same lock yet.*/
+		/*if (file_exists($this->fn) && !$this->shared) {
+			@unlink($this->fn);
+		}*/
+	}/*}}}*/
+
+	public function shared(bool $block = false) : bool
+	{/*{{{*/
+		$flags = LOCK_SH;
+		if (!$block) {
+			$flags |= LOCK_NB;
+		}
+
+		return $this->doLock($flags);
+	}/*}}}*/
+
+	public function exclusive(bool $block = false) : bool
+	{/*{{{*/
+		$flags = LOCK_EX;
+		if (!$block) {
+			$flags |= LOCK_NB;
+		}
+
+		return $this->doLock($flags);
+	}/*}}}*/
+
+	protected function doLock(int $flags = LOCK_EX) : bool
+	{/*{{{*/
+		if ($this->locked) {
+			/* Or throw an exception, as we don't know which lock type the outta world expected. */
+			return true;
+		}
+
+		$this->shared = $flags & LOCK_SH;
+		if ($this->shared) {
+			$this->fd = fopen($this->fn, "rb");
+		} else {
+			$this->fd = fopen($this->fn, "wb");
+		}
+		$this->locked = flock($this->fd, $flags, $this->wouldBlock);	
+		return $this->locked;
+	}/*}}}*/
+
+	public function unlock() : bool
+	{/*{{{*/
+		if (!$this->locked) {
+			return true;
+		}
+
+		$this->doLock(LOCK_UN);
+
+		fclose($this->fd);
+		$this->fd = NULL;
+
+		return $this->locked;
+	}/*}}}*/
+
+	public function locked() : bool
+	{/*{{{*/
+		return $this->locked;
+	}/*}}}*/
+
+	public function wouldBlock() : bool
+	{/*{{{*/
+		return 1 === $this->wouldBlock;
+	}/*}}}*/
+}
+
+/*
+ * Local variables:
+ * tab-width: 4
+ * c-basic-offset: 4
+ * End:
+ * vim600: sw=4 ts=4 fdm=marker
+ * vim<600: sw=4 ts=4
+ */

msys2/usr/share/aclocal/bison-i18n.m4

@@ -1,6 +1,6 @@
 # bison-i18n.m4 serial 2
 
-dnl Copyright (C) 2005-2006, 2009-2013 Free Software Foundation, Inc.
+dnl Copyright (C) 2005-2006, 2009-2015 Free Software Foundation, Inc.
 
 dnl This file is free software; the Free Software Foundation
 dnl gives unlimited permission to copy and/or distribute it,

msys2/usr/share/bison/README

@@ -52,7 +52,7 @@ into various formats.
 
 -----
 
-Copyright (C) 2002, 2008-2013 Free Software Foundation, Inc.
+Copyright (C) 2002, 2008-2015 Free Software Foundation, Inc.
 
 This file is part of GNU Bison.
 

msys2/usr/share/bison/bison.m4

@@ -2,7 +2,7 @@
 
 # Language-independent M4 Macros for Bison.
 
-# Copyright (C) 2002, 2004-2013 Free Software Foundation, Inc.
+# Copyright (C) 2002, 2004-2015 Free Software Foundation, Inc.
 
 # This program is free software: you can redistribute it and/or modify
 # it under the terms of the GNU General Public License as published by
@@ -437,7 +437,6 @@ m4_define([b4_symbol_action_location],
 # b4_symbol_action(SYMBOL-NUM, KIND)
 # ----------------------------------
 # Run the action KIND (destructor or printer) for SYMBOL-NUM.
-# Same as in C, but using references instead of pointers.
 m4_define([b4_symbol_action],
 [b4_symbol_if([$1], [has_$2],
 [b4_dollar_pushdef([(*yyvaluep)],
@@ -1061,3 +1060,6 @@ b4_percent_define_ifdef([api.value.type],
                 [['%s' and '%s' cannot be used together]],
                 [%yacc],
                 [%define api.value.type "union"])])])])
+
+# api.value.union.name.
+b4_percent_define_check_kind([api.value.union.name], [keyword])

msys2/usr/share/bison/c++-skel.m4

@@ -2,7 +2,7 @@
 
 # C++ skeleton dispatching for Bison.
 
-# Copyright (C) 2006-2007, 2009-2013 Free Software Foundation, Inc.
+# Copyright (C) 2006-2007, 2009-2015 Free Software Foundation, Inc.
 
 # This program is free software: you can redistribute it and/or modify
 # it under the terms of the GNU General Public License as published by