29 Commits

Author SHA1 Message Date
Craig Tiller
3afc5d692a [build] Convert more templates to inja (#39304)
This should complete the templates that /do not/ have embedded Python

Closes #39304

PiperOrigin-RevId: 750384033
2025-04-22 17:33:19 -07:00
Craig Tiller
5fb754aeb5 [build] Convert dockerfiles to new template system (#38812)
Closes #38812

PiperOrigin-RevId: 743803131
2025-04-03 21:26:45 -07:00
Eric Anderson
9098d8b8db Upgrade Java interop to Bullseye and Java 11 (#30599) 2022-10-20 13:44:18 -07:00
Eric Anderson
f4c162f30d Allow Gradle to use more memory when building Java interop (#30249)
Should fix "Expiring Daemon because JVM heap space is exhausted".

https://github.com/grpc/grpc-java/pull/9269 probably pushed the build
over the edge, but there's been evidence via flakes for a good while
that we've been reaching the limit.

b/238438006
2022-07-08 13:00:12 -07:00
Jan Tattermusch
205d7569ea Big dockerimage cleanup (#28010)
* use python3 for running run_tests.py

* update dockerimage templates

* update dockerfiles

* fix bazel build in the bazel docker image

* adjust run_tests.py to renamed php docker image

* add previously forgotten new templates

* add missing images

* php dockerfile remove whitespaces

* restore accidentally deleted binder_transport_apk image

* add back cxx_buster_x64 image

* add back php zts stretch image

* add back binder_transport_apk image

* fix bazel builds by temporarily adding back python2-dev

* check_redundant_namespace_qualifiers.py to python3

* fix clang-tidy

* make run_tests_matrix.py use python3

* fixup cxx_debian9 templates

* regenerate

* stop running dummy grpc-node tests for protobuf-at-head and boringssl-at-head jobs

* remove cxx_buster image (replaced by cxx_debian9)

* add back python_alpine_x64 image

* run_tests_in_workspace using python3

* unbreak python macos basictests by partially reverting run_tests_matrix to python2

* fix cxx_gcc_X docker images
2021-12-01 12:56:26 +01:00
Esun Kim
420a98f96b Update docker images (#27109) 2021-08-24 18:03:45 -07:00
Eric Anderson
eee38e35dd tools/dockerfile: Run Java build twice to reduce flakiness
Downloads fail from time to time because Gradle does not retry certain
types of network failures
(https://github.com/gradle/gradle/issues/8264).

Retrying twice should reduce the flake rate below noticeable without
increasing the size of the interop image created for each new release
for historical testing.

Fixes #18892
2020-05-11 11:37:49 -07:00
Chengyuan Zhang
d659ad23ef Skip building Android-dependent modules for Java interop test. 2020-01-10 10:45:49 -08:00
Eric Anderson
05c603729e Disable Gradle daemon for Java interop test building
We have seen an issue where `rm -r "$HOME/.gradle"` fails because
"Directory not empty". It seems likely this is due the fact Gradle is
still running in daemon form. The build script doesn't get any advantage
by running the daemon, so we just disable it.

Fixes #20423
2019-10-02 15:17:07 -07:00
Eric Anderson
1b025b60e4 Swap java interop tests to openjdk8
Since openjdk8 is dead to us (see #19113), we cannot leave openjdk8 in
the list of runtimes in client_matrix.py. The list of runtimes is now
the defaults to use, which includes master, and you can specify
alternative runtimes per-release.

Fixes #19113
2019-05-24 11:03:11 -07:00
Eric Anderson
dedbcf453b Merge branch 'master' into sed-jessie-updates 2019-04-12 09:19:39 -07:00
Eric Anderson
977e4b1450 grpc_interop_java: Remove unnecessary cruft from container
This reduces the container size from 1.4 GB to 640 MB. 129 MB is
jessie, 489 MB jdk, and 22 MB grpc-java. When we swap from jessie to
stretch, we could swap to openjdk:8-jdk-slim-stretch which would make
the entire image 265 MB.

Python was never needed; it was added by mistake in 0589e533.
Pre-downloading gradle artifacts isn't helpful these days, because we
build on a clean machine. Git isn't needed as cp is sufficient. libapr1
has not been required by tcnative for a long time, and we even use
tcnative-boringssl-static since at least 1.0, which also doesn't need
it. The final cleanup is to remove source and downloaded artifacts when
done compiling.
2019-04-04 18:23:00 -07:00
Eric Anderson
1f84f8950c Remove vestigial sed for /etc/apt/sources.list in Dockerfiles
Jessie has a line that looks like this, now-a-days, so the regex is no
longer matching:
deb http://security.debian.org/debian-security jessie/updates main

But because that line was changed, downloads are also working correctly
out-of-the-box. The sed was originally added in #18530.
2019-04-04 17:45:00 -07:00
murgatroid99
2a12b47f0b Fix other docker build issues 2019-03-28 15:56:08 -07:00
Alex Polcyn
e52d87b53d Add a grpclb-in-DNS interop test suite 2018-10-23 00:00:08 -07:00
Jan Tattermusch
e1efb43345 Revert "Install pyyaml through pip in docker" 2018-06-18 16:03:59 +02:00
Alex Polcyn
f3fb98e75f Install pyyaml through pip in docker 2018-06-14 06:44:56 +00:00
Mehrdad Afshari
c176917789 Bump Python protobuf to 3.5.2.post1 2018-04-19 15:48:31 -04:00
Mehrdad Afshari
d0d8ce8568 Bump pip version to 10.0.1 2018-04-19 15:48:23 -04:00
Matt Kwong
4598eb8a7a Update pip pin from 9.0.1 to 9.0.2 2018-04-06 15:37:37 -07:00
Mehrdad Afshari
0df9c8acdc Update Python dependency to protobuf v3.5.0.post1 2017-11-27 12:52:41 -08:00
Nathaniel Manista
8bba3bfc25 Pin pip at 9.0.1 2017-09-28 17:28:01 +00:00
Alexander Polcyn
27bf05d003 Add tests for c-ares wrapper using a local DNS server. 2017-09-14 14:32:30 -07:00
Jan Tattermusch
7897ae9308 auto-fix most of licenses 2017-06-08 11:22:41 +02:00
Yong Ni
b92813b18b Created a Java Oracle8 Dockerfile directory and moved all build_interop.sh to under template/. Added java_oracle8 to the client matrix. 2017-05-31 12:31:20 -07:00
Mehrdad Afshari
9b3c73d1cd Updated protobuf dependency for python to 3.2.0 2017-03-07 22:10:15 +00:00
siddharthshukla
0589e533cd Make testing toolchain python 3.x compliant
six is necessary for making these scripts cross compatible
between python 2.x and 3.x

Changes:
Add six to python_deps.include
Include python_deps.include to all Dockerfile templates in test directory
Include python_deps.include to all Dockerfile templates in stress_test directory
Include python_deps.include to all Dockerfile templates in interop_test directory
Replace print statements with print function calls (from futute..)
Replace .iteritems() with .items() wherever necessary
use six.moves to import BaseHTTPServer
Generate new dockerfiles using generate_projects.sh
2016-07-12 01:35:53 +02:00
Jan Tattermusch
24b68cd62f generate interop test Dockerfiles using templates 2016-04-27 15:31:11 -07:00
Jan Tattermusch
c218d05029 move interop test docker files to a subdir 2016-04-27 15:27:55 -07:00