Commit Graph

41 Commits

Author SHA1 Message Date
Jan Tattermusch
a526a091ae [docker images] Consolidate git directory ownership workaround and upgrade ccache (#34035)
Based on https://github.com/grpc/grpc/pull/34033

Bunch of cleanup and rebuilding many docker images from scratch
- consolidate the workaround for "dubious ownership" issue reported by
git. Other team members have run into this recently and used similar but
not identical workarounds so some cleanup is due.
- rebuilding many images increases the chance that we fix the "dubious
ownership" git issue early on rather than later on in the one-at-a-time
fashion in the future (and the former will prevent many teammembers from
wasting time on this weird issue).
- Newer version of ccache is needed for some portability tests to be
able to benefit from caching (e.g. the GCC 12 portability test to get
benefits of local disk caching) - this is a prerequisite for reenabling
the bazelified gcc12 portability test.
- upgrade node interop images to debian:11 (since debian jessie is long
past EOL).
2023-08-17 00:28:21 +02:00
Jan Tattermusch
d15711d2bb Docker image cleanup (prepare for ARM64 tests) (#29051)
* remove gcc-multilib from base image

* remove useless "apt-get --allow-releaseinfo-change update" from docker images

* get rid of no-longer-useful python_debian11_base.include

* regenerate dockerfiles
2022-03-08 20:31:32 +01:00
Jan Tattermusch
b0cdd3cba2 Cleanup (followup for ccache addition) (#28702)
* nit in python interop dockerfile

* address TODO in prepare_ccache_symlinks_rc

* enable ccache for C# and ruby distribtest jobs

* use debian11 instead of bullseye consistently
2022-01-26 18:56:46 +01:00
Jan Tattermusch
1cf6b085f2 Enable ccache in more builds (#28665)
* upgrade ruby docker images to debian 11

* upgrade C# docker images to debian11

* update sanity dockerimage to debian11

* upgrade cxx interop to debian11

* add ccache to python interop images

* enable use of ccache for interop tests

* adjust run_tests.py to new docker images

* add ccache to rake-compiler-dock docker images

* improve prepare_ccache_symlinks_rc

* enable use of ccache in rake-compiler-dock docker containers

* add ccache support for python_manylinux2014_aarch64

* add ccache support for python_linux_armv7

* deduplicate python3.9 install

* ccache for crosscompiled darwin gems is broken

* fix bash -l resetting of PATH in grpc_artifact_python_linux_armv7
2022-01-25 20:37:04 +01:00
Jan Tattermusch
205d7569ea Big dockerimage cleanup (#28010)
* use python3 for running run_tests.py

* update dockerimage templates

* update dockerfiles

* fix bazel build in the bazel docker image

* adjust run_tests.py to renamed php docker image

* add previously forgotten new templates

* add missing images

* php dockerfile remove whitespaces

* restore accidentally deleted binder_transport_apk image

* add back cxx_buster_x64 image

* add back php zts stretch image

* add back binder_transport_apk image

* fix bazel builds by temporarily adding back python2-dev

* check_redundant_namespace_qualifiers.py to python3

* fix clang-tidy

* make run_tests_matrix.py use python3

* fixup cxx_debian9 templates

* regenerate

* stop running dummy grpc-node tests for protobuf-at-head and boringssl-at-head jobs

* remove cxx_buster image (replaced by cxx_debian9)

* add back python_alpine_x64 image

* run_tests_in_workspace using python3

* unbreak python macos basictests by partially reverting run_tests_matrix to python2

* fix cxx_gcc_X docker images
2021-12-01 12:56:26 +01:00
Richard Belleville
179a7c7459 Fix Python Interop (#27620) (#27703) (#27749)
* WIP. Attempt to fix interop

* Yapf
2021-10-15 18:22:29 -07:00
Richard Belleville
1437dc9816 Fix pypa link (#25647)
* Fix pypa link

* And 3.5 as well
2021-03-08 17:26:52 -08:00
Lidi Zheng
a6c5d6c43e [xDS Proto] Pin PyPI dependencies in Dockerfiles (#25510) 2021-02-22 10:10:56 -08:00
Jan Tattermusch
cd53c55269 regenerate dockerfiles 2021-02-11 14:11:42 +01:00
Stanley Cheung
7d8f295ab0 Fix run_tests pip install error 2020-05-13 10:59:09 -07:00
Lidi Zheng
3e2171ed61 Adopt reviewer's advice 2019-09-06 11:15:00 -07:00
Jan Tattermusch
905f52852e make python dockerfiles buildable again 2019-08-27 18:09:13 -04:00
Jan Tattermusch
b0bcfb4ea5 use python stretch3.7 image for interop tests 2018-11-26 09:47:20 +01:00
Jan Tattermusch
422fdbfd6c run python interop tests with python3.7 2018-11-26 09:47:20 +01:00
Jan Tattermusch
5a0f722590 run interop tests using python3.4 2018-11-21 13:08:30 +01:00
Jan Tattermusch
e1efb43345 Revert "Install pyyaml through pip in docker" 2018-06-18 16:03:59 +02:00
Alex Polcyn
f3fb98e75f Install pyyaml through pip in docker 2018-06-14 06:44:56 +00:00
Jan Tattermusch
619b9500bd only build interop tests with python2.7 2018-06-06 11:35:21 +02:00
Jan Tattermusch
0c4a3ba63b regenerate dockerfiles 2018-05-23 06:29:19 +02:00
Jan Tattermusch
2e679e664d Revert "Remove ccache from all docker images" 2018-05-19 06:25:35 -07:00
Jan Tattermusch
80095a046c regenerate dockerfiles 2018-05-18 00:29:31 +02:00
Matt Kwong
4d5200f99a Install pip for Python3.4 in all Dockerfiles used for Python testing 2018-05-08 14:16:44 -07:00
Mehrdad Afshari
c176917789 Bump Python protobuf to 3.5.2.post1 2018-04-19 15:48:31 -04:00
Mehrdad Afshari
d0d8ce8568 Bump pip version to 10.0.1 2018-04-19 15:48:23 -04:00
Matt Kwong
4598eb8a7a Update pip pin from 9.0.1 to 9.0.2 2018-04-06 15:37:37 -07:00
Mehrdad Afshari
0df9c8acdc Update Python dependency to protobuf v3.5.0.post1 2017-11-27 12:52:41 -08:00
Nathaniel Manista
8bba3bfc25 Pin pip at 9.0.1 2017-09-28 17:28:01 +00:00
Alexander Polcyn
27bf05d003 Add tests for c-ares wrapper using a local DNS server. 2017-09-14 14:32:30 -07:00
Jan Tattermusch
7897ae9308 auto-fix most of licenses 2017-06-08 11:22:41 +02:00
Mehrdad Afshari
9b3c73d1cd Updated protobuf dependency for python to 3.2.0 2017-03-07 22:10:15 +00:00
Matt Kwong
10dcccadfb fixed whitespacing and docker_run_tests.sh now clones submodule via network 2016-09-28 16:55:15 -07:00
Matt Kwong
5d0f24600e changed method to local clone submodules to using git submodule foreach from the local copy 2016-09-28 16:55:15 -07:00
Matt Kwong
46c7f574bd submodule clone comments changed to be more descriptive 2016-09-28 16:55:15 -07:00
Matt Kwong
ce9471c962 fixed wrong directory in git clone commands 2016-09-28 16:55:14 -07:00
Matt Kwong
befac97048 fixed local cloning of grpc/grpc submodules on docker 2016-09-28 16:55:14 -07:00
siddharthshukla
0589e533cd Make testing toolchain python 3.x compliant
six is necessary for making these scripts cross compatible
between python 2.x and 3.x

Changes:
Add six to python_deps.include
Include python_deps.include to all Dockerfile templates in test directory
Include python_deps.include to all Dockerfile templates in stress_test directory
Include python_deps.include to all Dockerfile templates in interop_test directory
Replace print statements with print function calls (from futute..)
Replace .iteritems() with .items() wherever necessary
use six.moves to import BaseHTTPServer
Generate new dockerfiles using generate_projects.sh
2016-07-12 01:35:53 +02:00
kpayson64
dcca468abe Merge pull request #6791 from soltanmm/pain
Make running individual Python tests less painful
2016-07-06 11:02:46 -07:00
Craig Tiller
eda85c6765 Expunge all references to zookeeper 2016-07-01 12:45:19 -07:00
Masood Malekghassemi
ac586ba21e Remove tox 2016-07-01 10:18:45 -07:00
Jan Tattermusch
24b68cd62f generate interop test Dockerfiles using templates 2016-04-27 15:31:11 -07:00
Jan Tattermusch
c218d05029 move interop test docker files to a subdir 2016-04-27 15:27:55 -07:00