1. Change Docker images to use Python3
2. Change local scripts to support Python3
3. Fix installation of Chromium dependencies
4. Remove profiling code, the profiling package only supports up to
Python3.9
5. Recompile all protos and change some uworker serialization code that
has to work differently due to some changes in dependencies
6. Add many no-member pylint exemptions since pylint is now
misunderstanding proto members.
7. Change platforms for binary downloads during deploy
8. Upgrade packages that no longer work or have to be upgraded by
because of depdency/dependent upgrades
[Used everywhere]
a. grpcio
b. grpcio-tools
c. protobuf
[development]
d. parameterized
e. WebTest
[bots]
f. google-cloud-batch
g. google-cloud-core
h. google-cloud-datastore
i. google-cloud-logging
j. google-cloud-monitoring
k. google-cloud-ndb
l. google-cloud-storage
m. google-api-python-client
n. google-auth
o. google-api-core
[appengine]
p. cryptography
q. firebase-admin
r. PyJWT
9. Remove no longer used pip packages:
a. twisted
b. lxml
Set Python3.7 for pipenv. python3.8 is indirectly installed by another package in the new CI
image and used by default otherwise.
Also remove CLOUDSDK_PYTHON env var which was setting it to python2.
Increase flaky afl test timeout.
* Python 2->3 fixes
- Use latest python 3 images in clusters.yaml
- Use python 3 by default, remove python 2 in install_deps_linux.bash
- Remove Go in prerequisites.
- Change python 2 to 3 in prerequisites.
- Fix reproduce script to not need PY3.
- run_server3->run_server.
- Remove python 2 CI.
Require env vars instead:
- TEST_BLOBS_BUCKET
- TEST_BUCKET
- TEST_CORPUS_BUCKET
- TEST_QUARANTINE_BUCKET
- TEST_BACKUP_BUCKET
- TEST_COVERAGE_BUCKET
Also make it clearer which read-only test buckets we depend on in test, and fix corpus pruning task test to use own backup bucket rather than a global one.
Github integration with CloudBuild does not copy over the
.git folder, thus to compute the diff we have to perform
a git clone as the first step.
Fixes#127
