You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
Go to file
Andrii Shyshkalov d51ed57edb git_cache: lower max num of .pack files before re-bootstrap on Win.
It used to be 50, I think ~9 gives best results for Chromium on Win:
  on golo VM, it takes <4 minutes to re-boostrap + git fetch small
  delta, assuming zipped git checkout for bootstrap is fresh (~1day).

For other repos, which are significantly smaller, this change should
have minor effect if at all.

Test: I tested this using `led` tool on Win7 machines running LUCI
stack extensively. For example,

  * https://ci.chromium.org/swarming/task/3a0102e8c8657410
    shows case with few .pack files, hence just 1 fetch

  * https://ci.chromium.org/swarming/task/3a010282f9fd8010
    shows case with 39 .pack files and so bootstrapping + fetch.
    If you look at prior tasks on the same VM, you'd find this:
    https://ci.chromium.org/swarming/task/39ffe843d01ed010
    which spent 8 minutes doing 1 incremental fetch with 39 .pack
    files.

**Troopers/Sheriffs**: This change is safe to revert.
However, beware that you should also at the same time revert the recipe
roll of this CL to the repo, in which the failed builder's recipe is
located, typically `chromium/tools/build`.

Bug: 749709
Change-Id: I18e2b63283100d466e9fb981a9094862463f6909
Reviewed-on: https://chromium-review.googlesource.com/787174
Commit-Queue: Andrii Shyshkalov <tandrii@chromium.org>
Reviewed-by: Takuto Ikuta <tikuta@google.com>
8 years ago
bootstrap/win Update depot_tools prod git to 2.15.0 8 years ago
fetch_configs Update fetch config with new Syzygy location. 8 years ago
git-templates Explicitly exec hooks inside a shell. 12 years ago
infra Roll recipe dependencies (trivial). 8 years ago
man git-upstream-diff: add optional branch argument 8 years ago
recipes git_cache: lower max num of .pack files before re-bootstrap on Win. 8 years ago
support chromite_wrapper: Fix up comment. 12 years ago
testing_support Do not write gclient_gn_args_file too early. 8 years ago
tests [presubmit] Rename to CheckChangedLUCIConfigs 8 years ago
third_party [depot_tools] Add mock lib 8 years ago
win_toolchain Add --repackage option to VS packaging script 8 years ago
zsh-goodies Remove unmaintained "gclient export" command, 14 years ago
.gitattributes Add gsutil.vpython spec to recipe bundles 8 years ago
.gitignore Add vs_files.ciopfs to gitignore 8 years ago
.style.yapf Add experimental support for python in 'git cl format' 10 years ago
LICENSE Create the Next Generation of depot_tools. Eh. 16 years ago
OWNERS Remove references to phajdan.jr 8 years ago
PRESUBMIT.py Remove defunct Rietveld end-to-end tests 8 years ago
README.gclient.md docs: Removing references to SVN 9 years ago
README.git-cl.md Proofread README.git-cl.md. 9 years ago
README.md Add links to bug tracker, forum and review UI 8 years ago
README.testing Move git_cl back into depot_tools. 14 years ago
WATCHLISTS Remove myself (dpranke@) from the WATCHLISTS. 9 years ago
annotated_gclient.py Send build revision as json object. 12 years ago
appengine_mapper.py Automatically map urls to their raw appengine forms 9 years ago
apply_issue Mark the apply_issue and apply_issue.bat files as executable. BUG=149941 13 years ago
apply_issue.bat [.bat] Remove "depot_tools" override. (#2) 8 years ago
apply_issue.py apply_issue: remove old hack. 8 years ago
auth.py [presubmit] Extend depot tools auth to use luci context 8 years ago
autoninja autoninja - ninja wrapper to make goma easier 8 years ago
autoninja.bat Fix autoninja to allow compiling one source file 8 years ago
autoninja.py Fix autoninja to allow compiling one source file 8 years ago
breakpad.py Finally get rid of depot_tools' breakpad. 9 years ago
buildbucket.py Add get subcommand to buildbucket.py 10 years ago
cbuildbot Cleanup chromite_wrapper. 13 years ago
checkout.py Revert "Fix checkout.py issues when p.patchlevel > 1." 8 years ago
chrome_set_ver Cleanup chromite_wrapper. 13 years ago
cipd depot_tools: Use armv6 for cipd's GOARCH when on armv7 host. 8 years ago
cipd.bat Revert "[cipd] Bump version, log at warning." 8 years ago
cipd.ps1 [cipd] Bump version, log at warning (#2). 8 years ago
cipd_bin_setup.bat [cipd] Bump version, log at warning (#2). 8 years ago
cipd_bin_setup.sh Fix depot_tools errors that cause runhooks to be inoperable for Cygwin 8 years ago
cipd_client_version [cipd] Add support for ppc64 and ppc64le. 8 years ago
cipd_manifest.txt Roll mac_toolchain to 2b69be620 8 years ago
cit Added tool to call tools in infra.git 10 years ago
cit.bat [.bat] Remove "depot_tools" override. (#2) 8 years ago
cit.py cit.py: Use infra.git's cit branch instead of the deployed branch 8 years ago
clang-format Depot tools: use the clang-format binaries that are now included 11 years ago
clang-format.bat [.bat] Remove "depot_tools" override. (#2) 8 years ago
clang_format.py Improve clang-format error messages when run outside of chromium checkout 8 years ago
clang_format_merge_driver Introduce git merge driver for the blink reformatting 9 years ago
clang_format_merge_driver.bat [.bat] Remove "depot_tools" override. (#2) 8 years ago
clang_format_merge_driver.py Make merge driver complain about older gits 9 years ago
codereview.settings Make depot_tools upload reviews to Gerrit by default 9 years ago
compile_single_file Add a script to make it easier to build a single source file with ninja 8 years ago
compile_single_file.bat Add a script to make it easier to build a single source file with ninja 8 years ago
compile_single_file.py Add a script to make it easier to build a single source file with ninja 8 years ago
cpplint.bat [.bat] Remove "depot_tools" override. (#2) 8 years ago
cpplint.py Remove presubmit check for DISALLOW_* macros 8 years ago
cpplint_chromium.py Add lint check against "Foo *bar" and "Foo &bar" declarations. 14 years ago
cros Add cros wrapper to depot_tools. 13 years ago
cros_sdk Cleanup chromite_wrapper. 13 years ago
dart_format.py Run dartfmt when invoking git cl format. 10 years ago
depot-tools-auth Add OAuth2 support for end users (i.e. 3-legged flow with the browser). 10 years ago
depot-tools-auth.bat [.bat] Remove "depot_tools" override. (#2) 8 years ago
depot-tools-auth.py Fix coloring madness in depot_tools. 9 years ago
download_from_google_storage Added posix and windows runner scripts for download_from_google_storage.py 12 years ago
download_from_google_storage.bat [.bat] Remove "depot_tools" override. (#2) 8 years ago
download_from_google_storage.py download_from_google_storage: call gsutil.py once before anything else happens 8 years ago
ensure_bootstrap [depot_tools] Add "ensure_bootstrap" script. 8 years ago
fetch Update fetch to support more flexible refspecs 11 years ago
fetch.bat [.bat] Remove "depot_tools" override. (#2) 8 years ago
fetch.py [git] Remove hard-coded "depot_tools" Git. 8 years ago
fix_encoding.py depot_tools: Replace pylint error numbers with symbolic names. 8 years ago
gclient Make msys depot_tools upgrade process smoother. 9 years ago
gclient-new-workdir.py Fix regression of gclient-new-workdir.py 8 years ago
gclient.bat [.bat] Remove "depot_tools" override. (#2) 8 years ago
gclient.py [gclient hooks] add .bat to vpython on windows 8 years ago
gclient_completion.sh Added basic completion (the commands) for gclient. 11 years ago
gclient_eval.py gclient conditionals are supposed to allow '!=', but don't currently. 8 years ago
gclient_scm.py Revert "git_cache: Remove locks" 8 years ago
gclient_utils.py Reland "gclient runhooks: now with less spammy progress notifications" 8 years ago
gerrit_client.py depot_tools: Fix executable bit for gerrit_*.py 8 years ago
gerrit_util.py Do not delete users' draft comments 8 years ago
git-cache Generalize python_git_runner for use in non-git scripts. 10 years ago
git-cl Generalize python_git_runner for use in non-git scripts. 10 years ago
git-crrev-parse Fix git-crrev-parse on Mac. 8 years ago
git-crsync Invoke the bash shell via /usr/bin/env so that these scripts run on operating systems without /bin/bash too. 11 years ago
git-drover Generalize python_git_runner for use in non-git scripts. 10 years ago
git-find-releases Generalize python_git_runner for use in non-git scripts. 10 years ago
git-footers Generalize python_git_runner for use in non-git scripts. 10 years ago
git-freeze Generalize python_git_runner for use in non-git scripts. 10 years ago
git-gs Add *.proto to git-gs 8 years ago
git-hyper-blame Added git hyper-blame, a tool that skips unwanted commits in git blame. 9 years ago
git-map Generalize python_git_runner for use in non-git scripts. 10 years ago
git-map-branches Generalize python_git_runner for use in non-git scripts. 10 years ago
git-mark-merge-base Generalize python_git_runner for use in non-git scripts. 10 years ago
git-nav-downstream Generalize python_git_runner for use in non-git scripts. 10 years ago
git-nav-upstream Remove useless comments from git bash wrappers. 11 years ago
git-new-branch Generalize python_git_runner for use in non-git scripts. 10 years ago
git-number Generalize python_git_runner for use in non-git scripts. 10 years ago
git-rebase-update Generalize python_git_runner for use in non-git scripts. 10 years ago
git-rename-branch Generalize python_git_runner for use in non-git scripts. 10 years ago
git-reparent-branch Generalize python_git_runner for use in non-git scripts. 10 years ago
git-retry Generalize python_git_runner for use in non-git scripts. 10 years ago
git-runhooks Invoke the bash shell via /usr/bin/env so that these scripts run on operating systems without /bin/bash too. 11 years ago
git-squash-branch Generalize python_git_runner for use in non-git scripts. 10 years ago
git-thaw Generalize python_git_runner for use in non-git scripts. 10 years ago
git-upstream-diff Generalize python_git_runner for use in non-git scripts. 10 years ago
git_cache.py git_cache: lower max num of .pack files before re-bootstrap on Win. 8 years ago
git_cl.py Add OutputApi.AppendCC to allow presubmit checks to add CCs 8 years ago
git_cl_completion.sh Add git cl bash completition. 9 years ago
git_common.py [presubmit] Add check to call validation endpoint for config files 8 years ago
git_dates.py Added git hyper-blame, a tool that skips unwanted commits in git blame. 9 years ago
git_drover.py git-drover: send mail and don't use WIP mode 8 years ago
git_find_releases.py find-releases: handle untagged merges 10 years ago
git_footers.py git_footers: fix bug stdin-based message input. 8 years ago
git_freezer.py Handle KeyboardInterrupt consistently in python scripts 10 years ago
git_hyper_blame.py git hyper-blame: Fixed --no-default-ignores option to not take argument. 8 years ago
git_map.py git-map: use committer date instead of author date 8 years ago
git_map_branches.py Update help text for git-map-branches 8 years ago
git_mark_merge_base.py Handle KeyboardInterrupt consistently in python scripts 10 years ago
git_nav_downstream.py Handle KeyboardInterrupt consistently in python scripts 10 years ago
git_new_branch.py Clarify how `new-branch` is different for --help 9 years ago
git_number.py Pass user name and email to git-number's initial commit. 8 years ago
git_rebase_update.py Flush stdout before squash attempt 8 years ago
git_rename_branch.py Handle KeyboardInterrupt consistently in python scripts 10 years ago
git_reparent_branch.py Add better error messages to git_reparent_branch. 10 years ago
git_retry.py [git retry] Fix Git wrapper fallthrough. 8 years ago
git_squash_branch.py Include branch name in git-squash-branch's default message 8 years ago
git_upstream_diff.py git-upstream-diff: add optional branch argument 8 years ago
gn Add executable and line ending properties for GN. 12 years ago
gn.bat [.bat] Remove "depot_tools" override. (#2) 8 years ago
gn.py Handle KeyboardInterrupt consistently in python scripts 10 years ago
gsutil.py Fix depot_tools errors that cause runhooks to be inoperable for Cygwin 8 years ago
gsutil.vpython [gsutil.vpython] Update packages. 8 years ago
led [bootstraps] Sync at gclient, suppress output (#2) 8 years ago
led.bat [bootstraps] Sync at gclient, suppress output (#2) 8 years ago
mac_toolchain depot_tools: add mac_toolchain shim 8 years ago
my_activity.py Add support for PDFium to my_activity.py 8 years ago
my_reviews.py Use dateutil.parser for parsing dates. 8 years ago
ninja Update ninja to v1.8.2 8 years ago
ninja-linux32 Update ninja to v1.8.2 8 years ago
ninja-linux64 Update ninja to v1.8.2 8 years ago
ninja-mac Update ninja to v1.8.2 8 years ago
ninja.exe Update ninja to v1.8.2 8 years ago
owners.py Also check override files before checking the fs 8 years ago
owners_finder.py Use OldContents() for OWNERS files to do checks 8 years ago
patch.py Revert "Fix checkout.py issues when p.patchlevel > 1." 8 years ago
presubmit_canned_checks.py [presubmit] Rename to CheckChangedLUCIConfigs 8 years ago
presubmit_support.py Fix silly bug in presubmit_support implementation of AppendCC. 8 years ago
profile.xml Create the Next Generation of depot_tools. Eh. 16 years ago
pylint Fix git-cl quoting, yet again. 12 years ago
pylint.py Permits running pylint without pylintrc. 10 years ago
pylintrc depot_tools: Replace pylint error numbers with symbolic names. 8 years ago
python_runner.sh Multiple improvements to windows bash integration. 9 years ago
repo repo: update to v1.12.34-cr2 9 years ago
rietveld.py Change rietveld.py to use GET on get_depends_on_patchset 8 years ago
roll-dep Convenience tool for rolling git-style deps with an svn revision. 11 years ago
roll-dep-svn Revert of Delete roll-dep-svn (patchset #1 id:1 of https://codereview.chromium.org/2282223002/ ) 9 years ago
roll-dep-svn.bat [.bat] Remove "depot_tools" override. (#2) 8 years ago
roll-dep.bat [.bat] Remove "depot_tools" override. (#2) 8 years ago
roll_dep.py roll-dep: Add comments indicating that --no-log needs to keep working 8 years ago
roll_dep_svn.py Update roll_dep_svn for new DEPS syntax 8 years ago
scm.py Correct Git show's path format on Windows 8 years ago
setup_color.py setup_color.py should not be executable, as it pollutes $PATH. 8 years ago
split_cl.py Fix git cl upload --send-mail typo in split_cl.py 8 years ago
subcommand.py Revert "gclient: return non-zero exit code on unknown command" 8 years ago
subprocess2.py depot_tools: Replace pylint error numbers with symbolic names. 8 years ago
update_depot_tools Revert "update_depot_tools: make cipd_bin_setup failures fatal" 8 years ago
update_depot_tools.bat [bootstraps] Sync at gclient, suppress output (#2) 8 years ago
update_depot_tools_toggle.py [auto_update] Add control script, allow disable. 8 years ago
upload_to_google_storage.py Make download_from_google_storage.py print nothing in the happy case where it needs to do nothing. 8 years ago
vpython [bootstraps] Sync at gclient, suppress output (#2) 8 years ago
vpython.bat [bootstraps] Sync at gclient, suppress output (#2) 8 years ago
watchlists.py watchlists: Precompile filepath regular expressions before using them. 8 years ago
weekly Adding weekly tool to help with weekly snippets 15 years ago
wtf fix wtf crash when deps entry is at None 13 years ago

README.md

depot_tools

Tools for working with Chromium development. It requires python 2.7.

Tools

The most important tools are:

  • fetch: A gclient wrapper to checkout a project. Use fetch --help for more details.
  • gclient: A meta-checkout tool. Think repo or git submodules, except that it support OS-specific rules, e.g. do not checkout Windows only dependencies when checking out for Android. Use gclient help for more details and README.gclient.md.
  • git cl: A code review tool to interact with Rietveld or Gerrit. Use git cl help for more details and README.git-cl.md.
  • roll-dep: A gclient dependency management tool to submit a dep roll, updating a dependency to a newer revision.

There are a lot of git utilities included.

Updating

depot_tools updates itself automatically when running gclient tool. To disable auto update, set the environment variable DEPOT_TOOLS_UPDATE=0.

To update package manually, run update_depot_tools.bat on Windows, or ./update_depot_tools on Linux or Mac.

On Windows only, running gclient will install git and python.

Contributing

To contribute change for review:

git new-branch <somename>
# Hack
git add .
git commit -a -m "Fixes goat teleporting"
# find reviewers
git cl owners
git log -- <yourfiles>

# Request a review.
git cl upload -r reviewer1@chromium.org,reviewer2@chromium.org --send-mail

# Edit change description if needed.
git cl desc

# If change is approved, flag it to be committed.
git cl set-commit

# If change needs more work.
git rebase-update
...
git cl upload -t "Fixes goat teleporter destination to be Australia"

See also open bugs, open reviews, forum or report problems.

cpplint.py

To update cpplint.py, please submit the change upstream first at https://github.com/google/styleguide/tree/gh-pages/cpplint then copy it down.