You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
Go to file
Sylvain Defresne 7b4ecc7c35 [apple] Raise max number of open file descriptors if possible
On macOS the default limit on open file descriptors is really low
and causes ninja to fail with 'Too many open files' if run with a
value of -j greater than 200.

Running only 200 jobs however slow down the build considerably so
check whether the limit has been raised by the user or if it can
be raised programmatically. In the positive case, use a limit of
800 jobs, otherwise settle down on 200 jobs.

This should allow running ninja with a large number of jobs even
on macOS Ventura 13.5 which now requires to set the limit both in
/Library/LaunchDaemons/limit.maxfiles.plist and via ulimit -n.

Bug: 1467777
Change-Id: Ib8b7d0d1ee47d243c1872229c5340e7795c1b42e
Reviewed-on: https://chromium-review.googlesource.com/c/chromium/tools/depot_tools/+/4725183
Auto-Submit: Sylvain Defresne <sdefresne@chromium.org>
Reviewed-by: Dirk Pranke <dpranke@google.com>
Commit-Queue: Sylvain Defresne <sdefresne@chromium.org>
3 years ago
bootstrap
fetch_configs Set managed:True for infra_superproject configs. 3 years ago
git-templates
infra Roll recipe dependencies (trivial). 3 years ago
man [docs] Improve `git cl patch --help` 3 years ago
python-bin
python2-bin
recipes Roll recipe dependencies (trivial). 3 years ago
testing_support Adding batch CIPD version resolution to gclient. 3 years ago
tests Convert branch revision to remote branch in status call. 3 years ago
third_party [ssci] Added Shipped field to READMEs 3 years ago
win_toolchain Improve .boto message visibility 3 years ago
zsh-goodies
.cipd_impl.ps1 Import Get-FileHash from PowerShell's version specific path 3 years ago
.gitattributes Add lib to recipe cipd package 3 years ago
.gitignore Implement reclient metrics uploading 3 years ago
.isort.cfg
.style.yapf
.vpython
.vpython3 Add brotli to .vpython3 for depot_tools 3 years ago
BUILD_OWNERS add siso wrapper 3 years ago
CROS_OWNERS
DIR_METADATA
LICENSE
LUCI_OWNERS Revert "New vpython to depot_tools" 3 years ago
OWNERS Implement reclient metrics uploading 3 years ago
PRESUBMIT.py PRESUBMIT.py: remove `USE_PYTHON3 = True` 3 years ago
README.gclient.md
README.git-cl.md
README.md
RECLIENT_OWNERS Add convenience wrapper for reclientreport for autoninja users 3 years ago
WATCHLISTS Update WATCHLISTS for ninja, siso and reclient changes 3 years ago
auth.py
autoninja
autoninja.bat
autoninja.py [apple] Raise max number of open file descriptors if possible 3 years ago
autosiso [siso] add autosiso wrappers 3 years ago
autosiso.bat [autosiso] Do not double quote arguments on Windows. 3 years ago
autosiso.py Mark reclient build metrics with the tool that started reclient 3 years ago
bb
bb.bat
black
bootstrap_python3 Use relative path for cipd 3 years ago
breakpad.py
cbuildbot
cipd Revert "loongarch64: Add loongarch64 architecture detection support." 3 years ago
cipd.bat [cipd] Run cipd_impl.ps1 in constrained language mode 3 years ago
cipd_bin_setup.bat
cipd_bin_setup.sh
cipd_client_version [auth]: Update CIPD to include version update of luci-auth change. 3 years ago
cipd_client_version.digests [auth]: Update CIPD to include version update of luci-auth change. 3 years ago
cipd_manifest.txt Roll lucicfg v1.39.8 -> v1.39.10 3 years ago
cipd_manifest.versions Roll lucicfg v1.39.8 -> v1.39.10 3 years ago
cipd_manifest_cros_python2.txt
cipd_manifest_cros_python2.versions
clang-format
clang-format.bat
clang_format.py
clang_format_merge_driver
clang_format_merge_driver.bat
clang_format_merge_driver.py
codereview.settings
compile_single_file
compile_single_file.bat
compile_single_file.py
cpplint.bat
cpplint.py Update TODO pattern to not match other names 3 years ago
cpplint_chromium.py
cros [cros] Update "Chromium OS" to "ChromiumOS" 3 years ago
cros_python2.vpython
cros_sdk
crosjobs
detect_host_arch.py Revert "loongarch64: Add loongarch64 architecture detection support." 3 years ago
dirmd
dirmd.bat
download_from_google_storage
download_from_google_storage.bat
download_from_google_storage.py Handle 401 from gsutil 3 years ago
ensure_bootstrap
fetch [py2] Drop envvar to run scripts with py2 3 years ago
fetch.bat [py2] Drop envvar to run scripts with py2 3 years ago
fetch.py
fix_encoding.py
gclient [py2] Drop envvar to run scripts with py2 3 years ago
gclient-new-workdir.py
gclient.bat [py2] Drop envvar to run scripts with py2 3 years ago
gclient.py Fix gclient read submodule path 3 years ago
gclient_completion.sh
gclient_eval.py Add git_dependencies flag to DEPS 3 years ago
gclient_paths.py Suppress stderr of the git rev-parse command 3 years ago
gclient_scm.py Convert branch revision to remote branch in status call. 3 years ago
gclient_utils.py [gclient_utils] Make git tools set `gitcommit` modeline in vim. 3 years ago
gerrit Symlink gerrit CLI into depot_tools 3 years ago
gerrit_client.py gerrit_client: changes: support raw search queries 3 years ago
gerrit_util.py Bump Gerrit fetch retry logic to 6 tries and 12s initial sleep 3 years ago
git-cache
git-cl
git-crrev-parse
git-drover
git-find-releases
git-footers
git-freeze
git-gs
git-hyper-blame
git-map
git-map-branches
git-mark-merge-base
git-migrate-default-branch
git-nav-downstream
git-nav-upstream
git-new-branch
git-number
git-rebase-update
git-rename-branch
git-reparent-branch
git-retry
git-runhooks
git-squash-branch
git-thaw
git-upstream-diff
git_cache.py Reset git_cache mirror when HEAD points to master 3 years ago
git_cl.py [docs] Improve `git cl patch --help` 3 years ago
git_cl_completion.sh
git_common.py [git-freeze] Fix error in git-add invocation when not in repo root. 3 years ago
git_dates.py
git_drover.py
git_find_releases.py
git_footers.py
git_freezer.py [git-freeze] Ignore submodules when freezing. 3 years ago
git_hyper_blame.py
git_map.py
git_map_branches.py Support dormant branches in the git map-branches output. 3 years ago
git_mark_merge_base.py
git_migrate_default_branch.py Revert "Move scm.py to lib/" 3 years ago
git_nav_downstream.py
git_new_branch.py
git_number.py
git_rebase_update.py [git-rebase-update] Ignore submodules when checking tree status. 3 years ago
git_rename_branch.py
git_reparent_branch.py [git-reparent-branch] Keep empty branches when doing rebase-update. 3 years ago
git_retry.py
git_squash_branch.py
git_upstream_diff.py
gn
gn.bat
gn.py
goma_auth
goma_auth.bat
goma_ctl Skip goma on unsupported platforms 3 years ago
goma_ctl.bat
gsutil.py Improve .boto message visibility 3 years ago
gsutil.py.bat
gsutil.vpython3
infra_to_superproject Use shutil.copytree instead for migration script instead. 3 years ago
infra_to_superproject.bat Use shutil.copytree instead for migration script instead. 3 years ago
infra_to_superproject.py Fix infra_to_superproject for Linux 3 years ago
isort
led
led.bat
lockfile.py
luci-auth
luci-auth.bat
lucicfg
lucicfg.bat
mac_toolchain
metrics.README.md
metrics.py
metrics_utils.py Use exit code 130 for keyboard interrupts 3 years ago
my_activity.py
ninja
ninja.bat
ninja.py Fix a spelling error in a comment 3 years ago
ninja_reclient.py Mark reclient build metrics with the tool that started reclient 3 years ago
ninjalog.README.md
ninjalog_uploader.py [ninjalog_uploader] Exclude absolute paths and options from targets 3 years ago
ninjalog_uploader_wrapper.py
owners_client.py Update code-owners documentation links 3 years ago
owners_finder.py
pinpoint
pinpoint.bat
post_build_ninja_summary.py
presubmit_canned_checks.py [depot_tools] Clarify error message for license headers. 3 years ago
presubmit_support.py config: use lucicfg validate to validate the config files 3 years ago
profile.xml
prpc
prpc.bat
pylint-2.6
pylint-2.6.bat
pylint-2.7
pylint-2.7.bat
pylint_main.py
pylintrc
python_runner.sh [py2] Drop envvar to run scripts with py2 3 years ago
rdb
rdb.bat
rdb_wrapper.py
reclient_helper.py [reclient] Set some sensible defaults for racing that match goma 3 years ago
reclient_metrics.README.md [reclient] Update reclient_metrics.README.md to reflect that we collect googler hostnames 3 years ago
reclient_metrics.py Implement reclient metrics uploading 3 years ago
reclientreport Add convenience wrapper for reclientreport for autoninja users 3 years ago
reclientreport.bat Remove unnesisary quotes from propagated args in reclientreport.bat 3 years ago
reclientreport.py Fix reclientreport after functions moved to reclient_helper 3 years ago
repo repo: unfork our launcher 3 years ago
repo_launcher repo: unfork our launcher 3 years ago
roll-dep [py2] Drop envvar to run scripts with py2 3 years ago
roll-dep.bat [py2] Drop envvar to run scripts with py2 3 years ago
roll_dep.py
rustfmt.py
scm.py Revert "Move scm.py to lib/" 3 years ago
setup_color.py
siso add siso wrapper 3 years ago
siso.bat add siso wrapper 3 years ago
siso.py [siso] check presence of .sisoenv file 3 years ago
split_cl.py Print top reviewers for git cl split 3 years ago
subcommand.py
subprocess2.py
swift-format
swift_format.py
update_depot_tools Call goma_ctl update_hook only after python3 is bootstrapped. 3 years ago
update_depot_tools.bat Call goma_ctl update_hook only after python3 is bootstrapped. 3 years ago
update_depot_tools_toggle.py
upload_metrics.py
upload_to_google_storage.py
utils.py Revert "Extract searching relevat files in utils function" 3 years ago
vpython Remove Python 2 support for presubmit Commands 3 years ago
vpython.bat Remove Python 2 support for presubmit Commands 3 years ago
vpython3 Revert "Resolve symlinks to cipd, vpython3" 3 years ago
vpython3.bat
watchlists.py
weekly
whitespace.txt
win32imports.py
wtf
yapf Update vpython spec for yapf to 0.31.0 3 years ago
yapf.bat

README.md

depot_tools

Tools for working with Chromium development. It requires python 2.7 or 3.8 for python 3 support.

Tools

The most important tools are:

  • fetch: A gclient wrapper to checkout a project. Use fetch --help for more details.
  • gclient: A meta-checkout tool. Think repo or git submodules, except that it support OS-specific rules, e.g. do not checkout Windows only dependencies when checking out for Android. Use gclient help for more details and README.gclient.md.
  • git cl: A code review tool to interact with Rietveld or Gerrit. Use git cl help for more details and README.git-cl.md.
  • roll-dep: A gclient dependency management tool to submit a dep roll, updating a dependency to a newer revision.

There are a lot of git utilities included.

Updating

depot_tools updates itself automatically when running gclient tool. To disable auto update, set the environment variable DEPOT_TOOLS_UPDATE=0 or run ./update_depot_tools_toggle.py --disable.

To update package manually, run update_depot_tools.bat on Windows, or ./update_depot_tools on Linux or Mac.

On Windows only, running gclient will install git and python.

Contributing

To contribute change for review:

git new-branch <somename>
# Hack
git add .
git commit -a -m "Fixes goat teleporting"
# find reviewers
git cl owners
git log -- <yourfiles>

# Request a review.
git cl upload -r reviewer1@chromium.org,reviewer2@chromium.org --send-mail

# Edit change description if needed.
git cl desc

# If change is approved, flag it to be committed.
git cl set-commit

# If change needs more work.
git rebase-update
...
git cl upload -t "Fixes goat teleporter destination to be Australia"

See also open bugs, open reviews, forum or report problems.

cpplint.py

Until 2018, our cpplint.py was a copy of the upstream version at https://github.com/google/styleguide/tree/gh-pages/cpplint. Unfortunately, that repository is not maintained any more. If you want to update cpplint.py in depot_tools, just upload a patch to do so. We will figure out a long-term strategy via issue https://crbug.com/916550.

Note that the cpplint.py here is also used by the Tricium analyzer, so if the cpplint.py here changes, we should also update the copy used there.