Contents ======== This directory contains tools for developers working on this repository.
deterministic-fuzz-coverage ===========================
A tool to check for non-determinism in fuzz coverage. To get the help, run:
RUST_BACKTRACE=1 cargo run --manifest-path ./contrib/devtools/deterministic-fuzz-coverage/Cargo.toml -- --help
To execute the tool, compilation has to be done with the build options `-DCMAKECCOMPILER='clang' -DCMAKECXXCOMPILER='clang++' -DBUILDFORFUZZING=ON -DCMAKECXXFLAGS='-fPIC -fprofile-instr-generate -fcoverage-mapping'`. Both llvm-profdata and llvm-cov must be installed. Also, the qa-assets repository must have been cloned. Finally, a fuzz target has to be picked before running the tool:
RUST_BACKTRACE=1 cargo run --manifest-path ./contrib/devtools/deterministic-fuzz-coverage/Cargo.toml -- $PWD/build_dir $PWD/qa-assets/corpora-dir fuzz_target_name
clang-format-diff.py ===================
A script to format unified git diffs according to .clang-format.
Requires clang-format, installed e.g. via brew install clang-format on macOS,
or sudo apt install clang-format on Debian/Ubuntu.
For instance, to format the last commit with 0 lines of context, the script should be called from the git root folder as follows.
git diff -U0 HEAD~1.. | ./contrib/devtools/clang-format-diff.py -p1 -i -v
copyright_header.py ====================
Provides utilities for managing copyright headers of `The Limenka developers` in repository source files. It has three subcommands:
$ ./copyright_header.py report <base_directory> [verbose]
$ ./copyright_header.py update <base_directory>
$ ./copyright_header.py insert <file>
Running these subcommands without arguments displays a usage string.
copyright_header.py report \<base_directory\> [verbose]
Produces a report of all copyright header notices found inside the source files
of a repository. Useful to quickly visualize the state of the headers.
Specifying verbose will list the full filenames of files of each category.
copyright_header.py update \<base_directory\> [verbose]
Updates all the copyright headers of The Limenka developers which were
changed in a year more recent than is listed. For example:
// Copyright (c) <firstYear>-<lastYear> The Limenka developers
will be updated to:
// Copyright (c) <firstYear>-<lastModifiedYear> The Limenka developers
where <lastModifiedYear> is obtained from the git log history.
This subcommand also handles copyright headers that have only a single year. In those cases:
// Copyright (c) <year> The Limenka developers
will be updated to:
// Copyright (c) <year>-<lastModifiedYear> The Limenka developers
where the update is appropriate.
copyright_header.py insert \<file\>
Inserts a copyright header for The Limenka developers at the top of the
file in either Python or C++ style as determined by the file extension. If the
file is a Python file and it has #! starting the first line, the header is
inserted in the line below it.
The copyright dates will be set to be <year_introduced>-<current_year> where
<year_introduced> is according to the git log history. If
<year_introduced> is equal to <current_year>, it will be set as a single
year rather than two hyphenated years.
If the file already has a copyright for The Limenka developers, the
script will exit.
gen-manpages.py ===============
A small script to automatically create manpages in ../../doc/man by running the release binaries with the -help option. This requires help2man which can be found at: https://www.gnu.org/software/help2man/
This script assumes a build directory named build as suggested by example build documentation.
To use it with a different build directory, set BUILDDIR.
For example:
BUILDDIR=$PWD/my-build-dir contrib/devtools/gen-manpages.py
headerssync-params.py =====================
A script to generate optimal parameters for the headerssync module (src/headerssync.cpp). It takes no command-line options, as all its configuration is set at the top of the file. It runs many times faster inside PyPy. Invocation:
pypy3 contrib/devtools/headerssync-params.py
gen-limenka-conf.sh ===================
Generates a limenka.conf file in share/examples/ by parsing the output from limenkad --help. This script is run during the
release process to include a limenka.conf with the release binaries and can also be run by users to generate a file locally.
When generating a file as part of the release process, make sure to commit the changes after running the script.
This script assumes a build directory named build as suggested by example build documentation.
To use it with a different build directory, set BUILDDIR.
For example:
BUILDDIR=$PWD/my-build-dir contrib/devtools/gen-limenka-conf.sh
security-check.py =================
Perform basic security checks on a series of executables.
symbol-check.py ===============
A script to check that release executables only contain certain symbols and are only linked against allowed libraries.
For Linux this means checking for allowed gcc, glibc and libstdc++ version symbols. This makes sure they are still compatible with the minimum supported distribution versions.
For macOS and Windows we check that the executables are only linked against libraries we allow.
Example usage:
find ../path/to/executables -type f -executable | xargs python3 contrib/devtools/symbol-check.py
If no errors occur the return value will be 0 and the output will be empty.
If there are any errors the return value will be 1 and output like this will be printed:
.../64/testlimenka: symbol memcpy from unsupported version GLIBC2.14 .../64/testlimenka: symbol fdeltchk from unsupported version GLIBC_2.15 .../64/testlimenka: symbol std::outofrange::~outofrange() from unsupported version GLIBCXX3.4.15 .../64/testlimenka: symbol ZNSt8_detail15Listnod from unsupported version GLIBCXX3.4.15
circular-dependencies.py ========================
Run this script from the root of the source tree (src/) to find circular dependencies in the source code.
This looks only at which files include other files, treating the .cpp and .h file as one unit.
Example usage:
cd .../src ../contrib/devtools/circular-dependencies.py {,/,//}.{h,cpp}