Contributing
Polyscope is an open-source project, and you are encouraged to contribute! The core library is lives in this repository, with documentation here and Python bindings here.
All contributions will be released under Polyscope’s MIT license.
How to make a great pull request:
Implement a feature or fix a bug
Write a new unit test and run tests
Submit a PR and ensure automated tests pass
Update the documentation
Create any new Python bindings
Of course, contributions that only do some of the above are still welcome and appreciated! But doing all of these steps means your pull request is most likely to be merged right away.
The sections below go in to more detail on each of these steps.
C++ implementation
C++ vs. Python contributions
Polyscope is implemented as a C++ library, with a thin binding layer to Python.
All functionality is implemented on the C++ side—pull requests which implement new features solely on the Python side or using external Python dependencies generally will not be accepted. Please file an issue asking first if you are unsure! Of course, bugfixes and additions to the Python binding layer itself are an exception.
Conversely, any new C++ features are strongly encouraged to add corresponding Python bindings! See below.
A few general pointers:
-
The UI (menus, dialogs, buttons, etc) is managed using Dear ImGUI, which is very well-documented and has many resources available online.
-
Core rendering logic and shaders are implemented in the
/render
subdirectory, particularlyengine.h
. The engine is written to abstract over rendering backends, but at the moment only openGL is supported. There is also a “mock” backend for testing; new rendering features should be mirrored in bothgl_engine.cpp
andmock_gl_engine.cpp
. -
Polyscope shaders use a custom in-house shader builder, which performs string manipulation with a simple substitution language to build shaders at runtime which support optional features like slice planes, transparency, different quantity visualization policies, etc. The shaders themselves also explicitly track some metadata like what attributes and uniforms they require. Examples of base shaders can be found e.g. here, and substitution rules here. For any shader or rule to be available in Polyscope, it must be registered in
GLEngine::populateDefaultShadersAndRules()
, and also in the corresponding function of the mock engine for testing. -
If adding a new structure or quantity, be sure to make use of the data adaptors for all user inputs. See here for an example. Generally, this means functions which take user data should be templated, and the input then passed through
standardizeArray<>()
orstandardizeVectorArray<>()
, etc. -
If adding new options or parameters to a structure/quantity. Be sure to follow proper encapsulation principles (create getters & setters), and use a persistent values. Check out
PointCloud::pointColor
for a good basic example. Also, all length-valued quantities should use scaled values (as inPointCloud::pointRadius
).
Unit testing
Whenever possible, add a unit test that somehow exercises any new functionality or verifies that the bug has been fixed. Polyscope uses the googletest testing framework. See documentation there for test macros, executable options, etc.
In a perfect world, we would actually test that the rendered output from Polyscope is pixel-perfect. However, this is hard for a lot of reasons, so instead most of our tests are just “smoke tests” that call functions with some dummy data and ensure no errors are thrown.
In fact, these tests are often run on headless servers, where we cannot even initialize an openGL environment. For this reason, in addition to the usual openGL
backend, we also have an openGL_mock
backend (implemented here) for testing on headless servers. This backend cannot actually render anything, but still performs many rendering-related sanity checks. If making changes to the rendering engine & shaders, you may find that changes need to be mirrored in mock_gl_engine.cpp
.
To run unit tests locally on your own machine (here, via unix terminal commands), use
cd test
mkdir build && cd build
cmake -DCMAKE_BUILD_TYPE=Debug ..
make -j4
./bin/polyscope-test backend=openGL3_glfw
which should create a window onscreen and run tests for a few seconds.
Additionally, run the tests again like
./bin/polyscope-test
which will use the openGL_mock
backend (you will not see anything onscreen). This is how testing will be performed on the headless CI servers. If both sets of tests pass without errors, you are good to go.
PRs & automated tests
Once your feature seems ready and unit tests are passing, submit a pull request to the main repository. This will trigger continuous integration (CI) tests via Github Actions to automatically compile the code on a collection of windows/mac/linux machines with various compilers, and verify that tests pass. If there are any issues, a failed “check” will show on the pull request page which you can click to learn more.
If this is your first contribution to Polyscope, a maintainer will need to manually approve the CI run (this is a github restriction).
You are welcome to reach out in the PR chat to sort out any problems. We may request changes! If a PR ever goes more than a few days without a response feel free to ping @nmwsharp.
Documentation
Documentation is hosted in its own separate repository. Polyscope docs use the mkdocs documentation engine, with the mkdocs-material theme (this theme is quite large and adds significant functionality beyond base mkdocs). The documentation is written in a large collection of markdown files; it is not automatically scraped from the code, or code comments, etc, so we must manually keep it up to date.
There are two duplicate copies of all the docs for C++ and Python, stored in parallel directories /cpp
and /py
. A few shared files and assets are stored in the /shared
directory, or symlinked from the /py
subdirectory to point to a file the /cpp
directory. We try to keep these two parallel versions in sync as much as possible, only differing where necessary between C++ and Python.
To preview the documentation while editing, first install the necessary packages with pip install mkdocs mkdocs-material==6.2.8 mkdocs-macros-plugin pygments
. Then run python3 -m mkdocs serve
(run this command from the /cpp
directory to view C++ docs, and likewise for /py
). A local address will be printed to your terminal, which you can navigate to in-browser to see the docs.
Hopefully editing the docs markdown files should be self-evident, you can mainly copy existing content & formatting. Any new files need to be added the manifests in mkdocs.yml
. Don’t forget to add a blurb to the release notes!
If you are not able to build the docs for any reason, it is fine to just edit the markdown files and submit a docs PR with that.
To actually update the hosted documentation files online at polyscope.run, the documentation site needs to be recompiled and committed to the to the /docs
subdirectory. The build_commit_push.sh
script can handle this for you, rebuilding both C++ & Python docs and committing the result to the /docs
subdirectory:
sh build_commit_push.sh
If you include these built docs changes in your PR, the webpage will automatically update when it is merged. Otherwise the maintainers (usually @nmwsharp) will need to run this command and commit the update after accepting your PR.
Python bindings
Python bindings for Polyscope are stored in their own separate repository. We use pybind11 to generate bindings. These bindings are kept as thin wrappers as much as possible, just doing a minimal translation between the C++ interface and typical Python calling conventions.
The bindings are actually managed internally as two separate Python packages: polyscope_bindings
(which contains the raw bindings generated by our pybind11 code), and the higher-level polyscope
(which contains the actual, nice user-facing Python functions). The separation is because there is no way to write additional Python code in the pybind11-generated package, but we often want to do some translation and error checking on the Python side before invoking the bindings. As such, adding a binding generally means writing code in two places:
- Add a new pybind11 C++ binding, like those here
- Add a new Python wrapper function which calls the generated binding, like the ones here
Note that a few stylistic conventions between Python and C++. In particular, we do not expose classes for quantities, but set options via optional keyword arguments when the quantity is added. The pybind11 C++ bindings take Eigen arrays as arguments, because pybind11 performs automatic translation between Eigen/numpy.
Python binding unit tests are stored in /test/polyscope_test.py
. As with C++, these are mainly just simple “smoke tests” which call the functions with dummy data and ensure no errors are thrown. All new bindings functions need a test! To build and test the bindings, first compile the bindings from the polyscope-py
root directory like
mkdir build
cd build
cmake ..
make -j8
python polyscope_test.py
. As you write code, these bindings must be recompiled to reflect any changes to the pybind11 C++. When testing, make sure there is not another copy of Polyscope for Python installed in your system, which might unintentionally be used instead of the development version! Also, the adjacent demo_app.py
can be used for simple testing.
Don’t forget, the Python bindings have a parallel set of docs in the /py
directory. Updates to Python should be reflected there.
When all your tests are passing, create a pull request! As with C++, submitting a pull request to the Python bindings will trigger a cloud build and some automated checks.
Actually deploying a new Python version to pip
and conda
package managers is a somewhat significant process, so we typically group together updates before cutting a new version. Ping @nmwsharp to get a new version deployed. Major and minor versions of the Python library are kept in-sync with the C++ library versions, whereas patch versions (1.2.4
–> 1.2.5
) are used for new updates to the Python bindings only.