Running Tests on the Cloud
Before running tests on the Narya platform, ensure that your project is set up on the platform and that you have granted permission to the Narya GitHub App. For more information, refer to this document.
Access the Narya web application at https://app.narya.ai.
Monitoring Branch
Narya monitors the pnm-tests
branch in the repository. Whenever a new commit is pushed, the Narya platform automatically runs tests on it. If you wish to use a different branch for monitoring, please contact us.
Monitoring Folder
All tests under the test
folder will be run by the engine. To better organize your tests, we recommend placing invariant tests under the test/invariants
folder.
Running Simulations
A simulation can run indefinitely, but the simulation iteration number and coverage are not linear. The engine will stop automatically once it is confident enough about the coverage.
Viewing Test Results
You can view the results for the latest pushed commit in the monitoring branch on the Narya dashboard at https://app.narya.ai.
If assertions fail and tests break, the engine generates a report.
Clicking the call sequence card will take you to the call trace page, where you can see the entire trace for the simulation. It provides a lot of details that can help you understand what is happening and why the assertions or tests failed.
Learn More
- For information about all test types, see Test Types.
- For more test examples, visit NaryaAI/narya-examples.
- For cheat codes (test utilities), check out: