Testing and buildbots

• Running and writing tests
  • Running
    • Locale support
    • Unexpected skips
  • Writing
  • Benchmarks
• Silence warnings from the test suite
• Increase test coverage
  • Common gotchas
  • Measuring coverage
    • Using coverage.py
      • Install coverage
      • Basic usage
      • Branch coverage
    • Using test.regrtest
  • Filing the issue
  • Measuring coverage of C code with gcov and lcov
• Working with buildbots
  • In case of trouble
  • Buildbot failures on pull requests
  • Checking results of automatic builds
  • Stability
  • Flags-dependent failures
  • Ordering-dependent failures
  • Transient failures
• New buildbot workers
  • Preparing for buildbot worker setup
  • Setting up the buildbot worker
    • Conventional always-on machines
    • Latent workers
  • Buildbot worker operation
  • Required ports
  • Required resources
  • Security considerations