v0.21.2 – 2024-06-27

Summary

Small bugfix release to fix ctapipe with scipy 1.14.

Find the changelog in the docs: https://ctapipe.readthedocs.io/en/latest/changelog.html#ctapipe-v0-21-2-2024-06-27
and the list of merged pull requests below.

Contributors

@kosack, @maxnoe, @mexanick and @morcuended

What has changed since v0.21.1

Pull-requests containing changes of multiple nature are repeated.

• Support scipy 1.14, fixes #2568 (#2569) @maxnoe
• Use debug logging for plugin loading details (#2560) @kosack
• Add new version to docs switcher (#2558) @maxnoe

New features

• Feature/custom exit codes in tools (#2566) @mexanick

Maintenance

• Remove unsed config files for old test and quality control systems (#2562) @morcuended

v0.21.1 – 2024-05-15

Summary

This is a small bugfix and maintenance release for 0.21.0.

Find the changelog in the docs: https://ctapipe.readthedocs.io/en/latest/changelog.html#ctapipe-v0-21-1-2024-05-15
and the list of merged pull requests below.

Contributors

@gschwefer and @maxnoe

What has changed since v0.21.0

Pull-requests containing changes of multiple nature are repeated.

• Render changelog for 0.21.1 (#2557) @maxnoe
• Fix StereoTrigger non-deterministically discarding LST-1 in prod6 files (#2552) @maxnoe
• Impact code cleanup (#2551) @gschwefer

Maintenance

• Remove upload to pages ci, replaced by using readthedocs (#2553) @maxnoe

v0.21.0 – 2024-04-26

Summary

This is a pretty large release with lots of changes, new features and a couple of API breaking changes, see below.

The headline feature is that through a lot of work, the ImPACT reconstructor works again.

For the full changelog, see https://ctapipe.readthedocs.io/en/stable/changelog.html#ctapipe-v0-21-0-2024-04-26, for contributors and list of merged PRs, see below.

Contributors

@Hckjs, @LukasBeiske, @LukasNickel, @StFroese, @Tobychev, @aknierim, @ccossou, @dependabot, @dependabot[bot], @gschwefer, @kosack, @maxnoe, @morcuended and @nbiederbeck

What has changed since v0.20.0

Pull-requests containing changes of multiple nature are repeated.

• Prepare changelog for 0.21.0 (#2550) @maxnoe
• Update to bokeh 3 (#2549) @maxnoe
• Compute deconvolution parameters in FlashCamExtractor only as needed (#2545) @maxnoe
• Fix possible out of bounds error in FlashCamExtractor (#2544) @maxnoe
• Fix CI (#2547) @maxnoe
• Add function to get point on shower axis in altaz (#2537) @maxnoe
• Update ImPACT code to work again (#2305) @Tobychev
• Bump JamesIves/github-pages-deploy-action from 4.5.0 to 4.6.0 (#2538) @dependabot
• Interpolate pointing in TableLoader and HDF5EventSource (#2409) @maxnoe
• add SonarQube badges & remove codecov (#2531) @kosack
• Overburden-to-height conversion functions (#2422) @gschwefer
• Add a trait for astropy quantities (#2524) @LukasBeiske
• Add configuration for using CTAO sonarqube to check code (#2463) @maxnoe
• Add a note to CameraGeometry docs about from_name() (#2485) @kosack
• Fix entry point specification (#2516) @maxnoe
• Use signal_fraction for training particle classifier (#2465) @LukasBeiske
• fix some documentation bugs (#2514) @kosack
• Test on python 3.12 (#2486) @maxnoe
• Bump pre-commit/action from 3.0.0 to 3.0.1 (#2510) @dependabot
• Bump codecov/codecov-action from 3 to 4 (#2509) @dependabot
• Bump release-drafter/release-drafter from 5 to 6 (#2508) @dependabot
• Bump andstor/file-existence-action from 2 to 3 (#2506) @dependabot
• Improve logging colorization, fixes #2504 (#2505) @maxnoe
• Fix wrong branch name in README (#2502) @maxnoe
• Fix pydata sphinx theme is not safe for parallel writing warning (#2500) @maxnoe
• Bump actions/cache from 3 to 4 (#2498) @dependabot
• Load constant pointing in TableLoader (#2481) @maxnoe
• Accept CEP 002 (#2400) @kosack
• Bump actions/checkout from 3 to 4 (#2492) @dependabot
• Bump JamesIves/github-pages-deploy-action from 3.7.1 to 4.5.0 (#2494) @dependabot
• Bump actions/upload-artifact from 3 to 4 (#2493) @dependabot
• Bump actions/setup-python from 4 to 5 (#2495) @dependabot
• Update citation year and add link (#2487) @maxnoe
• Write out cross-validation results immediately (#2483) @LukasBeiske
• Update and add missing docstrings related to ML functionalities (#2456) @LukasBeiske
• Let the DispReconstructor also compute a score for the sign prediction (#2479) @maxnoe
• Allow passing of ax to Subarray.peek, do not always call tight_layout (#2369) @maxnoe
• Change how DataWriter writes simulation pointing (#2438) @maxnoe
• Add missing cache=True to numba compilation (#2477) @maxnoe
• Docs: Fix Headings in Docs [Closes #2472] (#2474) @aknierim
• Allow setting n_jobs on tool invocation (#2430) @LukasNickel
• Update citation (#2470) @maxnoe
• Make ML config files more readable and add comments. (#2455) @LukasBeiske
• Remove python warnings (#2421) @LukasNickel
• Enable str/Path as input to get_hdf5_datalevels (#2451) @maxnoe
• Add true_impact_distance to cross validation output (#2468) @LukasBeiske
• Chunked loading of training data (#2423) @LukasBeiske
• Rename single changelog file (#2435) @StFroese
• Removed stray : from ctapipe.io page (#2448) @Tobychev
• Bump setuptools and setuptools scm versions (#2447) @morcuended
• Propose CEP 3: remove image parameters in camera frame (#2405) @maxnoe
• run test only if labels don't contain 'documentation' (#2227) @nbiederbeck
• Fix unwanted default columns in disp output (#2440) @maxnoe
• Add docstring for ctapipe-train-disp-reconstructor (#2420) @LukasBeiske
• Check pointing coordinate frame in DispReconstructor (#2431) @LukasBeiske
• Check if tel_id exists when looking up TelescopeParameters (#2429) @maxnoe
• Fix broken urls in README (#2408) @aknierim
• Fix h_max definition (#2403) @kosack
• Do not use hidden attribute reconstructor._models in ctapipe-apply-models (#2418) @LukasBeiske
• Changed some numpy calls following the numpy 2.0 migration guide (#2406) @Tobychev
• Include example config for ctapipe-train-disp-reconstructor in quickstart tool (#2414) @LukasBeiske
• Fix empty reference location (#2402) @kosack

New features

• Change R1- and DL0-waveforms shape to (n_channels, n_pixels, n_samples) (#2529) @Hckjs
• Change ImageCleaner API (#2511) @Hckjs
• Use intmin for invalid pixel positions, allow empty arguments (#2397) @maxnoe
• Add option to override obs_id in SimTelEventSource (#2411) @maxnoe

API Changes

• Change ImageCleaner API (#2511) @Hckjs
• Refactor/rename datawriter options (redux) (#2520) @kosack
• Move TableLoader traits to read_...-methods (#2482) @Hckjs

Data Model Changes

• Change R1- and DL0-waveforms shape to (n_channels, n_pixels, n_samples) (#2529) @Hckjs
• Change definition of leakage_pixel_{1,2} (#2432) @maxnoe
• Improve column names for disp (#2443) @LukasBeiske
• Add option to override obs_id in SimTelEventSource (#2411) @maxnoe

Bug Fixes

• Properly transform between camera and telescope frame in muon fitter (#2464) @maxnoe

Refactoring and Optimization

• Prevent import of ctapipe.image at import time of ctapipe.io (#2488) @maxnoe

Maintenance

• Use macos 14 (apple arm) in CI (#2534) @maxnoe
• Fix docs build, use sphinxcontrib-bibtex for bibliography (#2536) @maxnoe
• Drop python 3.9 (#2526) @maxnoe
• Fix sonar complaining about statements in notebooks (#2527) @maxnoe
• Update sonar key (#2525) @maxnoe
• Update python version in deploy config (#2523) @maxnoe
• Use ruff for linting (#2416) @maxnoe
• Move options from setup.cfg to pyproject.toml (#2512) @maxnoe
• Switch to src based repository structure (#2459) @maxnoe
• pin scikit-learn to < 1.4, breaks with astropy tables (#2496) @maxnoe
• Add config to let dependabot update github actions (#2490) @maxnoe
• Fix some minor issues found by sonarqube (#2466) @maxnoe
• Move TableLoader traits to read_...-methods (#2482) @Hckjs
• Fix docstring of EventSource (#2419) @maxnoe
• Support for astropy 6 (#2475) @maxnoe
• Fix indentation in docs resulting in wrong rendering (#2462) @maxnoe
• Fix CI after pytest-xdist update (#2469) @maxnoe
• Use editable install to fix coverage (#2460) @maxnoe
• Fix coverage report not being found by codecov (#2458) @maxnoe
• Add more nitpick ignores to fix docs build after traitlets update (#2412) @maxnoe
• Fix docs by adding more traitlets nitpick ignores (#2399) @maxnoe

v0.20.0 – 2023-09-11

Summary

This release has a couple of bug fixes, new features and mainly documentation theme updates, see below for the merged pull requests and find the full changelog on readthedocs

Contributors

@StFroese, @TjarkMiener, @Tobychev, @aknierim, @gschwefer, @jstvdk, @kosack, @maxnoe and Vadym Voitsekhovskyi

What has changed since v0.19.3

Pull-requests containing changes of multiple nature are repeated.

New features

• Add fit status fields to output container of MuonIntensityFitter (#2381) @jstvdk
• R0 and R1 waveform merging (#2386) @TjarkMiener
• Make provenance information in log optional (#2328) @Tobychev

API Changes

• Use int minval instead -1 for invalid telescope ids in SubarrayDescription.tel_index_array, improve docstrings (#2376) @maxnoe
• Remove EventSource.from_config, fixes #2258 (#2384) @maxnoe
• Remove dump-triggers, enable ctapipe-process to store only trigger and simulation data (#2375) @maxnoe

Data Model Changes

• Add fields defined in CTAO DL0 and R1 data models (#2338) @maxnoe
• Remove SimulationConfigContainer.injection_height, add SimulatedShowercontainer.starting_grammage (#2343) @maxnoe

Bug Fixes

• Fix HillasIntersection error for badly reconstructed events (#2265) @gschwefer
• Bug fix in full numeric pixel likelihood calculation (#2388) @gschwefer

Maintenance

• Add changelog for 0.20.0 (#2394) @maxnoe
• Convert all notebooks to sphinx gallery format (#2377) @StFroese
• Use int minval instead -1 for invalid telescope ids in SubarrayDescription.tel_index_array, improve docstrings (#2376) @maxnoe
• Update doc structure and dev guide (#2383) @maxnoe
• Remove no-longer needed importlib_resources (#2389) @maxnoe
• Replace deprecated provision-with-micromamba action with setup-micromamba (#2387) @maxnoe
• Drop support for python 3.8, update env file (#2342) @maxnoe
• Update docs (#2373) @aknierim
• Try to fix readthedocsbuild (#2365) @maxnoe

v0.19.3 – 2023-06-21

Summary

This is a bugfix release, find the list of merged pull requests below, the changelog is available on readthedocs.

Contributors

@LukasBeiske, @clara-escanuela, @kosack and @maxnoe

What has changed since v0.19.2

Pull-requests containing changes of multiple nature are repeated.

• Render changelog for 0.19.3 (#2362) @maxnoe
• Improve docstring and validation of parameters in CameraGeometry (#2361) @maxnoe
• Fix removal of telescope events in software trigger, fixes #2356 (#2357) @maxnoe
• Add support for using toymodel in telescope frame (#2349) @maxnoe
• Fix pixel picking for multiple displays in same figure (#2358) @maxnoe
• Fill reference_location into SubarrayDescription.tel_coords (#2354) @maxnoe
• fix help string in disp reconstructor (#2352) @maxnoe
• Add support for hillas parameters in TelescopeFrame to CameraDisplay (#2347) @maxnoe
• Fix typo in merge tool flag definition (#2341) @LukasBeiske
• Fix return value of NullDataVolumeReducer (#2340) @maxnoe
• Peak time units conversion for the FlashCam reconstructor (#2337) @clara-escanuela

Maintenance

• Improve error messages of expression engine (#2350) @maxnoe

v0.19.2 – 2023-05-17

Summary

This is a bugfix release, see the full changelog in the docs and merged Pull Requests below.

Contributors

@clara-escanuela and @maxnoe

What has changed since v0.19.1

Pull-requests containing changes of multiple nature are repeated.

• Fix peak_time estimation in FlashCamExtractor (#2333) @clara-escanuela

Maintenance

• Render changelog for 0.19.2 (#2334) @maxnoe
• Fix links to docs (#2330) @maxnoe

v0.19.1 – 2023-05-11

Summary

This is mainly a bug fix and maintenance release containing one feature addition.

See the full changelog in the documentation
and the list of merged PRs below.

This is also the first release to support python 3.11.

Contributors

@kosack and @maxnoe

What has changed since v0.19.0

Pull-requests containing changes of multiple nature are repeated.

Bug Fixes

• Do not use pathlib for hdf5 datasets, fixes #2318 (#2319) @maxnoe
• Fix SoftwareTrigger for actual simtel files (#2320) @maxnoe
• Allow training without cross validation (#2310) @maxnoe
• Fix --overwrite for ApplyModel tool (#2311) @maxnoe
• Fix neighbor matrix for no pixels, fixes #2316 (#2317) @maxnoe
• Fix activity start order (#2312) @maxnoe

New Features

• Add possibility to compute multiplicities using FeatureGenerator (#2308) @maxnoe

Maintenance

• Support python 3.11 (#2107) @maxnoe
• Render changelog to prepare for v0.19.1 release (#2327) @maxnoe
• Remove unused codecov (got yanked from pypi) (#2306) @maxnoe
• Deduplicate tomas in mailmap (#2314) @maxnoe

v0.19.0 – 2023-03-31

Summary

This release has only one headline feature: the addition of the FlashCamExtractor to support the signal shaping needed to properly analyze the data of FlashCam.

See the changelog in the documentation and the list of merged PRs down below.

Contributors

@Tobychev, @clara-escanuela, @kosack, @maxnoe and @zinob

What has changed since v0.18.1

Pull-requests containing changes of multiple nature are repeated.

• Flashcam extractor (#2188) @clara-escanuela
• Better errors in case of no events in train tools (#2295) @maxnoe
• Rename GeometryReco to HillasGeometryReco (#2293) @Tobychev

Maintenance

• Render 0.19 changelog using towncrier (#2300) @maxnoe
• Adapt default config for flashcam, bring in line with current grid production (#2299) @maxnoe
• Fix status of CEP-001, add link to PR (#2298) @maxnoe
• Remove or move examples to documentation (#2266) @kosack
• Fixing link to cta-observatory.org (#2297) @zinob
• Install ffmpeg on readthedocs (#2302) @maxnoe

v0.18.1 – 2023-03-17

Summary

This is a bugfix release fixing three bugs and including some maintenance changes to the repository.

See the detailed changelog in the documentation and the list of merged PRs down below.

This release is also the first to include CEP 1, the definition of the CEP process, in the released ctapipe documentation.

Contributors

@LukasBeiske, @StFroese, @Tobychev, @kosack, @maxnoe and @nbiederbeck

What has changed since v0.18.0

Pull-requests containing changes of multiple nature are repeated.

• Render changelog for 0.18.1 (#2290) @maxnoe
• Fix wrong activity meta being written into output files (#2261) @maxnoe
• Only remove sort index from table if input did not contain it (#2288) @maxnoe
• Fix overwrite not working for ctapipe-apply-models (#2287) @maxnoe
• require lint CI before testing (#2281) @nbiederbeck
• Use pre-commit/action (#2276) @nbiederbeck
• Added favicon (#2263) @Tobychev
• Update CI config after default branch renaming (#2254) @maxnoe
• Add pypi badge to readme (#2253) @maxnoe

New features

• CEP-001: Definition of the proposal process (#2256) @Tobychev

Maintenance

• Add missing enter_context for TableLoader in train tools (#2286) @maxnoe
• CEP-001: Definition of the proposal process (#2256) @Tobychev
• Update pre-commit to isort 5.12.0 (#2271) @LukasBeiske
• Make devs aware of debugging and ipdb in docs (#2220) @StFroese
• Fix deprecation warning due to pkg_resources (#2259) @maxnoe

v0.18.0 – 2023-02-09

Summary

For the detailed changelog, please visit https://ctapipe.readthedocs.io/en/latest/changelog.html#ctapipe-v0-18-0-2023-02-09

Below, you can find a list of contributors and grouped list of all merged pull requests.

Contributors

@LukasBeiske, @LukasNickel, @RuneDominik, @StFroese, @Tobychev, @henningpt, @kosack, @maxnoe and @nbiederbeck

What has changed since v0.17.0

Pull-requests containing changes of multiple nature are repeated.

• Render 0.18 changelog using towncrier (#2251) @maxnoe
• Implement part of common reconstructor API (#2229) @maxnoe
• Fix wrong overwrite config in train_* tools (#2243) @maxnoe
• Simplify ChunkIterator, return start, stop, table (#2241) @maxnoe
• Notify users about test_plugin install (#2245) @RuneDominik
• Add HDF5Merger Component, use in MergeTool (#2179) @maxnoe
• Added a bit of clarification of how important classes attribute is to the tool doc (#2231) @Tobychev
• Implement transformation from GroundFrame to EarthLocation (#2167) @maxnoe
• Fix numba version to 0.56 (#2222) @maxnoe
• Move reading of stereo data before skipping empty events in HDF5EventSource (#2189) @maxnoe
• Rename towncrier bug to bugfix (#2202) @nbiederbeck
• Add coordinate overlay plotting to CameraDisplay (#2203) @maxnoe
• Fix unit handling in muon ring_completeness (#2197) @maxnoe
• Add changelogs for PRs merged since 0.17.0 (#2186) @maxnoe
• Fix version requirement for eventio, fixes #2185 (#2187) @maxnoe
• Fix byteorder fitshistogram (#2183) @maxnoe
• Add quality query to display dl1 tool (#2172) @maxnoe
• Run changelog check only on PRs, add support for no-changelog-needed … (#2176) @maxnoe
• Change default behaviour of run_tool (#2175) @nbiederbeck
• Fix docs build for traitlets 5.8 and array field defaults (#2173) @maxnoe
• Improve output of Tool in case of TraitError (#2171) @maxnoe
• Fix loading of observation info in TableLoader (#2163) @LukasBeiske
• Replace usage of deprecated astropy matrix functions (#2166) @maxnoe
• Make number of training events a telescope parameter (#2140) @maxnoe
• Don't use $HOME, use Path.home() instead (#2155) @kosack
• Error deprecationwarnings 2 (#2153) @nbiederbeck
• Improve missing field warning (#2148) @maxnoe
• Add ipython to docs requirements (#2150) @maxnoe
• Chunked model application (#2133) @maxnoe
• Allow lookup of telescope parameters by type (#2120) @maxnoe
• Fix flake8 complaint (#2137) @maxnoe
• fix set_line_hillas (#2134) @StFroese
• remove sort index after sorting (#2132) @maxnoe
• Allow using predicted energy in particle classifier (#2121) @maxnoe
• Speed up loader by using hstack instead of merge where possible (#2126) @maxnoe
• Speed up rotations, closes #2097 (#2098) @StFroese
• Update mailmap (#2117) @maxnoe
• Simplify apply_models (#2113) @maxnoe

New features

• Refactor apply tool to use HDF5Merger, read data only once (#2249) @maxnoe
• Disp reconstruction (#2138) @LukasBeiske
• Add option to configure ml prefixes (#2217) @LukasBeiske
• Improve likelihood muon intensity fitter (#2161) @StFroese
• Implement stereo trigger for subarray triggers (#2136) @maxnoe
• Support different frames for set_line_hillas (#2131) @StFroese
• Machine learning reconstruction (#1767) @maxnoe
• Add and use ComponentName traitlet instead of create_class_enum_trait, fixes #2100, #1874 (#2102) @maxnoe
• Allow overriding url via env variable (#2109) @maxnoe
• Atmosphere models for h_max to X_max conversion (#2000) @kosack

API Changes

• Raise error in case expected telescope-data is missing in HDF5EventSource (#2244) @RuneDominik
• Make muon analysis part of the processing tool (#2168) @StFroese

Bug Fixes

• Add rng attribute back to TrainEnergyRegressor (#2247) @maxnoe
• fix import error in metadata: fails on systems without pwd (#2152) @kosack
• Correctly setup components in dump-instrument-info, add test (#2106) @maxnoe

Refactoring and Optimization

• Use entry_points for plugins (#2101) @maxnoe
• Consistent overwrite (#2213) @LukasNickel
• Tool exit stack (#1926) @maxnoe
• Load observation info with TableLoader; standardize id fields in containers (#2096) @LukasBeiske
• Move impact_distance to coordinates to avoid circular import (#2095) @maxnoe

Maintenance

• Use entry_points for plugins (#2101) @maxnoe
• Consistent overwrite (#2213) @LukasNickel
• Use https links where possible (#2232) @maxnoe
• Fix sonarqube issues (#2215) @maxnoe
• Fix docstring in ImageProcessor (#2180) @maxnoe
• Update README (#2208) @StFroese
• Use weakref.proxy where parent=self. (#2223) @nbiederbeck
• Move test to correct module (#2225) @maxnoe
• Change actions for mamba / pip install methods. (#2207) @nbiederbeck
• Refactor initialization of telescope parameters, move to own module (#2190) @maxnoe
• Upload build docs as artifacts in CI (#2195) @nbiederbeck
• Fix frame name in coordinates warning (#2198) @maxnoe
• Create proper links to the PR in changelog (#2192) @maxnoe
• Raise error if run_tool encounters non-zero exit code and raises is True (#2191) @maxnoe
• Use towncrier for change log (#2144) @StFroese
• Add and use ComponentName traitlet instead of create_class_enum_trait, fixes #2100, #1874 (#2102) @maxnoe
• Update test data url (#2108) @maxnoe
• Only use setup.cfg, automatically include correct python requires in docs (#2093) @maxnoe
• Remove debug print (#2105) @maxnoe
• Fix warnings from deploy workflow (#2085) @maxnoe
• Update citations in README.rst (#2086) @maxnoe