Skip to content

Commit

Permalink
fix extra whitespace causing pre-commit check fail
Browse files Browse the repository at this point in the history
  • Loading branch information
dom-white committed Oct 4, 2023
1 parent 6ba823d commit ae93811
Showing 1 changed file with 1 addition and 3 deletions.
4 changes: 1 addition & 3 deletions docs/text/tsfresh_on_a_cluster.rst
Original file line number Diff line number Diff line change
Expand Up @@ -215,7 +215,7 @@ By default tsfresh uses parallelization to distribute the single-threaded python

However, this can create an issue known as over-provisioning. Many of the underlying python libraries (e.g. numpy) used in the feature calculators have C code implementations for their low-level processing. Those `also` try to spread their workload between as many cores available - which is in conflict with the parallelization done by tsfresh.

Over-provisioning is inefficient because of the overheads of repeated context switching.
Over-provisioning is inefficient because of the overheads of repeated context switching.

This issue can be solved by constraining the C libraries to single threads, using the following environment variables:

Expand All @@ -229,5 +229,3 @@ This issue can be solved by constraining the C libraries to single threads, usin
Put these lines at the beginning of your notebook/python script - before you call any tsfresh code or import any other module.

The more cores your host computer has, the more improvement in processing speed will be gained by implementing these environment changes. Speed increases of between 6x and 26x have been observed depending on the type of the host machine.


0 comments on commit ae93811

Please sign in to comment.