Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

End to end and stress tests #238

Open
arschles opened this issue Aug 23, 2021 · 11 comments
Open

End to end and stress tests #238

arschles opened this issue Aug 23, 2021 · 11 comments
Labels
feature help wanted Extra attention is needed testing

Comments

@arschles
Copy link
Collaborator

arschles commented Aug 23, 2021

We currently have mostly unit tests inside this repository, along with a few integration tests (like one for the interceptor coming in #206). I propose that we add more testing strategies to this project, including:

  • end to end: a test that installs the addon to a Kubernetes cluster along with KEDA and any other dependencies, installs an app and an HTTPScaledObject, and runs a quick suite of requests to trigger scale-from-zero, scale up, and scale back down to zero. this test should check that the app and the interceptor both scale properly, and that the external scaler, operator, and interceptor's admin endpoints all report the expected things (NOTE: KEDA does this, and there is a prototype of something similar in Multi-tenant interceptor and scaler #206)
  • stress: a test that runs a large number of requests concurrently against an interceptor fleet, optionally for a large period of time. also possibly inspect internal admin endpoints along the way to ensure that metrics report as expected. the main purpose of this test is to ensure that, from the outside, requests get serviced as expected
@arschles
Copy link
Collaborator Author

@ajanth97 are you interested in implementing either one of these at some point?

@arschles arschles mentioned this issue Sep 14, 2021
5 tasks
@arschles arschles added this to the v0.3.0 milestone Oct 8, 2021
@stale
Copy link

stale bot commented Dec 7, 2021

This issue has been automatically marked as stale because it has not had recent activity. It will be closed in 7 days if no further activity occurs. Thank you for your contributions.

@stale stale bot added the stale All issues that are marked as stale due to inactivity label Dec 7, 2021
@ajanth97
Copy link
Collaborator

ajanth97 commented Dec 8, 2021

@arschles sorry I just saw this. yeah will do when I get some time

@stale stale bot removed the stale All issues that are marked as stale due to inactivity label Dec 8, 2021
@arschles
Copy link
Collaborator Author

arschles commented Dec 8, 2021

sounds good @ajanth97 - thanks!

@tomkerkhove tomkerkhove removed this from the v0.4.0 milestone May 11, 2022
@v-shenoy
Copy link
Contributor

I am currently working on this.

@v-shenoy v-shenoy removed their assignment Nov 22, 2022
@JorTurFer
Copy link
Member

JorTurFer commented Jan 13, 2023

e2e test are executed on every PR/Push #564

@HongboFei
Copy link

should we close this one if done?

@JorTurFer
Copy link
Member

Stress tests are still pending, we could cose this and open another issue for stress test if we want to have it more accuracy tracked

@HongboFei
Copy link

OK, thanks Jorge. That;s OK. We can keep it what it is.

@JorTurFer
Copy link
Member

@MrsDaehin , may you be interested in help with this too? (after core load tests are ready, ofc) This is easier to test indeed because this is closer to an API (and here the load should be higher)

@MrsDaehin
Copy link

we can discuss this. It will be easy once we got k6 running.

@JorTurFer JorTurFer added the help wanted Extra attention is needed label Apr 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature help wanted Extra attention is needed testing
Projects
Status: To Do
Development

Successfully merging a pull request may close this issue.

7 participants