Feat/es mapping updates #296
Open
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Merge stg branch into master branch
Prod deployment
Created task to ingest with an upper limit on manifest dates
Added debug
Added debug
Removed month before for limit ingestion
Merge error logs & lambda mapping fix to master
Merge tagging task and routes
Fixed regex to ignore aws:* in most used tags
Added a README in tagging folder
Fixed Circle CI build status in READMEs
Merge tagging suggestions and onboard tagbot
Merge unused accounts into master
Merge resources route changes to master
Merge new entitlement checks
Merge Elasticsearch URL fix & should-popup route
|
This branch needs to be rebased once all other pull requests are merged. |
Merge /costs fix and tagging suggestions confidence
Merge stg into dev
Merge staging into master
Worker for the new Trackit dispatcher
Get the latest tag instead of the oldest
Merge stg into master
|
Updated it to be based on the latest version of stg (although I did a bunch of merges to make the merging process easier rather than a rebase, but I would hope that's fine). |
GabrielRavier
requested review from
cruffinoni and
J3suis
and removed request for
SchneiderNicolas
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR refactors some ES related code: mainly moving everything related to mappings scattered in the code base into a new package.
It also adds versioning of ES index mappings:
a new MySQL keeps track of the template's version used by every index in the ES.
ES updates are only done when the task "update-es-mappings" is run.
This task tries to discover indexes which are not tracked in the Mysql table yet. It also check if there is a new version for existing index' mappings and updates them using the following technique: Changing maping with zero downtime.
This is for review only for now.