{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":648821994,"defaultBranch":"main","name":"llm-application","ownerLogin":"ray-project","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2023-06-02T22:54:21.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/22125274?v=4","public":true,"private":false,"isOrgOwned":true},"refInfo":{"name":"","listCacheKey":"v0:1686709599.0919502","currentOid":""},"activityList":{"items":[{"before":"c50f2398a96a9272c80f3c48f76408e5dd4dfb9e","after":null,"ref":"refs/heads/preloadweights","pushedAt":"2023-06-14T02:26:39.091Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"kamil-kaczmarek","name":"Kamil Kaczmarek","path":"/kamil-kaczmarek","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/25202075?s=80&v=4"}},{"before":"3aa870b48adc6e648a7963d13985bc0ac332f3fc","after":"eb5b673618b8c68f692964f9c800c9d68c6b9210","ref":"refs/heads/main","pushedAt":"2023-06-14T02:26:32.180Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"kamil-kaczmarek","name":"Kamil Kaczmarek","path":"/kamil-kaczmarek","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/25202075?s=80&v=4"},"commit":{"message":"pre-cache llm model weights (#2)\n\nCo-authored-by: Adam Breindel <c-adam.breindel@anyscale.com>","shortMessageHtmlLink":"pre-cache llm model weights (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"1755896904\" data-permission-text=\"Title is private\" data-url=\"https://github.com/ray-project/llm-application/issues/2\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/ray-project/llm-application/pull/2/hovercard\" href=\"https://github.com/ray-project/llm-application/pull/2\">#2</a>)"}},{"before":null,"after":"c50f2398a96a9272c80f3c48f76408e5dd4dfb9e","ref":"refs/heads/preloadweights","pushedAt":"2023-06-14T01:51:16.844Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"adbreind","name":null,"path":"/adbreind","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1500370?s=80&v=4"},"commit":{"message":"add cell to determine the remote (non-head) node and run a task there to pre-cache llm model weights","shortMessageHtmlLink":"add cell to determine the remote (non-head) node and run a task there…"}},{"before":"e31f9832594d1eb4ed53eccf1b5f1f5dd5e9a8d2","after":"3aa870b48adc6e648a7963d13985bc0ac332f3fc","ref":"refs/heads/main","pushedAt":"2023-06-13T00:51:02.402Z","pushType":"push","commitsCount":1,"pusher":{"login":"kamil-kaczmarek","name":"Kamil Kaczmarek","path":"/kamil-kaczmarek","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/25202075?s=80&v=4"},"commit":{"message":"Update LICENSE\n\nSigned-off-by: Kamil Kaczmarek <kamil@anyscale.com>","shortMessageHtmlLink":"Update LICENSE"}},{"before":"5a9541cba292929a77e37b1311bb7945311338e8","after":null,"ref":"refs/heads/wip-llmprod","pushedAt":"2023-06-13T00:49:58.327Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"kamil-kaczmarek","name":"Kamil Kaczmarek","path":"/kamil-kaczmarek","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/25202075?s=80&v=4"}},{"before":"bd2c868d23bb921faa59e35745d128bc8c3652d0","after":"e31f9832594d1eb4ed53eccf1b5f1f5dd5e9a8d2","ref":"refs/heads/main","pushedAt":"2023-06-13T00:49:54.787Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"kamil-kaczmarek","name":"Kamil Kaczmarek","path":"/kamil-kaczmarek","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/25202075?s=80&v=4"},"commit":{"message":"LLMs in Production - iteration 1 (#1)\n\n* main structure for LLMs in Prod event\r\n\r\n* WIP notebooks and configs\r\n\r\n* update to larger cluster\r\n\r\n* add narrative to App_on_Ray_Serve notebook; update Anyscale service demo to use more replicas + autoscaling, add a little more intro explanation to Multilingual Chat\r\n\r\n* fix typo that broke code\r\n\r\n* update anyscale service yaml to use faster nodes\r\n\r\n* Sync questions between local model and Ray version\r\n\r\n* Remove filler cells from 01_Intro_LocalApp.ipynb\r\n\r\nSigned-off-by: Emmy Li <emmy@anyscale.com>\r\n\r\n* Format 01_Intro_LocalApp.ipynb with black.\r\n\r\nSigned-off-by: Emmy Li <emmy@anyscale.com>\r\n\r\n* Restructure first half (ingestion) of notebook.\r\n\r\nSigned-off-by: Emmy Li <emmy@anyscale.com>\r\n\r\n* Reorder ingestion section, esp. vector store part.\r\n\r\nSigned-off-by: Emmy Li <emmy@anyscale.com>\r\n\r\n* Add in \"Tear down application\" section.\r\n\r\nSigned-off-by: Emmy Li <emmy@anyscale.com>\r\n\r\n* Clean up second half of notebook.\r\n\r\nShifting some code cells around to keep the steps more discrete.\r\n\r\nSigned-off-by: Emmy Li <emmy@anyscale.com>\r\n\r\n* First pass restructuring of the LocalApp tutorial.\r\n\r\nSome links and explanations are still missing.\r\n\r\nSigned-off-by: Emmy Li <emmy@anyscale.com>\r\n\r\n* Add micro AIR overview/demo notebook\r\n\r\n* Format 00_Setup.ipynb with black.\r\n\r\nSigned-off-by: Emmy Li <emmy@anyscale.com>\r\n\r\n* Refinements on 00_Setup.ipynb.\r\n\r\nAdd in some explanations and remove unnecessary code.\r\n\r\nSigned-off-by: Emmy Li <emmy@anyscale.com>\r\n\r\n* add shutdown to xgboost demo to prevent potential path conflict with later demos\r\nadd requirements.txt usable for anyscale software config\r\n\r\n* Format 03_Multilingual_Chat... with black.\r\n\r\nSigned-off-by: Emmy Li <emmy@anyscale.com>\r\n\r\n* Format 04_App_on_Ray_Serve.ipynb with black.\r\n\r\nSigned-off-by: Emmy Li <emmy@anyscale.com>\r\n\r\n* Format 05_Service_Canary_Rollout with black.\r\n\r\nSigned-off-by: Emmy Li <emmy@anyscale.com>\r\n\r\n* add serve.shutdown to 03; remove cluster and compute info from service yamls for improved portability between anyscale environments\r\n\r\n* reformat 04 for presentation purposes\r\n\r\n* change notebook names/numbers, wip to clarify/emphasize elements in App on Ray notebook\r\n\r\n* add emphasis, explanations, minor edits\r\n\r\n* Add QA App diagram to 03_App_on_Ray_Serve.ipynb\r\n\r\nSigned-off-by: Emmy Li <emmy@anyscale.com>\r\n\r\n* Add in diagram for deployment endpoint.\r\n\r\nSigned-off-by: Emmy Li <emmy@anyscale.com>\r\n\r\n---------\r\n\r\nSigned-off-by: Emmy Li <emmy@anyscale.com>\r\nCo-authored-by: Adam Breindel <c-adam.breindel@anyscale.com>\r\nCo-authored-by: Emmy Li <emmy@anyscale.com>","shortMessageHtmlLink":"LLMs in Production - iteration 1 (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"1753821911\" data-permission-text=\"Title is private\" data-url=\"https://github.com/ray-project/llm-application/issues/1\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/ray-project/llm-application/pull/1/hovercard\" href=\"https://github.com/ray-project/llm-application/pull/1\">#1</a>)"}},{"before":"6272ff7bd47d939984a816a64960fe7803200cb0","after":"5a9541cba292929a77e37b1311bb7945311338e8","ref":"refs/heads/wip-llmprod","pushedAt":"2023-06-12T22:29:55.396Z","pushType":"push","commitsCount":2,"pusher":{"login":"emmyscode","name":"Emmy Li","path":"/emmyscode","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/78717839?s=80&v=4"},"commit":{"message":"Add in diagram for deployment endpoint.\n\nSigned-off-by: Emmy Li <emmy@anyscale.com>","shortMessageHtmlLink":"Add in diagram for deployment endpoint."}},{"before":"b56f41a92e0ca85ee79a55e856119a9425c9f0fb","after":"6272ff7bd47d939984a816a64960fe7803200cb0","ref":"refs/heads/wip-llmprod","pushedAt":"2023-06-12T21:40:04.613Z","pushType":"push","commitsCount":1,"pusher":{"login":"adbreind","name":null,"path":"/adbreind","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1500370?s=80&v=4"},"commit":{"message":"add emphasis, explanations, minor edits","shortMessageHtmlLink":"add emphasis, explanations, minor edits"}},{"before":"0051911654e2a02ef4094eb2fbe8154e62c8eb04","after":"b56f41a92e0ca85ee79a55e856119a9425c9f0fb","ref":"refs/heads/wip-llmprod","pushedAt":"2023-06-12T20:46:22.058Z","pushType":"push","commitsCount":1,"pusher":{"login":"adbreind","name":null,"path":"/adbreind","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1500370?s=80&v=4"},"commit":{"message":"change notebook names/numbers, wip to clarify/emphasize elements in App on Ray notebook","shortMessageHtmlLink":"change notebook names/numbers, wip to clarify/emphasize elements in A…"}},{"before":"ebcdf1169ec7e1384009243677136c251d419676","after":"0051911654e2a02ef4094eb2fbe8154e62c8eb04","ref":"refs/heads/wip-llmprod","pushedAt":"2023-06-12T19:02:11.094Z","pushType":"push","commitsCount":1,"pusher":{"login":"adbreind","name":null,"path":"/adbreind","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1500370?s=80&v=4"},"commit":{"message":"reformat 04 for presentation purposes","shortMessageHtmlLink":"reformat 04 for presentation purposes"}},{"before":"495970eac38ed631facc4d5e19d5dc4f1ead8b1d","after":"ebcdf1169ec7e1384009243677136c251d419676","ref":"refs/heads/wip-llmprod","pushedAt":"2023-06-12T18:35:54.568Z","pushType":"push","commitsCount":1,"pusher":{"login":"adbreind","name":null,"path":"/adbreind","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1500370?s=80&v=4"},"commit":{"message":"add serve.shutdown to 03; remove cluster and compute info from service yamls for improved portability between anyscale environments","shortMessageHtmlLink":"add serve.shutdown to 03; remove cluster and compute info from servic…"}},{"before":"63cc6ee0dd8c4252562b692fda63f698c10dcda8","after":"495970eac38ed631facc4d5e19d5dc4f1ead8b1d","ref":"refs/heads/wip-llmprod","pushedAt":"2023-06-09T17:16:47.224Z","pushType":"push","commitsCount":2,"pusher":{"login":"emmyscode","name":"Emmy Li","path":"/emmyscode","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/78717839?s=80&v=4"},"commit":{"message":"Format 05_Service_Canary_Rollout with black.\n\nSigned-off-by: Emmy Li <emmy@anyscale.com>","shortMessageHtmlLink":"Format 05_Service_Canary_Rollout with black."}},{"before":"12a27beee50923a7fc7349c553ad08aed94c1ff1","after":"63cc6ee0dd8c4252562b692fda63f698c10dcda8","ref":"refs/heads/wip-llmprod","pushedAt":"2023-06-09T16:51:58.941Z","pushType":"push","commitsCount":1,"pusher":{"login":"emmyscode","name":"Emmy Li","path":"/emmyscode","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/78717839?s=80&v=4"},"commit":{"message":"Format 03_Multilingual_Chat... with black.\n\nSigned-off-by: Emmy Li <emmy@anyscale.com>","shortMessageHtmlLink":"Format 03_Multilingual_Chat... with black."}},{"before":"0aabfd263f034bd34d8add2eb7e2571711512f9e","after":"12a27beee50923a7fc7349c553ad08aed94c1ff1","ref":"refs/heads/wip-llmprod","pushedAt":"2023-06-09T01:53:07.283Z","pushType":"push","commitsCount":1,"pusher":{"login":"adbreind","name":null,"path":"/adbreind","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1500370?s=80&v=4"},"commit":{"message":"add shutdown to xgboost demo to prevent potential path conflict with later demos\nadd requirements.txt usable for anyscale software config","shortMessageHtmlLink":"add shutdown to xgboost demo to prevent potential path conflict with …"}},{"before":"ec0fbaf35201778f5ff3753add6f5b5bff9af278","after":"0aabfd263f034bd34d8add2eb7e2571711512f9e","ref":"refs/heads/wip-llmprod","pushedAt":"2023-06-08T23:17:06.543Z","pushType":"push","commitsCount":2,"pusher":{"login":"emmyscode","name":"Emmy Li","path":"/emmyscode","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/78717839?s=80&v=4"},"commit":{"message":"Refinements on 00_Setup.ipynb.\n\nAdd in some explanations and remove unnecessary code.\n\nSigned-off-by: Emmy Li <emmy@anyscale.com>","shortMessageHtmlLink":"Refinements on 00_Setup.ipynb."}},{"before":"655ade6b671a77a0a749af12349851cee5b48371","after":"ec0fbaf35201778f5ff3753add6f5b5bff9af278","ref":"refs/heads/wip-llmprod","pushedAt":"2023-06-08T20:10:00.820Z","pushType":"push","commitsCount":1,"pusher":{"login":"adbreind","name":null,"path":"/adbreind","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1500370?s=80&v=4"},"commit":{"message":"Add micro AIR overview/demo notebook","shortMessageHtmlLink":"Add micro AIR overview/demo notebook"}},{"before":"f7f95e0cd1eafae4359d2d3ca501a1676cd1ec36","after":"655ade6b671a77a0a749af12349851cee5b48371","ref":"refs/heads/wip-llmprod","pushedAt":"2023-06-08T18:14:13.076Z","pushType":"push","commitsCount":7,"pusher":{"login":"emmyscode","name":"Emmy Li","path":"/emmyscode","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/78717839?s=80&v=4"},"commit":{"message":"First pass restructuring of the LocalApp tutorial.\n\nSome links and explanations are still missing.\n\nSigned-off-by: Emmy Li <emmy@anyscale.com>","shortMessageHtmlLink":"First pass restructuring of the LocalApp tutorial."}},{"before":"30d14d723bb027f968b898eadc15e5af24717580","after":"f7f95e0cd1eafae4359d2d3ca501a1676cd1ec36","ref":"refs/heads/wip-llmprod","pushedAt":"2023-06-07T00:34:45.480Z","pushType":"push","commitsCount":1,"pusher":{"login":"adbreind","name":null,"path":"/adbreind","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1500370?s=80&v=4"},"commit":{"message":"Sync questions between local model and Ray version","shortMessageHtmlLink":"Sync questions between local model and Ray version"}},{"before":"0603d1792088a27e9c5f5034c1bb56282ee6f2db","after":"30d14d723bb027f968b898eadc15e5af24717580","ref":"refs/heads/wip-llmprod","pushedAt":"2023-06-06T22:14:33.791Z","pushType":"push","commitsCount":1,"pusher":{"login":"adbreind","name":null,"path":"/adbreind","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1500370?s=80&v=4"},"commit":{"message":"update anyscale service yaml to use faster nodes","shortMessageHtmlLink":"update anyscale service yaml to use faster nodes"}},{"before":"19f1c4da8136562967e7666e5a877f2eec39544c","after":"0603d1792088a27e9c5f5034c1bb56282ee6f2db","ref":"refs/heads/wip-llmprod","pushedAt":"2023-06-06T21:30:09.650Z","pushType":"push","commitsCount":1,"pusher":{"login":"adbreind","name":null,"path":"/adbreind","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1500370?s=80&v=4"},"commit":{"message":"fix typo that broke code","shortMessageHtmlLink":"fix typo that broke code"}},{"before":"4ea4f3cae362e1129479b5e2d1536313387789e8","after":"19f1c4da8136562967e7666e5a877f2eec39544c","ref":"refs/heads/wip-llmprod","pushedAt":"2023-06-06T20:54:43.970Z","pushType":"push","commitsCount":1,"pusher":{"login":"adbreind","name":null,"path":"/adbreind","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1500370?s=80&v=4"},"commit":{"message":"add narrative to App_on_Ray_Serve notebook; update Anyscale service demo to use more replicas + autoscaling, add a little more intro explanation to Multilingual Chat","shortMessageHtmlLink":"add narrative to App_on_Ray_Serve notebook; update Anyscale service d…"}},{"before":"dfc1656b6ceaf2de8efe7bbba799b722009a2248","after":"4ea4f3cae362e1129479b5e2d1536313387789e8","ref":"refs/heads/wip-llmprod","pushedAt":"2023-06-06T19:13:25.200Z","pushType":"push","commitsCount":1,"pusher":{"login":"adbreind","name":null,"path":"/adbreind","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1500370?s=80&v=4"},"commit":{"message":"update to larger cluster","shortMessageHtmlLink":"update to larger cluster"}},{"before":"63c67bccd8ad41665d0223e8b60ab1b0f150b53b","after":"dfc1656b6ceaf2de8efe7bbba799b722009a2248","ref":"refs/heads/wip-llmprod","pushedAt":"2023-06-06T17:43:39.816Z","pushType":"push","commitsCount":1,"pusher":{"login":"adbreind","name":null,"path":"/adbreind","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1500370?s=80&v=4"},"commit":{"message":"WIP notebooks and configs","shortMessageHtmlLink":"WIP notebooks and configs"}},{"before":null,"after":"63c67bccd8ad41665d0223e8b60ab1b0f150b53b","ref":"refs/heads/wip-llmprod","pushedAt":"2023-06-05T23:54:03.340Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"adbreind","name":null,"path":"/adbreind","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1500370?s=80&v=4"},"commit":{"message":"main structure for LLMs in Prod event","shortMessageHtmlLink":"main structure for LLMs in Prod event"}},{"before":null,"after":"bd2c868d23bb921faa59e35745d128bc8c3652d0","ref":"refs/heads/main","pushedAt":"2023-06-02T22:54:22.554Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"kamil-kaczmarek","name":"Kamil Kaczmarek","path":"/kamil-kaczmarek","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/25202075?s=80&v=4"},"commit":{"message":"Initial commit","shortMessageHtmlLink":"Initial commit"}}],"hasNextPage":false,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"djE6ks8AAAADQPT41gA","startCursor":null,"endCursor":null}},"title":"Activity · ray-project/llm-application"}