Update Gen AI for Integration Tests

[drbeh]

No description provided.

[mingxin-zheng]

Hi @drbeh ! Please add this into the test script (test_monai_notebook.py) instead of having it in the notebook. Thanks!

[mingxin-zheng]

To achieve this, you may need nbformat to manipulate the cells. For example, this is what I do locally for development mode testing

def remove_download(cells, inplace=True): 
    # New cell content
    cell_copy = cells.copy() if not inplace else cells
    # Identify and replace the target cell
    def condition(cell):
        if cell.cell_type != "code":
            return False
        return cell.source.startswith("# Download the job artifacts, including logs, scripts, and model checkpoints")
    for cell in cell_copy:
        if condition(cell):
            cell.source = ""
            break  # Assuming there's only one cell with this marker, break after finding it
 
nb = nbformat.read(notebook_path, as_version=4)
cells = nb.cells
cells = remove_download(cells)

[drbeh]

Hi @mingxin-zheng, I see your point but the way that integration tests are suppose to parametrize these notebooks are through the parameters cell (the cell tagged with "parameters") and the test cases are defined in NOTEBOOK_TEST_CASES as a list of dictionaries. Modifying arbitrary cells will break the logic and make it particular to this test.
It makes sense for what you have done which is not notebook dependents but adding specific content to a specific cell of a specific notebooks looks very hacky to me and it is hard to maintain in a long run. What to you think? @mingxin-zheng @Nic-Ma @yiheng-wang-nv

[drbeh]

@mingxin-zheng following your suggestion. I added a general rule to overwrite any tagged cell with the requested data. I will test to see if it works.

[drbeh]

I tested it and it worked for generative ai notebook.

[drbeh]

@mingxin-zheng @Nic-Ma I have updated this notebook and removed all the integration test related stuff. Instead, I added job_run_data tag and modified the integration test code to overwrite this cell for CI. This can be use for any other notebook that needs to overwrite values in a cell other than the top parameters cell.

[mingxin-zheng]

Testing it right now. Hopefully we can merge this PR soon