Resolve `AirflowProviderDeprecationWarning` in providers system tests #39485

Taragolis · 2024-05-08T11:56:56Z

Body

Time to time we deprecate some attributes/arguments and even entire Operators, however maintainer might forget to change it as result system tests which use as DAG/Operators example might suggest to use deprecated stuff, this should not be a case after the #39468 PR

The purpose of this task is to fixing existing usage of deprecated stuff in Airflow Providers system tests
This one is a special case for #38642

How to check that deprecations resolved after the changes

For example you make a changes in tests/system/providers/google/cloud/gcs/example_gcs_to_gcs.py and want to check that it resolved

Remove reference to specific system test from that list

airflow/tests/always/test_example_dags.py

Lines 50 to 80 in 694d303

 "tests/system/providers/amazon/aws/example_ecs_fargate.py", 

 "tests/system/providers/amazon/aws/example_eks_with_nodegroups.py", 

 "tests/system/providers/amazon/aws/example_emr.py", 

 "tests/system/providers/amazon/aws/example_emr_notebook_execution.py", 

 "tests/system/providers/dbt/cloud/example_dbt_cloud.py", 

 "tests/system/providers/docker/example_docker_swarm.py", 

 "tests/system/providers/google/cloud/azure/example_azure_fileshare_to_gcs.py", 

 "tests/system/providers/google/cloud/bigquery/example_bigquery_operations.py", 

 "tests/system/providers/google/cloud/bigquery/example_bigquery_sensors.py", 

 "tests/system/providers/google/cloud/dataproc/example_dataproc_gke.py", 

 "tests/system/providers/google/cloud/gcs/example_gcs_sensor.py", 

 "tests/system/providers/google/cloud/gcs/example_gcs_to_gcs.py", 

 "tests/system/providers/google/cloud/kubernetes_engine/example_kubernetes_engine.py", 

 "tests/system/providers/google/cloud/kubernetes_engine/example_kubernetes_engine_async.py", 

 "tests/system/providers/google/cloud/kubernetes_engine/example_kubernetes_engine_job.py", 

 "tests/system/providers/google/cloud/kubernetes_engine/example_kubernetes_engine_kueue.py", 

 "tests/system/providers/google/cloud/kubernetes_engine/example_kubernetes_engine_resource.py", 

 "tests/system/providers/google/cloud/life_sciences/example_life_sciences.py", 

 "tests/system/providers/google/marketing_platform/example_analytics.py", 

 "tests/system/providers/weaviate/example_weaviate_cohere.py", 

 "tests/system/providers/weaviate/example_weaviate_openai.py", 

 "tests/system/providers/weaviate/example_weaviate_operator.py", 

 # Deprecated Operators/Hooks, which replaced by common.sql Operators/Hooks 

 "tests/system/providers/apache/drill/example_drill_dag.py", 

 "tests/system/providers/jdbc/example_jdbc_queries.py", 

 "tests/system/providers/microsoft/mssql/example_mssql.py", 

 "tests/system/providers/mysql/example_mysql.py", 

 "tests/system/providers/postgres/example_postgres.py", 

 "tests/system/providers/snowflake/example_snowflake.py", 

 "tests/system/providers/sqlite/example_sqlite.py", 

 "tests/system/providers/trino/example_trino.py",

Run test case tests/always/test_example_dags.py::test_should_be_importable, you might specify relative path as pytest parametrise by define it inside of [] brackets

pytest 'tests/always/test_example_dags.py::test_should_be_importable[tests/system/providers/google/cloud/gcs/example_gcs_to_gcs.py]'

Warning

System tests also uses as an example in providers documentation, so if you change system test please make sure that you also remove / change information about deprecated Operators / attributes / arguments in to the documentation.

Provider `amazon`

tests/system/providers/amazon/aws/example_ecs_fargate.py

airflow/providers/amazon/aws/operators/ecs.py:498:
   airflow.exceptions.AirflowProviderDeprecationWarning:Call to deprecated function (or staticmethod) region. (`region` is deprecated and will be removed in the future. Please use `region_name` instead.)

tests/system/providers/amazon/aws/example_eks_with_nodegroups.py

tests/system/providers/amazon/aws/example_eks_with_nodegroups.py:124:
   airflow.exceptions.AirflowProviderDeprecationWarning:You have not set parameter `on_finish_action` in class EksPodOperator. Currently the default for this parameter is `keep_pod` but in a future release the default will be changed to `delete_pod`. To ensure pods are not deleted in the future you will need to set `on_finish_action=keep_pod` explicitly.

tests/system/providers/amazon/aws/example_emr.py

tests/system/providers/amazon/aws/example_emr.py:143:
   airflow.exceptions.AirflowProviderDeprecationWarning:The parameter waiter_check_interval_seconds has been deprecated to standardize naming conventions.  Please use waiter_delay instead.  In the future this will default to None and defer to the waiter's default value.

tests/system/providers/amazon/aws/example_emr_notebook_execution.py

tests/system/providers/amazon/aws/example_emr_notebook_execution.py:54:
   airflow.exceptions.AirflowProviderDeprecationWarning:The parameter waiter_check_interval_seconds has been deprecated to standardize naming conventions.  Please use waiter_delay instead.  In the future this will default to None and defer to the waiter's default value.

tests/system/providers/amazon/aws/example_emr_notebook_execution.py:54:
   airflow.exceptions.AirflowProviderDeprecationWarning:The parameter waiter_countdown has been deprecated to standardize naming conventions.  Please use waiter_max_attempts instead.  In the future this will default to None and defer to the waiter's default value.

tests/system/providers/amazon/aws/example_emr_notebook_execution.py:75:
   airflow.exceptions.AirflowProviderDeprecationWarning:The parameter waiter_check_interval_seconds has been deprecated to standardize naming conventions.  Please use waiter_delay instead.  In the future this will default to None and defer to the waiter's default value.

tests/system/providers/amazon/aws/example_emr_notebook_execution.py:75:
   airflow.exceptions.AirflowProviderDeprecationWarning:The parameter waiter_countdown has been deprecated to standardize naming conventions.  Please use waiter_max_attempts instead.  In the future this will default to None and defer to the waiter's default value.

tests/system/providers/amazon/aws/example_emr_notebook_execution.py:87:
   airflow.exceptions.AirflowProviderDeprecationWarning:The parameter waiter_check_interval_seconds has been deprecated to standardize naming conventions.  Please use waiter_delay instead.  In the future this will default to None and defer to the waiter's default value.

tests/system/providers/amazon/aws/example_emr_notebook_execution.py:87:
   airflow.exceptions.AirflowProviderDeprecationWarning:The parameter waiter_countdown has been deprecated to standardize naming conventions.  Please use waiter_max_attempts instead.  In the future this will default to None and defer to the waiter's default value.

Provider `apache.drill`

tests/system/providers/apache/drill/example_drill_dag.py

tests/system/providers/apache/drill/example_drill_dag.py:41:
   airflow.exceptions.AirflowProviderDeprecationWarning:Call to deprecated class DrillOperator. (Please use `airflow.providers.common.sql.operators.sql.SQLExecuteQueryOperator`.)

Provider `dbt.cloud`

tests/system/providers/dbt/cloud/example_dbt_cloud.py

tests/system/providers/dbt/cloud/example_dbt_cloud.py:82:
   airflow.exceptions.AirflowProviderDeprecationWarning:Call to deprecated class DbtCloudJobRunAsyncSensor. (Class `DbtCloudJobRunAsyncSensor` is deprecated and will be removed in a future release. Please use `DbtCloudJobRunSensor` and set `deferrable` attribute to `True` instead)

Provider `docker`

tests/system/providers/docker/example_docker_swarm.py

airflow/providers/docker/operators/docker_swarm.py:118:
   airflow.exceptions.AirflowProviderDeprecationWarning:bool value for `auto_remove` is deprecated and will be removed in the future. Please use 'never', 'success', or 'force' instead

Provider `google`

Important

Please mention @VladaZakharova in PR if you would like to to make changes in Google Provider System Tests. See: #39485 (comment)

tests/system/providers/google/cloud/azure/example_azure_fileshare_to_gcs.py

tests/system/providers/google/cloud/azure/example_azure_fileshare_to_gcs.py:56:
   airflow.exceptions.AirflowProviderDeprecationWarning:Use 'directory_path' instead of 'directory_name'.

tests/system/providers/google/cloud/bigquery/example_bigquery_operations.py

tests/system/providers/google/cloud/bigquery/example_bigquery_operations.py:66:
   airflow.exceptions.AirflowProviderDeprecationWarning:Passing table parameters via keywords arguments will be deprecated. Please provide table definition using `table_resource` parameter.

tests/system/providers/google/cloud/bigquery/example_bigquery_sensors.py

tests/system/providers/google/cloud/bigquery/example_bigquery_sensors.py:101:
   airflow.exceptions.AirflowProviderDeprecationWarning:Call to deprecated class BigQueryTableExistenceAsyncSensor. (Class `BigQueryTableExistenceAsyncSensor` is deprecated and will be removed in a future release. Please use `BigQueryTableExistenceSensor` and set `deferrable` attribute to `True` instead)

tests/system/providers/google/cloud/bigquery/example_bigquery_sensors.py:141:
   airflow.exceptions.AirflowProviderDeprecationWarning:Call to deprecated class BigQueryTableExistencePartitionAsyncSensor. (Class `BigQueryTableExistencePartitionAsyncSensor` is deprecated and will be removed in a future release. Please use `BigQueryTablePartitionExistenceSensor` and set `deferrable` attribute to `True` instead)

tests/system/providers/google/cloud/dataproc/example_dataproc_gke.py

airflow/providers/google/cloud/operators/kubernetes_engine.py:342:
   airflow.exceptions.AirflowProviderDeprecationWarning:The body field 'initial_node_count' is deprecated. Use 'node_pool.initial_node_count' instead.

tests/system/providers/google/cloud/gcs/example_gcs_sensor.py

tests/system/providers/google/cloud/gcs/example_gcs_sensor.py:144:
   airflow.exceptions.AirflowProviderDeprecationWarning:Call to deprecated class GCSObjectExistenceAsyncSensor. (Class `GCSObjectExistenceAsyncSensor` is deprecated and will be removed in a future release. Please use `GCSObjectExistenceSensor` and set `deferrable` attribute to `True` instead)

tests/system/providers/google/cloud/gcs/example_gcs_to_gcs.py

tests/system/providers/google/cloud/gcs/example_gcs_to_gcs.py:169:
   airflow.exceptions.AirflowProviderDeprecationWarning:Usage of wildcard (*) in 'source_object' is deprecated, utilize 'match_glob' instead

tests/system/providers/google/cloud/gcs/example_gcs_to_gcs.py:189:
   airflow.exceptions.AirflowProviderDeprecationWarning:Usage of 'delimiter' is deprecated, please use 'match_glob' instead

tests/system/providers/google/cloud/kubernetes_engine/example_kubernetes_engine.py

airflow/providers/google/cloud/operators/kubernetes_engine.py:342:
   airflow.exceptions.AirflowProviderDeprecationWarning:The body field 'initial_node_count' is deprecated. Use 'node_pool.initial_node_count' instead.

tests/system/providers/google/cloud/kubernetes_engine/example_kubernetes_engine_async.py

airflow/providers/google/cloud/operators/kubernetes_engine.py:342:
   airflow.exceptions.AirflowProviderDeprecationWarning:The body field 'initial_node_count' is deprecated. Use 'node_pool.initial_node_count' instead.

tests/system/providers/google/cloud/kubernetes_engine/example_kubernetes_engine_job.py

airflow/providers/google/cloud/operators/kubernetes_engine.py:342:
   airflow.exceptions.AirflowProviderDeprecationWarning:The body field 'initial_node_count' is deprecated. Use 'node_pool.initial_node_count' instead.

tests/system/providers/google/cloud/kubernetes_engine/example_kubernetes_engine_kueue.py

airflow/providers/google/cloud/operators/kubernetes_engine.py:342:
   airflow.exceptions.AirflowProviderDeprecationWarning:The body field 'initial_node_count' is deprecated. Use 'node_pool.initial_node_count' instead.

tests/system/providers/google/cloud/kubernetes_engine/example_kubernetes_engine_resource.py

airflow/providers/google/cloud/operators/kubernetes_engine.py:342:
   airflow.exceptions.AirflowProviderDeprecationWarning:The body field 'initial_node_count' is deprecated. Use 'node_pool.initial_node_count' instead.

tests/system/providers/google/cloud/life_sciences/example_life_sciences.py

tests/system/providers/google/cloud/life_sciences/example_life_sciences.py:105:
   airflow.exceptions.AirflowProviderDeprecationWarning:Call to deprecated class LifeSciencesRunPipelineOperator. (Consider using Google Cloud Batch Operators instead.The Life Sciences API (beta) will be discontinued on July 8, 2025 in favor of Google Cloud Batch.)

tests/system/providers/google/cloud/life_sciences/example_life_sciences.py:113:
   airflow.exceptions.AirflowProviderDeprecationWarning:Call to deprecated class LifeSciencesRunPipelineOperator. (Consider using Google Cloud Batch Operators instead.The Life Sciences API (beta) will be discontinued on July 8, 2025 in favor of Google Cloud Batch.)

tests/system/providers/google/marketing_platform/example_analytics.py

tests/system/providers/google/marketing_platform/example_analytics.py:55:
   airflow.exceptions.AirflowProviderDeprecationWarning:Call to deprecated class GoogleAnalyticsListAccountsOperator. (The `GoogleAnalyticsListAccountsOperator` class is deprecated, please use `GoogleAnalyticsAdminListAccountsOperator` instead.)

tests/system/providers/google/marketing_platform/example_analytics.py:59:
   airflow.exceptions.AirflowProviderDeprecationWarning:Call to deprecated class GoogleAnalyticsGetAdsLinkOperator. (The `GoogleAnalyticsGetAdsLinkOperator` class is deprecated, please use `GoogleAnalyticsAdminGetGoogleAdsLinkOperator` instead.)

tests/system/providers/google/marketing_platform/example_analytics.py:68:
   airflow.exceptions.AirflowProviderDeprecationWarning:Call to deprecated class GoogleAnalyticsRetrieveAdsLinksListOperator. (The `GoogleAnalyticsRetrieveAdsLinksListOperator` class is deprecated, please use `GoogleAnalyticsAdminListGoogleAdsLinksOperator` instead.)

tests/system/providers/google/marketing_platform/example_analytics.py:73:
   airflow.exceptions.AirflowProviderDeprecationWarning:Call to deprecated class GoogleAnalyticsDataImportUploadOperator. (The `GoogleAnalyticsDataImportUploadOperator` class is deprecated, please use `GoogleAnalyticsAdminCreateDataStreamOperator` instead.)

tests/system/providers/google/marketing_platform/example_analytics.py:82:
   airflow.exceptions.AirflowProviderDeprecationWarning:Call to deprecated class GoogleAnalyticsDeletePreviousDataUploadsOperator. (The `GoogleAnalyticsDeletePreviousDataUploadsOperator` class is deprecated, please use `GoogleAnalyticsAdminDeleteDataStreamOperator` instead.)

Provider `jdbc`

tests/system/providers/jdbc/example_jdbc_queries.py

tests/system/providers/jdbc/example_jdbc_queries.py:43:
   airflow.exceptions.AirflowProviderDeprecationWarning:Call to deprecated class JdbcOperator. (Please use `airflow.providers.common.sql.operators.sql.SQLExecuteQueryOperator`.)

tests/system/providers/jdbc/example_jdbc_queries.py:52:
   airflow.exceptions.AirflowProviderDeprecationWarning:Call to deprecated class JdbcOperator. (Please use `airflow.providers.common.sql.operators.sql.SQLExecuteQueryOperator`.)

Provider `microsoft.mssql`

tests/system/providers/microsoft/mssql/example_mssql.py

tests/system/providers/microsoft/mssql/example_mssql.py:115:
   airflow.exceptions.AirflowProviderDeprecationWarning:Call to deprecated class MsSqlOperator. (Please use `airflow.providers.common.sql.operators.sql.SQLExecuteQueryOperator`.Also, you can provide `hook_params={'schema': <database>}`.)

tests/system/providers/microsoft/mssql/example_mssql.py:123:
   airflow.exceptions.AirflowProviderDeprecationWarning:Call to deprecated class MsSqlOperator. (Please use `airflow.providers.common.sql.operators.sql.SQLExecuteQueryOperator`.Also, you can provide `hook_params={'schema': <database>}`.)

tests/system/providers/microsoft/mssql/example_mssql.py:131:
   airflow.exceptions.AirflowProviderDeprecationWarning:Call to deprecated class MsSqlOperator. (Please use `airflow.providers.common.sql.operators.sql.SQLExecuteQueryOperator`.Also, you can provide `hook_params={'schema': <database>}`.)

tests/system/providers/microsoft/mssql/example_mssql.py:53:
   airflow.exceptions.AirflowProviderDeprecationWarning:Call to deprecated class MsSqlOperator. (Please use `airflow.providers.common.sql.operators.sql.SQLExecuteQueryOperator`.Also, you can provide `hook_params={'schema': <database>}`.)

tests/system/providers/microsoft/mssql/example_mssql.py:89:
   airflow.exceptions.AirflowProviderDeprecationWarning:Call to deprecated class MsSqlOperator. (Please use `airflow.providers.common.sql.operators.sql.SQLExecuteQueryOperator`.Also, you can provide `hook_params={'schema': <database>}`.)

tests/system/providers/microsoft/mssql/example_mssql.py:98:
   airflow.exceptions.AirflowProviderDeprecationWarning:Call to deprecated class MsSqlOperator. (Please use `airflow.providers.common.sql.operators.sql.SQLExecuteQueryOperator`.Also, you can provide `hook_params={'schema': <database>}`.)

Provider `mysql`

tests/system/providers/mysql/example_mysql.py

tests/system/providers/mysql/example_mysql.py:42:
   airflow.exceptions.AirflowProviderDeprecationWarning:Call to deprecated class MySqlOperator. (Please use `airflow.providers.common.sql.operators.sql.SQLExecuteQueryOperator`.Also, you can provide `hook_params={'schema': <database>}`.)

tests/system/providers/mysql/example_mysql.py:50:
   airflow.exceptions.AirflowProviderDeprecationWarning:Call to deprecated class MySqlOperator. (Please use `airflow.providers.common.sql.operators.sql.SQLExecuteQueryOperator`.Also, you can provide `hook_params={'schema': <database>}`.)

Provider `postgres`

tests/system/providers/postgres/example_postgres.py

tests/system/providers/postgres/example_postgres.py:41:
   airflow.exceptions.AirflowProviderDeprecationWarning:Call to deprecated class PostgresOperator. (Please use `airflow.providers.common.sql.operators.sql.SQLExecuteQueryOperator`.Also, you can provide `hook_params={'schema': <database>}`.)

tests/system/providers/postgres/example_postgres.py:54:
   airflow.exceptions.AirflowProviderDeprecationWarning:Call to deprecated class PostgresOperator. (Please use `airflow.providers.common.sql.operators.sql.SQLExecuteQueryOperator`.Also, you can provide `hook_params={'schema': <database>}`.)

tests/system/providers/postgres/example_postgres.py:69:
   airflow.exceptions.AirflowProviderDeprecationWarning:Call to deprecated class PostgresOperator. (Please use `airflow.providers.common.sql.operators.sql.SQLExecuteQueryOperator`.Also, you can provide `hook_params={'schema': <database>}`.)

tests/system/providers/postgres/example_postgres.py:72:
   airflow.exceptions.AirflowProviderDeprecationWarning:Call to deprecated class PostgresOperator. (Please use `airflow.providers.common.sql.operators.sql.SQLExecuteQueryOperator`.Also, you can provide `hook_params={'schema': <database>}`.)

Provider `snowflake`

tests/system/providers/snowflake/example_snowflake.py

tests/system/providers/snowflake/example_snowflake.py:53:
   airflow.exceptions.AirflowProviderDeprecationWarning:Call to deprecated class SnowflakeOperator. (This class is deprecated. Please use `airflow.providers.common.sql.operators.sql.SQLExecuteQueryOperator`. Also, you can provide `hook_params={'warehouse': <warehouse>, 'database': <database>, 'role': <role>, 'schema': <schema>, 'authenticator': <authenticator>,'session_parameters': <session_parameters>}`.)

tests/system/providers/snowflake/example_snowflake.py:55:
   airflow.exceptions.AirflowProviderDeprecationWarning:Call to deprecated class SnowflakeOperator. (This class is deprecated. Please use `airflow.providers.common.sql.operators.sql.SQLExecuteQueryOperator`. Also, you can provide `hook_params={'warehouse': <warehouse>, 'database': <database>, 'role': <role>, 'schema': <schema>, 'authenticator': <authenticator>,'session_parameters': <session_parameters>}`.)

tests/system/providers/snowflake/example_snowflake.py:61:
   airflow.exceptions.AirflowProviderDeprecationWarning:Call to deprecated class SnowflakeOperator. (This class is deprecated. Please use `airflow.providers.common.sql.operators.sql.SQLExecuteQueryOperator`. Also, you can provide `hook_params={'warehouse': <warehouse>, 'database': <database>, 'role': <role>, 'schema': <schema>, 'authenticator': <authenticator>,'session_parameters': <session_parameters>}`.)

tests/system/providers/snowflake/example_snowflake.py:63:
   airflow.exceptions.AirflowProviderDeprecationWarning:Call to deprecated class SnowflakeOperator. (This class is deprecated. Please use `airflow.providers.common.sql.operators.sql.SQLExecuteQueryOperator`. Also, you can provide `hook_params={'warehouse': <warehouse>, 'database': <database>, 'role': <role>, 'schema': <schema>, 'authenticator': <authenticator>,'session_parameters': <session_parameters>}`.)

tests/system/providers/snowflake/example_snowflake.py:69:
   airflow.exceptions.AirflowProviderDeprecationWarning:Call to deprecated class SnowflakeOperator. (This class is deprecated. Please use `airflow.providers.common.sql.operators.sql.SQLExecuteQueryOperator`. Also, you can provide `hook_params={'warehouse': <warehouse>, 'database': <database>, 'role': <role>, 'schema': <schema>, 'authenticator': <authenticator>,'session_parameters': <session_parameters>}`.)

Provider `sqlite`

tests/system/providers/sqlite/example_sqlite.py

tests/system/providers/sqlite/example_sqlite.py:48:
   airflow.exceptions.AirflowProviderDeprecationWarning:Call to deprecated class SqliteOperator. (Please use `airflow.providers.common.sql.operators.sql.SQLExecuteQueryOperator`.)

tests/system/providers/sqlite/example_sqlite.py:80:
   airflow.exceptions.AirflowProviderDeprecationWarning:Call to deprecated class SqliteOperator. (Please use `airflow.providers.common.sql.operators.sql.SQLExecuteQueryOperator`.)

Provider `trino`

tests/system/providers/trino/example_trino.py

tests/system/providers/trino/example_trino.py:43:
   airflow.exceptions.AirflowProviderDeprecationWarning:Call to deprecated class TrinoOperator. (Please use `airflow.providers.common.sql.operators.sql.SQLExecuteQueryOperator`.)

tests/system/providers/trino/example_trino.py:48:
   airflow.exceptions.AirflowProviderDeprecationWarning:Call to deprecated class TrinoOperator. (Please use `airflow.providers.common.sql.operators.sql.SQLExecuteQueryOperator`.)

tests/system/providers/trino/example_trino.py:57:
   airflow.exceptions.AirflowProviderDeprecationWarning:Call to deprecated class TrinoOperator. (Please use `airflow.providers.common.sql.operators.sql.SQLExecuteQueryOperator`.)

tests/system/providers/trino/example_trino.py:63:
   airflow.exceptions.AirflowProviderDeprecationWarning:Call to deprecated class TrinoOperator. (Please use `airflow.providers.common.sql.operators.sql.SQLExecuteQueryOperator`.)

tests/system/providers/trino/example_trino.py:72:
   airflow.exceptions.AirflowProviderDeprecationWarning:Call to deprecated class TrinoOperator. (Please use `airflow.providers.common.sql.operators.sql.SQLExecuteQueryOperator`.)

tests/system/providers/trino/example_trino.py:78:
   airflow.exceptions.AirflowProviderDeprecationWarning:Call to deprecated class TrinoOperator. (Please use `airflow.providers.common.sql.operators.sql.SQLExecuteQueryOperator`.)

Provider `weaviate`

tests/system/providers/weaviate/example_weaviate_cohere.py

tests/system/providers/weaviate/example_weaviate_cohere.py:81:
   airflow.exceptions.AirflowProviderDeprecationWarning:Passing 'input_json' to WeaviateIngestOperator is deprecated and you should use 'input_data' instead

tests/system/providers/weaviate/example_weaviate_openai.py

tests/system/providers/weaviate/example_weaviate_openai.py:79:
   airflow.exceptions.AirflowProviderDeprecationWarning:Passing 'input_json' to WeaviateIngestOperator is deprecated and you should use 'input_data' instead

tests/system/providers/weaviate/example_weaviate_operator.py

tests/system/providers/weaviate/example_weaviate_operator.py:120:
   airflow.exceptions.AirflowProviderDeprecationWarning:Passing 'input_json' to WeaviateIngestOperator is deprecated and you should use 'input_data' instead

tests/system/providers/weaviate/example_weaviate_operator.py:130:
   airflow.exceptions.AirflowProviderDeprecationWarning:Passing 'input_json' to WeaviateIngestOperator is deprecated and you should use 'input_data' instead

tests/system/providers/weaviate/example_weaviate_operator.py:230:
   airflow.exceptions.AirflowProviderDeprecationWarning:Passing 'input_json' to WeaviateIngestOperator is deprecated and you should use 'input_data' instead

tests/system/providers/weaviate/example_weaviate_operator.py:240:
   airflow.exceptions.AirflowProviderDeprecationWarning:Passing 'input_json' to WeaviateIngestOperator is deprecated and you should use 'input_data' instead

Committer

I acknowledge that I am a maintainer/committer of the Apache Airflow project.

The text was updated successfully, but these errors were encountered:

Related: apache#39485 The DbtCloudJobRunAsyncSensor is deprecated in favor of using DbtCloudJobRunSensor with `deferrable=True` set. Removing this sensor from the dbt Cloud system test and updating documentation accordingly.

josh-fell · 2024-05-09T14:52:17Z

Happy to help out where I can here. Thanks for putting this together @Taragolis!

* Resolve DbtCloudJobRunAsyncSensor deprecation in system tests Related: #39485 The DbtCloudJobRunAsyncSensor is deprecated in favor of using DbtCloudJobRunSensor with `deferrable=True` set. Removing this sensor from the dbt Cloud system test and updating documentation accordingly. * Remove dbt Cloud system test from deprecation ignores

…#39525) * Resolve DbtCloudJobRunAsyncSensor deprecation in system tests Related: apache#39485 The DbtCloudJobRunAsyncSensor is deprecated in favor of using DbtCloudJobRunSensor with `deferrable=True` set. Removing this sensor from the dbt Cloud system test and updating documentation accordingly. * Remove dbt Cloud system test from deprecation ignores

Related: apache#39485 AzureFileShareToGCSOperator has a deprecated parameter, `directory_name`, which was replaced by `directory_path`. This PR updates system and unit tests as well as operator docs to reflect this deprecated change.

Related: #39485 AzureFileShareToGCSOperator has a deprecated parameter, `directory_name`, which was replaced by `directory_path`. This PR updates system and unit tests as well as operator docs to reflect this deprecated change.

dondaum · 2024-05-17T13:34:42Z

I can take on the task or at least support it.

Bowrna · 2024-05-20T06:51:42Z

Raised PR for provider postgres

Bowrna · 2024-05-20T07:03:56Z

Raised PR for provider weaviate

Bowrna · 2024-05-20T08:53:40Z

Raised PR for provider AWS EKS

dirrao · 2024-05-20T16:15:23Z

I am going to raise PR for Trino.

Bowrna · 2024-05-21T06:03:20Z

I am going to raise PR for Trino.

oops @dirrao I am sorry I raised a PR without noticing it :(

Bowrna · 2024-05-21T06:06:17Z

Raising PR for Snowflake, Drill and SQLite too!

Edit: Raising for JDBC, MSSQL too

Bowrna · 2024-05-21T08:33:09Z

The open ones in this task are

tests/system/providers/google/cloud/life_sciences/example_life_sciences.py

tests/system/providers/google/marketing_platform/example_analytics.py

tests/system/providers/google/cloud/bigquery/example_bigquery_operations.py
tests/system/providers/amazon/aws/example_ecs_fargate.py

tests/system/providers/amazon/aws/example_emr_notebook_execution.py

tests/system/providers/amazon/aws/example_emr.py

dirrao · 2024-05-21T13:17:44Z

I am going to raise PR for Trino.

oops @dirrao I am sorry I raised a PR without noticing it :(

No issues. I will drop mine.

VladaZakharova · 2024-05-22T10:02:28Z

Hi @Taragolis ! Thank you for opening this issue to improve system tests for Google provider :)
From our team's side we can offer checking all the PR and also running them in Google env to check if they work good with new changes.
I would like to ask you only update the description of this issue and ask people who will create PRs to mention me in there, so we will be able to see all new changes. Thank you!

Taragolis added area:providers good first issue area:system-tests kind:meta High-level information important to the community labels May 8, 2024

Taragolis mentioned this issue May 8, 2024

Remove deprecations usage in docker provider system tests #39487

Merged

josh-fell mentioned this issue May 9, 2024

Resolve DbtCloudJobRunAsyncSensor deprecation in system tests #39525

Merged

josh-fell mentioned this issue May 14, 2024

Resolve deprecation warnings in Azure FileShare-to-GCS tests #39599

Merged

Taragolis removed the provider:dbt-cloud label May 15, 2024

Bowrna mentioned this issue May 20, 2024

removing deprecation postgres #39706

Merged

Bowrna mentioned this issue May 20, 2024

weaviate remove deprecations #39707

Merged

Bowrna mentioned this issue May 20, 2024

remove deprecations aws eks #39709

Merged

Taragolis removed the provider:weaviate label May 20, 2024

Bowrna mentioned this issue May 20, 2024

remove deprecations google cloud #39713

Open

dirrao mentioned this issue May 21, 2024

Resolving mysql deprecated operator warnings #39725

Merged

This was referenced May 21, 2024

gcs to gcs deprecation removal #39726

Open

removing deprecations gke #39727

Open

Bowrna mentioned this issue May 21, 2024

remove deprecation trino #39728

Open

This was referenced May 21, 2024

remove deprecations snowflake #39729

Open

remove deprecation sqlite #39730

Merged

remove deprecation drill #39732

Merged

remove deprecation jdbc #39733

Merged

remove deprecations mssql #39734

Open

dirrao mentioned this issue May 21, 2024

Resolving EMR deprecated warnings #39743

Merged

This was referenced May 25, 2024

Resolving EMR notebook deprecated warnings #39829

Open

Resolving ECS fargate deprecated warnings #39834

Merged

Resolving google bigquery deprecated warnings #39841

Merged

eladkal mentioned this issue May 26, 2024

Status of testing Providers that were prepared on May 26, 2024 #39842

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Resolve `AirflowProviderDeprecationWarning` in providers system tests #39485

Resolve `AirflowProviderDeprecationWarning` in providers system tests #39485

Taragolis commented May 8, 2024 •

edited

josh-fell commented May 9, 2024

dondaum commented May 17, 2024

Bowrna commented May 20, 2024

Bowrna commented May 20, 2024

Bowrna commented May 20, 2024

dirrao commented May 20, 2024

Bowrna commented May 21, 2024

Bowrna commented May 21, 2024 •

edited

Bowrna commented May 21, 2024

dirrao commented May 21, 2024

VladaZakharova commented May 22, 2024

Resolve AirflowProviderDeprecationWarning in providers system tests #39485

Resolve AirflowProviderDeprecationWarning in providers system tests #39485

Comments

Taragolis commented May 8, 2024 • edited

Body

How to check that deprecations resolved after the changes

Provider amazon

Provider apache.drill

Provider dbt.cloud

Provider docker

Provider google

Provider jdbc

Provider microsoft.mssql

Provider mysql

Provider postgres

Provider snowflake

Provider sqlite

Provider trino

Provider weaviate

Committer

josh-fell commented May 9, 2024

dondaum commented May 17, 2024

Bowrna commented May 20, 2024

Bowrna commented May 20, 2024

Bowrna commented May 20, 2024

dirrao commented May 20, 2024

Bowrna commented May 21, 2024

Bowrna commented May 21, 2024 • edited

Bowrna commented May 21, 2024

dirrao commented May 21, 2024

VladaZakharova commented May 22, 2024

Resolve `AirflowProviderDeprecationWarning` in providers system tests #39485

Resolve `AirflowProviderDeprecationWarning` in providers system tests #39485

Taragolis commented May 8, 2024 •

edited

Provider `amazon`

Provider `apache.drill`

Provider `dbt.cloud`

Provider `docker`

Provider `google`

Provider `jdbc`

Provider `microsoft.mssql`

Provider `mysql`

Provider `postgres`

Provider `snowflake`

Provider `sqlite`

Provider `trino`

Provider `weaviate`

Bowrna commented May 21, 2024 •

edited