data-subscriber failing to download SWOT_L2_LR_SSH_Basic_2.0

[jamesfwood]

Details here:
https://wiki.jpl.nasa.gov/pages/viewpage.action?spaceKey=PD&title=Data+Subscriber+1.15.0+UAT

Failing this command:
podaac-data-downloader -c SWOT_L2_LR_SSH_Basic_2.0 -d ./data --start-date 2023-12-01T00:00:00Z --end-date 2023-12-02T00:00:00Z --subset -b="-125.57812,34.84931,-124.73438,35.83342"

Error:
"WorkItem failed: Could not get result item file size"

Request:
https://harmony.earthdata.nasa.gov/C2799465428-POCLOUD/ogc-api-coverages/1.0.0/collections/ssh_karin%2Cssha_karin%2Cssh_karin_2%2Cssha_karin_2%2Ctime%2Ctime_tai%2Clongitude%2Clatitude/coverage/rangeset?subset=lon(-125.57812%3A-124.73438)&subset=lat(34.84931%3A35.83342)&subset=time(%222023-12-31T00%3A00%3A00Z%22%3A%222024-01-05T23%3A59%3A59Z%22)&format=application%2Fnetcdf

[sliu008]

seems to be working now. Jack have been removing the bounding box on this collection. A possibility is that it is trying to subset an area where there is no data and causing a failure.

[jamesfwood]

@davidcolemanjpl Please test this again just to confirm this collection is good.
Thanks!

[davidcolemanjpl]

PO.DAAC Data Subscriber v1.15.0a3
l2ss-py:2.9.0rc1
HiTIDE (UAT): v4.17.0-RC.6

--The podaac-data-downloader tool is currently functional for the SWOT_L2_LR_SSH_Basic_2.0 collection (also captured in (#51) : OKAY
podaac-data-downloader -c SWOT_L2_LR_SSH_BASIC_2.0 -d ./data --start-date 2023-09-01T00:00:00Z --end-date 2024-11-02T00:00:00Z --subset -b="-125.57812,34.84931,-124.73438,35.83342"
[2024-03-04 17:28:47,729] {subsetting.py:102} INFO - Waiting for Harmony subsetting job to complete...
./data/SWOT_L2_LR_SSH_Basic_007_039_20231124T183915_20231124T193002_PIC0_01_subsetted.nc4
./data/SWOT_L2_LR_SSH_Basic_007_052_20231125T054803_20231125T063932_PIC0_01_subsetted.nc4
./data/SWOT_L2_LR_SSH_Basic_007_317_20231204T170132_20231204T175300_PIC0_01_subsetted.nc4
./data/SWOT_L2_LR_SSH_Basic_007_330_20231205T041020_20231205T050149_PIC0_01_subsetted.nc4
./data/SWOT_L2_LR_SSH_Basic_008_052_20231216T023306_20231216T032435_PIC0_01_subsetted.nc4
./data/SWOT_L2_LR_SSH_Basic_008_039_20231215T152418_20231215T161504_PIC0_01_subsetted.nc4

But, note: the podaac-data-subscriber tool does NOT currently execute for the SWOT_L2 sub-collection under test as expected.
Error displays - AttributeError: 'Namespace' object has no attribute 'search_cycles' (PODAAC-6119)
Also NOTE: The podaac-data-subscriber tool seems to currently work for the SWOT_L2_LR_SSH_BASIC_2.0 collection when the --subset flag is NOT used / included:
% podaac-data-subscriber -c SWOT_L2_LR_SSH_BASIC_2.0 -d ./data --start-date 2023-09-01T00:00:00Z --end-date 2024-11-02T00:00:00Z
[2024-03-04 20:33:15,228] {podaac_data_subscriber.py:183} WARNING - No .update__SWOT_L2_LR_SSH_BASIC_2.0 in the data directory. (Is this the first run?)
[2024-03-04 20:33:29,977] {podaac_data_subscriber.py:340} INFO - Found 2677 total files to download
[2024-03-04 20:33:34,437] {podaac_data_subscriber.py:377} INFO - 2024-03-04 20:33:34.437289 SUCCESS: https://archive.swot.podaac.earthdata.nasa.gov/podaac-swot-ops-cumulus-protected/SWOT_L2_LR_SSH_2.0/SWOT_L2_LR_SSH_Basic_011_479_20240302T225617_20240302T234745_PIC0_01.nc

Harmony (UAT) Request also currently fails for the SWOT_L2_LR_SSH_Basic_2.0 collection :
E.g., attempt:
https://harmony.uat.earthdata.nasa.gov/C1261072645-POCLOUD/ogc-api-coverages/1.0.0/collections/all/coverage/rangeset?forceAsync=true&subset=lat(34.84931:35.83342)&subset=lon(-125.57812:-124.73438)&subset=time("2023-01-01T18:00:00%2B00:00":"2024-12-21T07:00:00%2B00:00")&skipPreview=true

[davidcolemanjpl]

PO.DAAC Data Subscriber v1.15.1a1
l2ss-py:2.9.0rc1
HiTIDE (UAT): v4.17.0-RC.6

SWOT_L2_LR_SSH_BASIC_2.0 (C1261072645-POCLOUD)
podaac-data-subscriber - FAIL - Error- IndexError: list index out of range

NOTE: podaac-data-subscriber tool currently does not work for the SWOT_L2_LR_SSH_BASIC_2.0 collection when the --subset flag NOT used

podaac-data-downloader - OK/PASS - podaac-data-downloader tool executes as expected

Harmony - request - FAIL - L2SS-py step does not succeed in Harmony UAT (see Harmony Job Status https://harmony.uat.earthdata.nasa.gov/jobs/a69c3ac9-6329-46bb-abb5-da962c7d4626)

[davidcolemanjpl]

PO.DAAC Data Subscriber v1.15.1a1:
l2ss-py v2.9.0rc1

SWOT_L2_LR_SSH_BASIC_2.0 (C1261072645-POCLOUD)
podaac-data-subscriber - FAIL - "IndexError: list index out of range"

podaac-data-downloader - OK/PASS - podaac-data-downloader tool executes as expected

Harmony - request - FAIL - L2SS-py step did not succeed in Harmony UAT (see https://harmony.uat.earthdata.nasa.gov/jobs/a69c3ac9-6329-46bb-abb5-da962c7d4626)

[davidcolemanjpl]

Re-Test after latest podaac-data-subscriber update:
(see podaac/data-subscriber#165)

PO.DAAC Data Subscriber v1.15.1a2
l2ss-py v2.9.0rc3
Harmony UAT v0.0.999

TEST Complete

SWOT_L2_LR_SSH_BASIC_2.0 (C1261072645-POCLOUD):
podaac-data-subscriber -PASS - podaac-data-subscriber tool executes as expected:
% podaac-data-subscriber -c SWOT_L2_LR_SSH_BASIC_2.0 -d ./data --start-date 2023-05-01T00:00:00Z --end-date 2024-12-21T00:00:00Z --subset -b="120,-30,160,20"
[2024-03-14 15:05:54,254] {podaac_data_subscriber.py:183} WARNING - No .update__SWOT_L2_LR_SSH_BASIC_2.0 in the data directory. (Is this the first run?)
[2024-03-14 15:06:04,386] {subsetting.py:102} INFO - Waiting for Harmony subsetting job to complete...
./data/SWOT_L2_LR_SSH_Basic_006_545_20231121T234622_20231122T003750_PIC0_01_subsetted.nc4
./data/SWOT_L2_LR_SSH_Basic_006_547_20231122T012915_20231122T022044_PIC0_01_subsetted.nc4
./data/SWOT_L2_LR_SSH_Basic_006_560_20231122T123804_20231122T132933_PIC0_01_subsetted.nc4
./data/SWOT_L2_LR_SSH_Basic_006_575_20231123T012947_20231123T022115_PIC0_01_subsetted.nc4
./data/SWOT_L2_LR_SSH_Basic_006_573_20231122T234653_20231123T003821_PIC0_01_subsetted.nc4
./data/SWOT_L2_LR_SSH_Basic_006_562_20231122T142058_20231122T151226_PIC0_01_subsetted.nc4

podaac-data-downloader - PASS - podaac-data-downloader tool executes as expected

Harmony - request - FAIL - L2SS-py step did not succeed in Harmony UAT when the subset=lon info was included in the request:
note: when the subset=lon info was removed from the request, L2SS-py steps were successful in Harmony UAT:
Harmony request:
https://harmony.uat.earthdata.nasa.gov/C1261072645-POCLOUD/ogc-api-coverages/1.0.0/collections/all/coverage/rangeset?forceAsync=true&subset=lat(34.84931:35.83342)&subset=time("2023-01-01T18:00:00%2B00:00":"2024-12-21T07:00:00%2B00:00")&skipPreview=true
see Job status : https://harmony.uat.earthdata.nasa.gov/jobs/e4472c82-c4af-412e-bb54-fcd91b354f12

Will address this L2SS anomaly separately in ticket #51