Hello, I am not sure if I am missing something or not, but when I use the goes_timerange() function and request to return the data as an xarray, I get an error and the result does not return as an xarray. I am using jupyter notebook. Attached is a word document with screenshots of the code and the error. The code is just the sample code you provided in the documentation. Thank you! error.docx

Hello,

I am downloading data for many days, which works fine most of the time, but there is a specific day that causes an issue. Here is my code (in a loop over multiple scene.target_time):

        print(scene.satellite_name[-4:])
        print(scene.target_time)
        data = goes_nearesttime(scene.target_time, satellite=scene.satellite_name[-4:], product='ABI-L2-ACMF', save_dir=data_dir+'GOES/', verbose=False)

and it produces:

WEST
2021-07-19 21:00:00
WEST
2021-07-20 21:00:00
WEST
2021-07-21 21:00:00
WEST
2021-07-22 21:00:00
Traceback (most recent call last):
...
  File "/uufs/chpc.utah.edu/common/home/u1020524/cloud-distributions-chpc/data_reader.py", line 1012, in _GOES_read
    data = goes_nearesttime(scene.target_time, satellite=scene.satellite_name[-4:], product='ABI-L2-ACMF', save_dir=data_dir+'GOES/', verbose=False)
  File "/uufs/chpc.utah.edu/common/home/u1020524/software/pkg/miniconda3/lib/python3.9/site-packages/goes2go/data.py", line 640, in goes_nearesttime
    df = _goes_file_df(satellite, product, start, end, refresh=s3_refresh)
  File "/uufs/chpc.utah.edu/common/home/u1020524/software/pkg/miniconda3/lib/python3.9/site-packages/goes2go/data.py", line 151, in _goes_file_df
    df["file"].str.rsplit("_", expand=True, n=3).loc[:, 1:]
  File "/uufs/chpc.utah.edu/common/home/u1020524/software/pkg/miniconda3/lib/python3.9/site-packages/pandas/core/indexing.py", line 925, in __getitem__
    return self._getitem_tuple(key)
...
TypeError: cannot do slice indexing on Index with these indexers [1] of type int

(I have omitted some of the traceback) As you can see, it works fine for most days but there seems to be a problem at the specific time of 2021-07-22 21:00:00. I am not sure what is wrong on that day.

Thanks

The field_of_view still gets the Full Disk FOV when the input is the CONUS data.

import xarray as xr
from glob import glob
from goes2go.tools import field_of_view

ds_abi = xr.open_dataset(glob('../data/GOES-16/ABI_L1/OR_ABI-L1b-RadC-M6C13_G16_s2020153000*')[0])
FOV_abi, geo_abi = field_of_view(ds_abi)

display(FOV_abi)

Hello!

I installed Goes2Go using pip and I'm trying to follow the example code for downloading and reading the data. When I try to import the module GOES (from goes2go import GOES) it returns a syntax error:

/home/ec2-user/.local/lib/python3.7/site-packages/goes2go/init.py:15: UserWarning: goes2go xarray accessors could not be imported. warnings.warn("goes2go xarray accessors could not be imported.")

Traceback (most recent call last):

File "/home/ec2-user/.local/lib/python3.7/site-packages/IPython/core/interactiveshell.py", line 3553, in run_code
  exec(code_obj, self.user_global_ns, self.user_ns)

File "/tmp/ipykernel_19813/3951463100.py", line 1, in <module>
  from goes2go import GOES

File "/home/ec2-user/.local/lib/python3.7/site-packages/goes2go/__init__.py", line 96, in <module>
  from goes2go.NEW import GOES

File "<fstring>", line 1
  (self.satellite=)
                 ^

SyntaxError: invalid syntax

I tried importing other modules but returns the same error

When selecting the ABI-L1b-Rad product, passing a single band to goes2go.data.goes_nearesttime yields a non-error result, but a list of multiple bands results in pandas.errors.InvalidIndexError: Reindexing only valid with uniquely valued Index objects. The issue is raised on line 612.

Example to illustrate the issue:

import datetime
from goes2go.data import goes_nearesttime

if __name__ == '__main__':

    t = datetime.datetime(2021, 1, 1, 17, 0, 0)

    # this succeeds
    bands = [1]
    res = goes_nearesttime(
        t,
        satellite=17,
        product='ABI-L1b-Rad',
        return_as='filelist',
        bands=bands,
        download=False,
        domain='C')
    print(res)

    # this fails 
    bands = [1, 2]
    res = goes_nearesttime(
        t,
        satellite=17,
        product='ABI-L1b-Rad',
        return_as='filelist',
        bands=bands,
        download=False,
        domain='C')
    print(res)

Environment details:

This failed on the latest release 2022.7.15 and the current HEAD commit 8a431a2. I am running this on an M1 Pro (Apple Silicon) machine, Python 3.9.13. I also experienced this while running in a Docker container with Ubuntu 20.04.4 & Python 3.8.10.

From an email

I have been trying to use your Goes2go python library, and I just happen to be missing something from the guidance of your GitHub examples. I believe my main issue is coming from an error saying I do not have a product_table.txt file. Do you have any insight on the product_table.txt file needed to run goes2go? I was also wondering if you would recommend using an older version of python rather than the most up to date one. I am using python 3.10.6. would this have any effect? What instillation method would you recommend? Just to use pip install?

I use the environment.yml installation when an error is reported, please ask what is the reason

ERROR: yaml.scanner.ScannerError: mapping values are not allowed here in xxxxxxx line 28,col 66

Hey!

First off, I just found this project and the archive it links to but this looks like an amazing resource!

Now to the issue: there seems to be a bug in setup.py. Running the script doesn't actually include the package and this seems to be the case with the release on PyPI as well. If you open the released wheel you'll notice the actual package is missing. The problem seems to be the use of find_package, which to my knowledge still relies on the __init__.py files to identify packages. So you either have to add an __init__.py or specify the package manually within the setup.py.

Hi,

Thank you very much, thanks to this repository it helped me to fix a deficiency of Google Earth Engine (GEE): the data is available with 1 or 2 days of delay. I would like the goes2go functionalities to be in the geemap package so that everyone can have recent (via AWS) and past (via GEE) data from GOES or another AWS dataset (Sentinel, Landsat, etc.).

In the readme under the Installation section there is a link that points to an environment.yml file to set up the conda environment but it points to a file in the Herbie repo.

Here's the link it points to: https://github.com/blaylockbk/Herbie/blob/main/environment.yml

Publish goes2go on conda-forge. This will help some of the installation problems people run into.

• [x] create conda recipe
• [x] publish on conda-forge
• [ ] test install from conda-forge

Can my legacy download pages at the University of Utah be recreated using only GitHub pages?

• https://home.chpc.utah.edu/~u0553130/Brian_Blaylock/cgi-bin/generic_AWS_download.cgi
• https://home.chpc.utah.edu/~u0553130/Brian_Blaylock/cgi-bin/goes16_download.cgi

Would need some help with the JavaScript and web design. https://aws.amazon.com/developer/tools/

Should just need to set satellite=18 to explicitly get GOES-18. But when user requests satellite="west" it should automatically detect which is the operational satellite (17 or 18).

hour = '2022-01-01 00:00:00'
g = goes_nearesttime(hour,
                   satellite='goes16',
                   product='ABI',
                   domain = 'C',
                   return_as='xarray',
                   download = False)

timestamp = str(g.time_coverage_end.values)
R = g['CMI_C02'].data

results in this error: raise ValueError("I/O operation on closed file.") ValueError: I/O operation on closed file.

R = g['CMI_C02'].data

When download = True and return as filelist, I have no issues opening xarray.open_dataset, but these files are huge so i was hoping to load in memory, process, and then move onto the next one. Am i doing something wrong when trying to access the data once this is loaded into memory?

FutureWarning: In a future version of pandas all arguments of StringMethods.rsplit except for the argument 'pat' will be keyword-only.
  product_mode = df.product_mode.str.rsplit("-", 1, expand=True)

When installing goes2go per the documentation using the provided environment.yml to create a clean conda environment, the ABI example below does not work:

from goes2go.data import goes_latest
import matplotlib.pyplot as plt
import cartopy.crs as ccrs

# Download a GOES ABI dataset
G = goes_latest(product='ABI')

# Make figure on Cartopy axes
ax = plt.subplot(projection=G.rgb.crs )
ax.imshow(G.rgb.TrueColor(), **G.rgb.imshow_kwargs)
ax.coastlines()

This fails with

Traceback (most recent call last):
  File "~/miniconda3/envs/goes2go/lib/python3.9/site-packages/matplotlib/backends/backend_qt.py", line 456, in _draw_idle
    self.draw()
  File "~/miniconda3/envs/goes2go/lib/python3.9/site-packages/matplotlib/backends/backend_agg.py", line 408, in draw
    self.figure.draw(self.renderer)
  File "~/miniconda3/envs/goes2go/lib/python3.9/site-packages/matplotlib/artist.py", line 74, in draw_wrapper
    result = draw(artist, renderer, *args, **kwargs)
  File "~/miniconda3/envs/goes2go/lib/python3.9/site-packages/matplotlib/artist.py", line 51, in draw_wrapper
    return draw(artist, renderer)
  File "~/miniconda3/envs/goes2go/lib/python3.9/site-packages/matplotlib/figure.py", line 3074, in draw
    mimage._draw_list_compositing_images(
  File "~/miniconda3/envs/goes2go/lib/python3.9/site-packages/matplotlib/image.py", line 131, in _draw_list_compositing_images
    a.draw(renderer)
  File "~/miniconda3/envs/goes2go/lib/python3.9/site-packages/matplotlib/artist.py", line 51, in draw_wrapper
    return draw(artist, renderer)
  File "~/miniconda3/envs/goes2go/lib/python3.9/site-packages/cartopy/mpl/geoaxes.py", line 558, in draw
    return matplotlib.axes.Axes.draw(self, renderer=renderer, **kwargs)
  File "~/miniconda3/envs/goes2go/lib/python3.9/site-packages/matplotlib/artist.py", line 51, in draw_wrapper
    return draw(artist, renderer)
  File "~/miniconda3/envs/goes2go/lib/python3.9/site-packages/matplotlib/axes/_base.py", line 3107, in draw
    mimage._draw_list_compositing_images(
  File "~/miniconda3/envs/goes2go/lib/python3.9/site-packages/matplotlib/image.py", line 131, in _draw_list_compositing_images
    a.draw(renderer)
  File "~/miniconda3/envs/goes2go/lib/python3.9/site-packages/matplotlib/artist.py", line 51, in draw_wrapper
    return draw(artist, renderer)
  File "~/miniconda3/envs/goes2go/lib/python3.9/site-packages/cartopy/mpl/feature_artist.py", line 147, in draw
    extent = ax.get_extent(feature_crs)
  File "~/miniconda3/envs/goes2go/lib/python3.9/site-packages/cartopy/mpl/geoaxes.py", line 814, in get_extent
    p = self._get_extent_geom(crs)
  File "~/miniconda3/envs/goes2go/lib/python3.9/site-packages/cartopy/mpl/geoaxes.py", line 821, in _get_extent_geom
    with self.hold_limits():
  File "~/miniconda3/envs/goes2go/lib/python3.9/contextlib.py", line 119, in __enter__
    return next(self.gen)
  File "~/miniconda3/envs/goes2go/lib/python3.9/site-packages/cartopy/mpl/geoaxes.py", line 491, in hold_limits
    self._autoscaleXon, self._autoscaleYon)
AttributeError: 'GeoAxesSubplot' object has no attribute '_autoscaleXon'

Hi All - Love using 'goes_latest' - works great, Unable to use 'goes_timerange' and get python runtime error on windows. Suggestions to address spawn and fork issues in python setup or in goes2go? The toml config file has cpu set as 2 which did not affect 'goes-latest' use.

        if __name__ == '__main__':
            freeze_support()
            ...

Thanks, Jeff