Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

problem dataset weather and mae metric #60

Closed
m6129 opened this issue May 4, 2024 · 1 comment
Closed

problem dataset weather and mae metric #60

m6129 opened this issue May 4, 2024 · 1 comment

Comments

@m6129
Copy link

m6129 commented May 4, 2024

Hello, Dear Developer
Can I know if you have performed any operations on dataset weather, before feeding it into the model, I am getting an error
TypeError: object of type 'NoneType' has no len()

I also wanted to ask your advice, if it doesn't take a lot of your attention, if you could tell me how to calculate the MAE metric
Thanks

@ashok-arjun
Copy link
Contributor

ashok-arjun commented Jun 2, 2024

Hi,

Is the problem with the weather dataset solved? I can look into the error if it's not resolved.

As for the MAE metric, we do not recommend it in fact, since we did not design our model with point-forecasting in mind. However, if you'd like to compute it for a paper/report, you could use the MAE value returned by the GluonTS Evaluator along with other metrics, or using the mean of the probabilistic forecast and then computing MAE, or using the median of the probabilistic forecast and then computing MAE (you can try the 3 methods and choose the one with the best average MAE, since we do not provide any "default" way to compute MAE/give point-predictions). I request that you indicate that our model was meant for probabilistic forecasting, in case you report any point-forecasting metric.

@m6129 m6129 closed this as completed Jun 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants