Add Open Energy Modeling at JuMP-dev 2024

[odow]

This is part of a deliverable for #154, so we can wait until that is announced before merging.

I haven't finished yet, but I'll ping @datejada, @trulsf, @jd-lara and @hellemo for initial feedback (if you are interested/have time).

Other talks to include:

• https://www.youtube.com/watch?v=W4LOKR7B4ts
• https://www.youtube.com/watch?v=HwOOww8vwyA
• https://www.youtube.com/watch?v=rWmllzN4P18 Doesn't really focus on the JuMP aspects
• https://www.youtube.com/watch?v=n0wmYTm6Y64
• https://www.youtube.com/watch?v=POOt1FCA8LI
• https://www.youtube.com/watch?v=rYUZK9kYeIY
• https://www.youtube.com/watch?v=tvBNQcuU-hY

Maybe others?

[datejada]

@odow Thanks for the comprehensive summary of our talks from TNO. We learned a lot from the JuMP-dev workshop and were happy to participate and contribute.

[odow]

Thanks! Did I miss (or mis-interpret) anything in your talk? I've sent you a calendar invite for a regular call series I'm starting up as it relates to #154. But it's at a pretty terrible time for you, so once we have something concrete to discuss, we could always schedule something at a more convenient time.

[trulsf]

Very good summaries! Regarding PiecewiseAffineApprox, we took a lot of inspiration from PiecewiseLinearOpt. Our focus was more on finding good convex piecewise approximation to data points (where you not necessarily have access to the function or the gradients). This was not covered by PiecewiseLinearOpt so we made our own package, but I think it would make sense to combine these features into a single package. We have plans to extend our work from only convex approximations to approximation of general function (similar to Kazda & Li, 2024). Then it would make even more sense to connect it with the modelling in PiecewiseLinearOpt (at least for univariate problems).

[datejada]

Thanks for the invitation; let's start with that schedule, and I will try to attend as much as possible. For instance, I'm sorry in advance because I am the first one I cannot participate. It is because I will be out of the office anyway.
Regarding the summary, I don't have any comments or suggested changes. Thanks!

[hellemo]

Thanks for the nice summary!

In the context of Energy Modeling at SINTEF it is perhaps worth to mention also EnergyModelsX, which was mentioned in our talks this year, and presented at JuMP-dev 2023 by @JulStraus https://www.youtube.com/watch?v=fARbeM8sANA&t=13s .

When it comes to performance in model building and workarounds, better documentation/advertising limitations is always useful, but I think it would benefit the JuMP ecosystem in large if the performance issues with sparse structures could be addressed at the JuMP-level by exploiting sparsity when building constraints, for example (see e.g. jump-dev/JuMP.jl#3438). The broader point of the SparseVariables package I would say is to demonstrate that this would allow people to write formulations that are closer to the math and hence easier to write, read and maintain - without sacrificing performance. Also keep in mind that many modellers in the energy domain do not have a background in computer science, so applying the current workarounds represents a significant barrier for them, and I believe this is perhaps the motivation for earlier algebraic modelling languages like GAMS to do these kinds of optimizations.

[odow]

I spent most of today re-watching a lot of JuMP-dev talks (on 2x speed!) and I've added a bunch more content. We've had quite a lot of energy-related talks! There are still a bunch that I haven't got to yet.

[odow]

I hope this post is actually pretty useful for future energy modelers. It's really a crash course on "here's everything that people have done previously and the various issues that we've run into."

Watching the talks back-to-back and making connections between them really is more than the sum of the parts.

[jd-lara]

@odow I think you should distinguish between applications that are energy models like Tulipa or GenX and those that are simulations tools like Sienna (PowerSimulations.jl)

[jd-lara]

Sienna is also one of the few tools that has a workflow with multiple resolves as part of the features and needs since it is the only JuMP application focused on simulations.

[odow]

I don't know if this is true. SpineOpt has a rolling-horizon feature, and so does @sstroemer's model.

[JulStraus]

The same is currently in development for EnergyModelsX.

[odow]

Okay! This kept getting longer and longer, but I think the first draft is done. Feedback appreciated.

[odow]

Also cc'ing @jd-foster @leonardgoeke @richard-weinhold @iSoron @joaquimg

[jd-lara]

We could reference from JuMP-dev 2024 that Pyomo arrived to a similar design of implementing a multiple dispatch like capability

[odow]

I think this is slightly different. Pyomo would say build models using blocks etc. They're using multiple dispatch internally to simplify the expression tree walkers.

[iSoron]

@odow Thanks for including UnitCommitment.jl in this review post. A few comments and suggestions:

• The current description compares UCjl with PowerModels.jl, but, in my opinion, does not make the distinction between the two packages very clear. The main distinction, as we see it, is that UCjl focuses on multi-period energy problems with integer decision variables modeling on/off status of generators.
• Since our JuMP-dev talk in 2021, we have added many new features to the package, including two-stage stochastic unit commitment, simulation of market clearing and decomposition methods. Here are some slides from the FERC Software Conference 2023.
• Since you have mentioned real-world usage of GenX and Sienna, I'd also like to mention that UnitCommitment.jl has been used by various academic institutions worldwide and by some industry stakeholders, including ISO-NE and EPRI Europe.

[jd-foster]

I wonder if the 'big-O' notation is potentially confusing for non-CS types.

[odow]

I wonder if the 'big-O' notation is potentially confusing for non-CS types.

I don't particularly care 😄 This post is mostly intended for our benefit, with a second-order benefit to energy system modelers.

[jd-foster]

This is a great overview - very useful to see it in one place.

[jd-foster]

All done.

[odow]

See

• https://jump.dev/open-energy-modeling/2024/09/19/open-energy-models/

Feel free to share:

• https://www.linkedin.com/posts/oscar-dowson-544704272_open-energy-modeling-at-jump-dev-activity-7242816000591585280-7a13?utm_source=share&utm_medium=member_desktop