Optimizers
==========

The optim module provides optimization algorithms for training neural networks.

Base Optimizer
--------------

.. automodule:: fit.optim.base
   :members:
   :undoc-members:
   :show-inheritance:

Standard Optimizers
-------------------

SGD
~~~

.. automodule:: fit.optim.sgd
   :members:
   :undoc-members:
   :show-inheritance:

Adam
~~~~

.. automodule:: fit.optim.adam
   :members:
   :undoc-members:
   :show-inheritance:

RMSprop
~~~~~~~

.. automodule:: fit.optim.rmsprop
   :members:
   :undoc-members:
   :show-inheritance:

Advanced Optimizers
-------------------

SAM (Sharpness-Aware Minimization)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

.. automodule:: fit.optim.experimental.sam
   :members:
   :undoc-members:
   :show-inheritance:

Lion
~~~~

.. automodule:: fit.optim.experimental.lion
   :members:
   :undoc-members:
   :show-inheritance:

Learning Rate Schedulers
------------------------

.. automodule:: fit.optim.scheduler
   :members:
   :undoc-members:
   :show-inheritance: