Advanced Examples
=================

Advanced examples showcasing FIT's capabilities.

Optimizer Comparison
--------------------

Comparing different optimizers on the XOR problem:

.. literalinclude:: ../../examples/advanced/optimizer_comparison.py
   :language: python
   :caption: Optimizer Comparison

SAM Optimizer
-------------

Using Sharpness-Aware Minimization for better generalization:

.. literalinclude:: ../../examples/advanced/sam_example.py
   :language: python
   :caption: SAM Optimizer Example

Transformer Model
-----------------

Building and training a transformer model:

.. literalinclude:: ../../examples/advanced/transformer_example.py
   :language: python
   :caption: Transformer Example

Attention Visualization
-----------------------

Visualizing attention patterns:

.. literalinclude:: ../../examples/advanced/attention_visualization.py
   :language: python
   :caption: Attention Visualization

Ensemble Methods
----------------

Using ensemble methods for improved performance:

.. literalinclude:: ../../examples/advanced/ensemble_example.py
   :language: python
   :caption: Ensemble Methods

Custom Loss Functions
---------------------

Creating and using custom loss functions:

.. literalinclude:: ../../examples/advanced/custom_loss.py
   :language: python
   :caption: Custom Loss Functions