Good afternoon All,
I’m researching how to develop/train/use Transformers (those similar to GPT) for S&P 500 historical data as an example. It seems like Transformers are mainly used for NLP but there are articles out there that utilize them for time series. Can any fellow lead the way in how could I get started in doing these in MATLAB? I have done general things like convolutions, LSTMs, etc. but not on a transformers caliber with the DL Toolbox.

I found this MATLAB package (pasted below) to be somewhat useful but it seems to lean more into language rather than historical data points.
https://www.mathworks.com/matlabcentral/fileexchange/107375-transformer-models

Another side question: It’s possibe to use the Deep Network Designer app to layout a transformers architecture?
Any tip is appreciated.

Thank you,
YerayGood afternoon All,
I’m researching how to develop/train/use Transformers (those similar to GPT) for S&P 500 historical data as an example. It seems like Transformers are mainly used for NLP but there are articles out there that utilize them for time series. Can any fellow lead the way in how could I get started in doing these in MATLAB? I have done general things like convolutions, LSTMs, etc. but not on a transformers caliber with the DL Toolbox.

I found this MATLAB package (pasted below) to be somewhat useful but it seems to lean more into language rather than historical data points.
https://www.mathworks.com/matlabcentral/fileexchange/107375-transformer-models

Another side question: It’s possibe to use the Deep Network Designer app to layout a transformers architecture?
Any tip is appreciated.

Thank you,
Yeray Good afternoon All,
I’m researching how to develop/train/use Transformers (those similar to GPT) for S&P 500 historical data as an example. It seems like Transformers are mainly used for NLP but there are articles out there that utilize them for time series. Can any fellow lead the way in how could I get started in doing these in MATLAB? I have done general things like convolutions, LSTMs, etc. but not on a transformers caliber with the DL Toolbox.

I found this MATLAB package (pasted below) to be somewhat useful but it seems to lean more into language rather than historical data points.
https://www.mathworks.com/matlabcentral/fileexchange/107375-transformer-models

Another side question: It’s possibe to use the Deep Network Designer app to layout a transformers architecture?
Any tip is appreciated.

Thank you,
Yeray deep learning, ai, transformers, gpt MATLAB Answers — New Questions

​