<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:itunes="http://www.itunes.com/dtds/podcast-1.0.dtd" xmlns:googleplay="http://www.google.com/schemas/play-podcasts/1.0"><channel><title><![CDATA[Engineering Alpha]]></title><description><![CDATA[Sharing in-depth machine learning, quantitative, and technical market knowledge.]]></description><link>https://abouttrading.substack.com</link><image><url>https://substackcdn.com/image/fetch/$s_!Nute!,w_256,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2bdca2d1-f044-4511-84fd-5ae2fdd81b09_1024x1024.png</url><title>Engineering Alpha</title><link>https://abouttrading.substack.com</link></image><generator>Substack</generator><lastBuildDate>Fri, 10 Jul 2026 19:38:22 GMT</lastBuildDate><atom:link href="https://abouttrading.substack.com/feed" rel="self" type="application/rss+xml"/><copyright><![CDATA[Sofien Kaabar]]></copyright><language><![CDATA[en]]></language><webMaster><![CDATA[sofien@allabouttrading.com]]></webMaster><itunes:owner><itunes:email><![CDATA[sofien@allabouttrading.com]]></itunes:email><itunes:name><![CDATA[Sofien Kaabar, CFA]]></itunes:name></itunes:owner><itunes:author><![CDATA[Sofien Kaabar, CFA]]></itunes:author><googleplay:owner><![CDATA[sofien@allabouttrading.com]]></googleplay:owner><googleplay:email><![CDATA[sofien@allabouttrading.com]]></googleplay:email><googleplay:author><![CDATA[Sofien Kaabar, CFA]]></googleplay:author><itunes:block><![CDATA[Yes]]></itunes:block><item><title><![CDATA[Orthogonal Matching Pursuit for Time Series Forecasting]]></title><description><![CDATA[Unconventional Machine Learning Models for Conventional Forecasting]]></description><link>https://abouttrading.substack.com/p/orthogonal-matching-pursuit-for-time-085</link><guid isPermaLink="false">https://abouttrading.substack.com/p/orthogonal-matching-pursuit-for-time-085</guid><dc:creator><![CDATA[Sofien Kaabar, CFA]]></dc:creator><pubDate>Fri, 10 Jul 2026 19:20:04 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!Ilow!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcc47ee9c-ff6f-4cb1-bfb5-ccac8cea868b_1254x1254.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!Ilow!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcc47ee9c-ff6f-4cb1-bfb5-ccac8cea868b_1254x1254.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!Ilow!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcc47ee9c-ff6f-4cb1-bfb5-ccac8cea868b_1254x1254.png 424w, https://substackcdn.com/image/fetch/$s_!Ilow!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcc47ee9c-ff6f-4cb1-bfb5-ccac8cea868b_1254x1254.png 848w, https://substackcdn.com/image/fetch/$s_!Ilow!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcc47ee9c-ff6f-4cb1-bfb5-ccac8cea868b_1254x1254.png 1272w, https://substackcdn.com/image/fetch/$s_!Ilow!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcc47ee9c-ff6f-4cb1-bfb5-ccac8cea868b_1254x1254.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!Ilow!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcc47ee9c-ff6f-4cb1-bfb5-ccac8cea868b_1254x1254.png" width="1254" height="1254" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/cc47ee9c-ff6f-4cb1-bfb5-ccac8cea868b_1254x1254.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1254,&quot;width&quot;:1254,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!Ilow!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcc47ee9c-ff6f-4cb1-bfb5-ccac8cea868b_1254x1254.png 424w, https://substackcdn.com/image/fetch/$s_!Ilow!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcc47ee9c-ff6f-4cb1-bfb5-ccac8cea868b_1254x1254.png 848w, https://substackcdn.com/image/fetch/$s_!Ilow!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcc47ee9c-ff6f-4cb1-bfb5-ccac8cea868b_1254x1254.png 1272w, https://substackcdn.com/image/fetch/$s_!Ilow!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcc47ee9c-ff6f-4cb1-bfb5-ccac8cea868b_1254x1254.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Time-series forecasting often begins with a simple idea.</p><p>Recent observations may contain information about the next one.</p><p>The researcher therefore creates lagged inputs. The value from one period ago becomes one input. The value from two periods ago becomes another. The process may continue through ten, fifty, or several hundred historical periods.</p><p>This cre&#8230;</p>
      <p>
          <a href="https://abouttrading.substack.com/p/orthogonal-matching-pursuit-for-time-085">
              Read more
          </a>
      </p>
   ]]></content:encoded></item><item><title><![CDATA[Isotonic Regression for Time Series Forecasting]]></title><description><![CDATA[Unconventional Machine Learning Models for Conventional Forecasting]]></description><link>https://abouttrading.substack.com/p/isotonic-regression-for-time-series</link><guid isPermaLink="false">https://abouttrading.substack.com/p/isotonic-regression-for-time-series</guid><dc:creator><![CDATA[Sofien Kaabar, CFA]]></dc:creator><pubDate>Thu, 09 Jul 2026 19:16:51 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!fi6d!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3e3b15ee-1536-4479-ae44-ced4a70f23f8_1536x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!fi6d!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3e3b15ee-1536-4479-ae44-ced4a70f23f8_1536x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!fi6d!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3e3b15ee-1536-4479-ae44-ced4a70f23f8_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!fi6d!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3e3b15ee-1536-4479-ae44-ced4a70f23f8_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!fi6d!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3e3b15ee-1536-4479-ae44-ced4a70f23f8_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!fi6d!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3e3b15ee-1536-4479-ae44-ced4a70f23f8_1536x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!fi6d!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3e3b15ee-1536-4479-ae44-ced4a70f23f8_1536x1024.png" width="1456" height="971" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/3e3b15ee-1536-4479-ae44-ced4a70f23f8_1536x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:971,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!fi6d!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3e3b15ee-1536-4479-ae44-ced4a70f23f8_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!fi6d!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3e3b15ee-1536-4479-ae44-ced4a70f23f8_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!fi6d!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3e3b15ee-1536-4479-ae44-ced4a70f23f8_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!fi6d!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3e3b15ee-1536-4479-ae44-ced4a70f23f8_1536x1024.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>A forecasting model can rank future outcomes correctly while still producing poorly scaled predictions.</p><p>It may recognise that one observation is likely to be higher than another. It may correctly identify stronger and weaker signals. It may even place most observations in the correct order.</p><p>The numerical values can still be wrong.</p><p>A model may produce forec&#8230;</p>
      <p>
          <a href="https://abouttrading.substack.com/p/isotonic-regression-for-time-series">
              Read more
          </a>
      </p>
   ]]></content:encoded></item><item><title><![CDATA[The Other Support Vector Regressor Nobody Uses]]></title><description><![CDATA[Unconventional Machine Learning Models for Conventional Forecasting]]></description><link>https://abouttrading.substack.com/p/the-other-support-vector-regressor</link><guid isPermaLink="false">https://abouttrading.substack.com/p/the-other-support-vector-regressor</guid><dc:creator><![CDATA[Sofien Kaabar, CFA]]></dc:creator><pubDate>Wed, 08 Jul 2026 19:11:04 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!g7SS!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4d827cb8-42ca-49c1-9d24-9ffdb234b4f4_730x400.jpeg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!g7SS!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4d827cb8-42ca-49c1-9d24-9ffdb234b4f4_730x400.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!g7SS!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4d827cb8-42ca-49c1-9d24-9ffdb234b4f4_730x400.jpeg 424w, https://substackcdn.com/image/fetch/$s_!g7SS!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4d827cb8-42ca-49c1-9d24-9ffdb234b4f4_730x400.jpeg 848w, https://substackcdn.com/image/fetch/$s_!g7SS!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4d827cb8-42ca-49c1-9d24-9ffdb234b4f4_730x400.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!g7SS!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4d827cb8-42ca-49c1-9d24-9ffdb234b4f4_730x400.jpeg 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!g7SS!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4d827cb8-42ca-49c1-9d24-9ffdb234b4f4_730x400.jpeg" width="730" height="400" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/4d827cb8-42ca-49c1-9d24-9ffdb234b4f4_730x400.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:400,&quot;width&quot;:730,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!g7SS!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4d827cb8-42ca-49c1-9d24-9ffdb234b4f4_730x400.jpeg 424w, https://substackcdn.com/image/fetch/$s_!g7SS!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4d827cb8-42ca-49c1-9d24-9ffdb234b4f4_730x400.jpeg 848w, https://substackcdn.com/image/fetch/$s_!g7SS!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4d827cb8-42ca-49c1-9d24-9ffdb234b4f4_730x400.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!g7SS!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4d827cb8-42ca-49c1-9d24-9ffdb234b4f4_730x400.jpeg 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Each historical example contributes to the fitted relationship, even when its contribution is small. This can be reasonable when the dataset is limited and every observation contains useful information. It can become less efficient when the training history is large, repetitive, or noisy.</p><p>Nu Support Vector Regression takes a more selective approach.</p><p>The m&#8230;</p>
      <p>
          <a href="https://abouttrading.substack.com/p/the-other-support-vector-regressor">
              Read more
          </a>
      </p>
   ]]></content:encoded></item><item><title><![CDATA[Radius Neighbors Regressor for Time Series Forecasting]]></title><description><![CDATA[Unconventional Machine Learning Models for Conventional Forecasting]]></description><link>https://abouttrading.substack.com/p/radius-neighbors-regressor-for-time</link><guid isPermaLink="false">https://abouttrading.substack.com/p/radius-neighbors-regressor-for-time</guid><dc:creator><![CDATA[Sofien Kaabar, CFA]]></dc:creator><pubDate>Tue, 07 Jul 2026 19:03:02 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!jN2L!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa13ed0fc-4693-4cff-a9ff-25daefabb96d_1254x1254.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!jN2L!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa13ed0fc-4693-4cff-a9ff-25daefabb96d_1254x1254.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!jN2L!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa13ed0fc-4693-4cff-a9ff-25daefabb96d_1254x1254.png 424w, https://substackcdn.com/image/fetch/$s_!jN2L!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa13ed0fc-4693-4cff-a9ff-25daefabb96d_1254x1254.png 848w, https://substackcdn.com/image/fetch/$s_!jN2L!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa13ed0fc-4693-4cff-a9ff-25daefabb96d_1254x1254.png 1272w, https://substackcdn.com/image/fetch/$s_!jN2L!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa13ed0fc-4693-4cff-a9ff-25daefabb96d_1254x1254.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!jN2L!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa13ed0fc-4693-4cff-a9ff-25daefabb96d_1254x1254.png" width="1254" height="1254" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/a13ed0fc-4693-4cff-a9ff-25daefabb96d_1254x1254.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1254,&quot;width&quot;:1254,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!jN2L!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa13ed0fc-4693-4cff-a9ff-25daefabb96d_1254x1254.png 424w, https://substackcdn.com/image/fetch/$s_!jN2L!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa13ed0fc-4693-4cff-a9ff-25daefabb96d_1254x1254.png 848w, https://substackcdn.com/image/fetch/$s_!jN2L!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa13ed0fc-4693-4cff-a9ff-25daefabb96d_1254x1254.png 1272w, https://substackcdn.com/image/fetch/$s_!jN2L!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa13ed0fc-4693-4cff-a9ff-25daefabb96d_1254x1254.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Many forecasting models try to learn a general rule connecting past observations to future outcomes.</p><p>They examine the available training data, estimate one relationship, and apply that relationship to every new observation. The same fitted rule is used whether the current environment resembles a calm historical period, a volatile transition, or an unusua&#8230;</p>
      <p>
          <a href="https://abouttrading.substack.com/p/radius-neighbors-regressor-for-time">
              Read more
          </a>
      </p>
   ]]></content:encoded></item><item><title><![CDATA[Automatic Relevance Determination Regression for Time Series Forecasting]]></title><description><![CDATA[Unconventional Machine Learning Models for Conventional Forecasting]]></description><link>https://abouttrading.substack.com/p/automatic-relevance-determination</link><guid isPermaLink="false">https://abouttrading.substack.com/p/automatic-relevance-determination</guid><pubDate>Mon, 06 Jul 2026 18:59:03 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!l4MQ!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F496b9eca-3f15-4685-876b-21307fd74215_801x590.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!l4MQ!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F496b9eca-3f15-4685-876b-21307fd74215_801x590.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!l4MQ!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F496b9eca-3f15-4685-876b-21307fd74215_801x590.png 424w, https://substackcdn.com/image/fetch/$s_!l4MQ!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F496b9eca-3f15-4685-876b-21307fd74215_801x590.png 848w, https://substackcdn.com/image/fetch/$s_!l4MQ!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F496b9eca-3f15-4685-876b-21307fd74215_801x590.png 1272w, https://substackcdn.com/image/fetch/$s_!l4MQ!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F496b9eca-3f15-4685-876b-21307fd74215_801x590.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!l4MQ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F496b9eca-3f15-4685-876b-21307fd74215_801x590.png" width="801" height="590" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/496b9eca-3f15-4685-876b-21307fd74215_801x590.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:590,&quot;width&quot;:801,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!l4MQ!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F496b9eca-3f15-4685-876b-21307fd74215_801x590.png 424w, https://substackcdn.com/image/fetch/$s_!l4MQ!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F496b9eca-3f15-4685-876b-21307fd74215_801x590.png 848w, https://substackcdn.com/image/fetch/$s_!l4MQ!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F496b9eca-3f15-4685-876b-21307fd74215_801x590.png 1272w, https://substackcdn.com/image/fetch/$s_!l4MQ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F496b9eca-3f15-4685-876b-21307fd74215_801x590.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Time-series models are often given a large collection of possible inputs. A forecasting system may receive recent observations, older observations, rolling averages, volatility estimates, calendar information, and related external variables. Some of these inputs may contain useful information. Others may be redundant, unstable, or entirely irrelevant.</p><p>This creates a practical problem. Adding more inputs gives the model more information to consider, but it also gives the model more opportunities to learn accidental patterns from the training data. A model may appear accurate during development because it has adapted to noise that will never occur in the same form again.</p><p>Automatic Relevance Determination Regression, available in scikit-learn as <code>ARDRegression</code>, approaches this problem by allowing the model to reduce the influence of inputs that do not appear consistently useful.</p><p>Rather than treating every input as equally deserving of attention, the model repeatedly evaluates how much each one contributes. Inputs that provide little dependable value are weakened. Some are effectively removed. The remaining inputs receive greater responsibility for the final prediction.</p><p>This makes ARDRegression particularly interesting for time-series research, where researchers frequently create dozens or hundreds of lagged observations without knowing which parts of the past are genuinely relevant.</p><h2>The central idea in plain language</h2><p>Imagine asking a group of witnesses to describe what happened during an event.</p><p>Some witnesses saw the event clearly. Some only saw part of it. Several heard the story from somebody else. Others were present but paid no attention. One person confidently remembers details that never happened.</p><p>A conventional model listens to everyone and tries to determine how much weight to give each account. This can work when the useful witnesses are obvious and the unreliable ones are harmless. It becomes less dependable when many witnesses repeat similar stories or when random details happen to fit the available evidence.</p><p>ARDRegression behaves more cautiously. It begins by allowing every witness to contribute. It then repeatedly checks whether each contribution appears necessary. Witnesses whose information does not add dependable value gradually lose influence. Some are ignored almost completely.</p><p>In a time-series setting, the witnesses are usually past observations.</p><p>A model might receive the value from one period ago, two periods ago, three periods ago, and so on. It may also receive rolling statistics or external variables. ARDRegression tries to determine which of these historical clues deserve to remain active.</p><p>Scikit-learn implements this as an iterative model. During training, it repeatedly updates the estimated influence of each input and can remove inputs that its internal relevance test considers too weak. The official documentation describes this removal process through the model&#8217;s <code>threshold_lambda</code> setting.</p><p>The practical result is a model that can begin with a broad set of candidate inputs and finish with a narrower set of active influences.</p><h2>ARDRegression does not understand time automatically</h2><p>ARDRegression is a general regression algorithm. It has no built-in understanding of sequence, chronology, cycles, or market history.</p><p>If it receives a column of values, it does not automatically know that one row occurred after another. It sees examples and inputs, much like any standard scikit-learn regression model.</p><p>The researcher must therefore represent the historical structure explicitly.</p><p>A common method is to create lagged observations. Each row contains several values from the recent past, while the target contains the next value to be predicted.</p><p>For example, one training row may contain:</p><ul><li><p><em>The value one period ago</em></p></li><li><p><em>The value two periods ago</em></p></li><li><p><em>The value three periods ago</em></p></li><li><p><em>Additional older values</em></p></li></ul><p>The model then learns how those previous observations relate to the following observation.</p><p>This conversion turns a single time series into a supervised learning dataset. The process is straightforward, but the order of the data must be preserved. Future observations must never be used to predict earlier ones.</p><p>The training sample should come before the testing sample. Any scaling or preparation should also be learned from the training data alone. Scikit-learn&#8217;s own time-dependent examples preserve chronological order and explicitly warn against using later observations to train a model evaluated on earlier data.</p><h2>Why relevance selection matters for lagged data</h2><p>Lagged time-series features are usually strongly related to one another.</p><p>The value from one period ago may be similar to the value from two periods ago. The values from periods ten and eleven may also contain nearly identical information. If the series moves smoothly, many neighbouring lags can tell broadly the same story.</p><p>This creates a difficult environment for ordinary regression.</p><p>The model may spread influence across many similar inputs. It may assign importance to arbitrary lags simply because several alternatives contain almost the same information. Small changes in the training sample can then alter which lags appear important.</p><p>ARDRegression attempts to control this by asking whether every input needs to remain active. Weak inputs can be pushed toward irrelevance, while stronger inputs remain available.</p><p>This does not guarantee that the surviving lags are the uniquely correct ones. When several lagged values contain similar information, the model may keep one, several, or different combinations across samples. Relevance should therefore be interpreted as model-specific evidence rather than proof that a particular lag possesses a permanent forecasting property.</p><p>The main benefit is practical restraint. The researcher can provide a reasonably broad memory window without forcing every part of that window to influence the final prediction.</p><div class="pullquote"><p><strong>&#128680; Get your Quant Atlas Free trial (no credit card required) &#128680;</strong></p><p style="text-align: center;"><strong>Sign up takes ~9 seconds before you have unconditional 10-day access to 100+ market forecasts.</strong></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.quant-atlas.com/&quot;,&quot;text&quot;:&quot;Start Your Free Trial&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="https://www.quant-atlas.com/"><span>Start Your Free Trial</span></a></p></div><h2>How it differs from ordinary linear regression</h2><p>Ordinary linear regression tries to find one fixed relationship between the inputs and the target. Every input remains part of the model unless the researcher removes it manually.</p><p>This can work well with a small, carefully selected set of inputs. It becomes less attractive when the dataset contains many overlapping or irrelevant features.</p><p>ARDRegression adds an internal filtering process. It does not simply fit the relationship once. It also evaluates how confidently each input should be trusted.</p><p>An input that repeatedly appears useful can retain a meaningful role. An input whose contribution is weak or uncertain can be reduced. Inputs that fail the model&#8217;s internal relevance test can be assigned no effective influence.</p><p>This produces a form of automatic feature selection.</p><p>The model also provides an estimate of uncertainty around its predictions. Scikit-learn exposes this through <code>predict(return_std=True)</code>, allowing the user to retrieve both the central prediction and an estimate of how uncertain the model is about that prediction.</p><p>That uncertainty estimate should not be treated as a guarantee. It reflects the model&#8217;s assumptions and the information available in the training data. It cannot account for every possible structural break, unusual event, or change in the process generating the series.</p><h2>Experimental design</h2><p>The following experiment uses a synthetic time series built from two repeating waves.</p><p>The first wave moves relatively slowly. The second moves more quickly and has a smaller effect. Random noise is added on top of both waves.</p><p>This creates a useful controlled example. The underlying series has a real recurring structure, but each observation is disturbed by an unpredictable component.</p><p>The model receives the previous 80 observations and predicts the next observation.</p><p>Eighty lags are deliberately excessive for such a simple process. The point is to give ARDRegression more candidate inputs than it clearly needs and allow it to decide which ones deserve influence.</p><p>The data is split chronologically. The first 80 percent is used for training, and the final 20 percent is reserved for testing.</p><p>The test period remains completely unseen during model fitting.</p><p>The model is also compared with a simple baseline. The baseline assumes that the next observation will be equal to the most recent observation. This is a basic persistence forecast and provides a more meaningful comparison than reporting the model&#8217;s performance in isolation.</p><p>A forecasting model should generally demonstrate that it adds something beyond an obvious rule. Beating no benchmark at all is an achievement shared by a concerning number of published experiments.</p><h2>Python implementation</h2><pre><code><code>import numpy as np
import pandas as pd
import matplotlib.pyplot as plt
from sklearn.linear_model import ARDRegression
from sklearn.preprocessing import StandardScaler
from sklearn.metrics import mean_absolute_error, mean_squared_error, r2_score

rng = np.random.default_rng(42)

n = 1400
time = np.arange(n)

clean_signal = (
    np.sin(2 * np.pi * time / 50)
    + 0.35 * np.sin(2 * np.pi * time / 17)
)

series = clean_signal + rng.normal(0, 0.35, n)

max_lag = 80

frame = pd.DataFrame({
    "time": time,
    "value": series
})

lagged = pd.concat(
    [
        frame["value"].shift(lag).rename(f"lag_{lag}")
        for lag in range(1, max_lag + 1)
    ],
    axis=1
)

frame = pd.concat([frame, lagged], axis=1).dropna().reset_index(drop=True)

feature_columns = [f"lag_{lag}" for lag in range(1, max_lag + 1)]

X = frame[feature_columns]
y = frame["value"]

split = int(len(frame) * 0.8)

X_train = X.iloc[:split]
X_test = X.iloc[split:]

y_train = y.iloc[:split]
y_test = y.iloc[split:]

test_time = frame["time"].iloc[split:]

scaler = StandardScaler()

X_train_scaled = scaler.fit_transform(X_train)
X_test_scaled = scaler.transform(X_test)

model = ARDRegression(max_iter=1000)

model.fit(X_train_scaled, y_train)

prediction, prediction_uncertainty = model.predict(
    X_test_scaled,
    return_std=True
)

baseline = X_test["lag_1"].to_numpy()

model_average_error = mean_absolute_error(y_test, prediction)
model_large_error_score = np.sqrt(mean_squared_error(y_test, prediction))
model_explained_share = r2_score(y_test, prediction)

baseline_average_error = mean_absolute_error(y_test, baseline)
baseline_large_error_score = np.sqrt(mean_squared_error(y_test, baseline))

actual_change = y_test.to_numpy() - baseline
predicted_change = prediction - baseline

direction_accuracy = np.mean(
    np.sign(actual_change) == np.sign(predicted_change)
)

active_lags = np.sum(model.coef_ != 0)

lag_relevance = pd.Series(
    np.abs(model.coef_),
    index=feature_columns
).sort_values(ascending=False)

print(f"ARD average error: {model_average_error:.3f}")
print(f"Baseline average error: {baseline_average_error:.3f}")
print(f"ARD large-error score: {model_large_error_score:.3f}")
print(f"Baseline large-error score: {baseline_large_error_score:.3f}")
print(f"Explained share: {model_explained_share:.3f}")
print(f"Direction accuracy: {direction_accuracy:.3%}")
print(f"Active lags: {active_lags}")
print()
print("Most influential lags:")
print(lag_relevance.head(10))

plt.figure(figsize=(14, 6))

plt.plot(
    test_time,
    y_test,
    label="Real values",
    linewidth=1.4
)

plt.plot(
    test_time,
    prediction,
    label="ARD predictions",
    linewidth=1.8
)

plt.fill_between(
    test_time,
    prediction - 2 * prediction_uncertainty,
    prediction + 2 * prediction_uncertainty,
    alpha=0.2,
    label="Model uncertainty range"
)

plt.title("ARDRegression on a Noisy Sine Wave")
plt.xlabel("Time")
plt.ylabel("Value")
plt.grid(True, alpha=0.3)
plt.legend()
plt.tight_layout()
plt.show()</code></code></pre><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!krdc!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3db11e9f-1fa4-4a55-98b6-c001260ac0fe_1920x951.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!krdc!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3db11e9f-1fa4-4a55-98b6-c001260ac0fe_1920x951.png 424w, https://substackcdn.com/image/fetch/$s_!krdc!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3db11e9f-1fa4-4a55-98b6-c001260ac0fe_1920x951.png 848w, https://substackcdn.com/image/fetch/$s_!krdc!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3db11e9f-1fa4-4a55-98b6-c001260ac0fe_1920x951.png 1272w, https://substackcdn.com/image/fetch/$s_!krdc!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3db11e9f-1fa4-4a55-98b6-c001260ac0fe_1920x951.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!krdc!,w_2400,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3db11e9f-1fa4-4a55-98b6-c001260ac0fe_1920x951.png" width="1200" height="594.2307692307693" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/3db11e9f-1fa4-4a55-98b6-c001260ac0fe_1920x951.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:false,&quot;imageSize&quot;:&quot;large&quot;,&quot;height&quot;:721,&quot;width&quot;:1456,&quot;resizeWidth&quot;:1200,&quot;bytes&quot;:268372,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://abouttrading.substack.com/i/204199383?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3db11e9f-1fa4-4a55-98b6-c001260ac0fe_1920x951.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:&quot;center&quot;,&quot;offset&quot;:false}" class="sizing-large" alt="" srcset="https://substackcdn.com/image/fetch/$s_!krdc!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3db11e9f-1fa4-4a55-98b6-c001260ac0fe_1920x951.png 424w, https://substackcdn.com/image/fetch/$s_!krdc!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3db11e9f-1fa4-4a55-98b6-c001260ac0fe_1920x951.png 848w, https://substackcdn.com/image/fetch/$s_!krdc!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3db11e9f-1fa4-4a55-98b6-c001260ac0fe_1920x951.png 1272w, https://substackcdn.com/image/fetch/$s_!krdc!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3db11e9f-1fa4-4a55-98b6-c001260ac0fe_1920x951.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div class="highlighted_code_block" data-attrs="{&quot;language&quot;:&quot;plaintext&quot;,&quot;nodeId&quot;:null}" data-component-name="HighlightedCodeBlockToDOM"><pre class="shiki"><code class="language-plaintext">ARD average error: 0.310
Baseline average error: 0.425
ARD large-error score: 0.391
Baseline large-error score: 0.529
Explained share: 0.764
Direction accuracy: 76.136%
Active lags: 49

Most influential lags:
lag_1     0.145027
lag_50    0.073316
lag_65    0.067392
lag_48    0.064639
lag_64    0.059979
lag_23    0.054170
lag_74    0.051897
lag_26    0.050988
lag_29    0.050849
lag_72    0.050070</code></pre></div><h2>What the script is doing</h2><p>The random seed ensures that the same synthetic series is produced each time the script runs.</p><p>The clean signal contains two repeating movements. One completes a cycle every 50 observations. The other completes a cycle every 17 observations and has a smaller effect.</p><p>Random noise is then added to every observation. The model sees only the noisy result. It does not receive the clean signal, the cycle lengths, or any direct indication that two separate patterns exist.</p><p>The lag-building section creates 80 historical inputs. For every usable row, <code>lag_1</code> contains the immediately previous value, <code>lag_2</code> contains the value from two periods earlier, and the process continues through <code>lag_80</code>.</p><p>The first 80 rows are removed because they do not have a complete history.</p><p>The chronological split then places the earlier observations in the training sample and the later observations in the test sample. No shuffling takes place.</p><p>The scaler is trained only on the training inputs. It then applies the same transformation to the test inputs.</p><p>This ordering matters. Fitting the scaler on the complete dataset would allow information from the test period to influence the preparation of the training data. The leakage would be small in this synthetic example, but the research process should remain correct even when the effect appears harmless.</p><p>The model is fitted using up to 1,000 training iterations. It usually stops earlier once its internal estimates become stable.</p><p>The prediction step returns two outputs. The first is the predicted value. The second is the model&#8217;s uncertainty estimate.</p><p>The baseline uses <code>lag_1</code>, meaning that it predicts no change from the most recent observation.</p><h2>Reading the chart</h2><p>The real series should appear visibly noisier than the model prediction.</p><p>This is expected.</p><p>The random disturbance added to every observation cannot be forecast from earlier values. A sensible model should recover the repeating structure without attempting to reproduce every isolated jump.</p><p>As a result, the prediction line tends to move through the centre of the noisy observations. It follows the main rises and falls while ignoring some of the sharpest fluctuations.</p><p>That smoother appearance does not automatically indicate underfitting. The target contains both predictable structure and unpredictable noise. Reproducing the noise would improve the visual fit on known data but would not provide a dependable forecasting advantage on unseen observations.</p><p>The shaded region represents the model&#8217;s estimated uncertainty.</p><p>It tends to remain fairly stable in this experiment because the test data resembles the training data. The series continues to follow the same general process, with the same cycle structure and noise level.</p><p>A more revealing uncertainty experiment would alter the test period by changing the cycle length, increasing the noise, or introducing a trend. The model would then face observations that are less consistent with its training history.</p><p>Even then, the uncertainty estimate may not fully recognise the structural change. ARDRegression measures uncertainty within its own learned framework. It does not possess a separate mechanism for detecting every form of regime shift.</p><h2>Performance evaluation</h2><p>With the fixed random seed used in the script, the exact output may vary slightly across software versions, but a representative run produces an average model error of approximately <code>0.310</code>.</p><p>The persistence baseline produces an average error of approximately <code>0.425</code>.</p><p>This means the ARD model reduces the average miss by roughly 27 percent relative to simply carrying the latest observation forward.</p><p>The score that places greater emphasis on large mistakes is approximately <code>0.391</code> for ARDRegression and <code>0.529</code> for the baseline. The model therefore improves both typical accuracy and protection against larger misses.</p><p>The explained share is approximately <code>0.764</code>. In practical language, the model captures a substantial portion of the movement in the unseen test period, while the remaining variation includes random noise and modelling error.</p><p>The directional accuracy is approximately 76 percent. This measures whether the model correctly predicts whether the next value will rise or fall relative to the most recent observation.</p><p>This result should be interpreted carefully.</p><p>The synthetic series contains persistent repeating behaviour. Its direction is much easier to predict than the direction of a highly irregular financial return series. The experiment demonstrates that ARDRegression can recover recurring temporal structure from noisy lagged observations. It does not demonstrate that the same directional accuracy should be expected in markets.</p><p>The comparison with the baseline is especially important.</p><p>A smooth cyclical series naturally gives the most recent observation predictive value. The baseline is therefore not useless. It already follows the series reasonably well.</p><p>ARDRegression improves on it because the model can use a wider historical window. It can recognise where the series appears to be within its repeating movement rather than assuming that the current level will persist unchanged.</p><h2>Interpreting the selected lags</h2><p>The script reports how many lag inputs remain active and prints the ten with the strongest influence.</p><p>The strongest lag will often be the most recent observation. This is reasonable because the series moves continuously and nearby values tend to resemble one another.</p><p>Other influential lags may appear near the underlying cycle lengths or at positions that help identify the current phase of the repeating pattern.</p><p>The results should not be interpreted too literally.</p><p>The two waves overlap, and many neighbouring lags contain similar information. The model does not need to identify the exact cycle lengths in order to forecast effectively. It may combine several historical positions that together describe the current state of the series.</p><p>Different noise samples can also change the selected lags. A lag that appears important in one run may lose influence in another.</p><p>This is why feature stability should be tested across multiple chronological training windows. A lag that remains influential across many periods is more credible than one that appears only in a single fitted sample.</p><p>Scikit-learn&#8217;s own comparison examples show that ARDRegression can produce a sparser solution by setting some uninformative inputs to zero, while also noting that some irrelevant inputs may still retain influence. Automatic relevance selection reduces the problem; it does not grant the model supernatural judgment.</p><h2>Strengths and limitations</h2><h3>Strengths</h3><p>ARDRegression is useful when the researcher has many candidate inputs but expects only part of them to be genuinely informative.</p><p>This situation is common in time-series work. A dataset may contain dozens of lags, several rolling windows, multiple indicators, and related external series. Manually selecting a small subset can be arbitrary, while keeping everything can produce an unstable model.</p><p>ARDRegression offers a middle path. The researcher provides a broad candidate set, and the model reduces the role of weak inputs during training.</p><p>The resulting model remains relatively interpretable. Each input receives a visible influence value, and inputs removed by the relevance process can be identified.</p><p>This is considerably easier to inspect than a large tree ensemble or neural network. A researcher can examine which lags remain active, whether their importance changes over time, and whether the selected structure makes economic or scientific sense.</p><p>The model also provides a built-in uncertainty estimate. This is useful when the forecast must be considered alongside an indication of confidence rather than as a single unquestionable value.</p><p>ARDRegression can perform well on small and medium-sized datasets. It does not require the enormous training samples often associated with more complex models.</p><p>Its automatic restraint can also reduce overfitting when the number of candidate inputs is large relative to the amount of available data.</p><h3>Limitations</h3><p>ARDRegression remains a linear model.</p><p>It combines inputs through fixed influences. It does not naturally learn rules such as one relationship applying during high volatility and another applying during low volatility.</p><p>Nonlinear behaviour must be represented through additional engineered inputs or handled by another model class.</p><p>The model also assumes that the relationship learned during training remains reasonably stable during the test period. If the underlying process changes, the selected lags may no longer be relevant.</p><p>This matters greatly in financial time series. Market behaviour can change after policy shifts, volatility shocks, structural breaks, or changes in participant behaviour. A model trained on one environment may carry obsolete relationships into another.</p><p>Correlated inputs create another interpretive problem.</p><p>If several lags contain nearly identical information, the model may distribute influence across them or favour one somewhat arbitrarily. The selected features should not be treated as independent discoveries.</p><p>Computation can become expensive when the input set grows very large. ARDRegression performs repeated internal updates and is generally slower than simpler linear methods. Hundreds of features may remain manageable, but thousands of heavily overlapping features can make training less convenient.</p><p>The uncertainty range also has limits.</p><p>It reflects uncertainty as understood by the fitted model. It does not automatically account for data errors, unprecedented events, sudden regime changes, or incorrect assumptions in the feature design.</p><p>Finally, automatic relevance determination does not eliminate the need for careful validation.</p><p>A single chronological train-test split is adequate for demonstration, but serious research should repeat the process across multiple forward-moving windows. Performance, selected inputs, and uncertainty behaviour should all be examined through time.</p><p>A model that performs well in one final test segment may simply have encountered a favourable period. The more important question is whether it continues to add value across changing samples without relying on future information.</p>]]></content:encoded></item><item><title><![CDATA[What is Kernel Ridge Regression?]]></title><description><![CDATA[How Regularization and Kernels Work Together for Strong Predictive Models]]></description><link>https://abouttrading.substack.com/p/what-is-kernel-ridge-regression</link><guid isPermaLink="false">https://abouttrading.substack.com/p/what-is-kernel-ridge-regression</guid><dc:creator><![CDATA[Sofien Kaabar, CFA]]></dc:creator><pubDate>Fri, 03 Jul 2026 18:37:30 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!RI5S!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdb37cccf-8333-421f-87cc-89db826341c8_1829x980.jpeg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!RI5S!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdb37cccf-8333-421f-87cc-89db826341c8_1829x980.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!RI5S!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdb37cccf-8333-421f-87cc-89db826341c8_1829x980.jpeg 424w, https://substackcdn.com/image/fetch/$s_!RI5S!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdb37cccf-8333-421f-87cc-89db826341c8_1829x980.jpeg 848w, https://substackcdn.com/image/fetch/$s_!RI5S!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdb37cccf-8333-421f-87cc-89db826341c8_1829x980.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!RI5S!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdb37cccf-8333-421f-87cc-89db826341c8_1829x980.jpeg 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!RI5S!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdb37cccf-8333-421f-87cc-89db826341c8_1829x980.jpeg" width="1456" height="780" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/db37cccf-8333-421f-87cc-89db826341c8_1829x980.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:780,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!RI5S!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdb37cccf-8333-421f-87cc-89db826341c8_1829x980.jpeg 424w, https://substackcdn.com/image/fetch/$s_!RI5S!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdb37cccf-8333-421f-87cc-89db826341c8_1829x980.jpeg 848w, https://substackcdn.com/image/fetch/$s_!RI5S!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdb37cccf-8333-421f-87cc-89db826341c8_1829x980.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!RI5S!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdb37cccf-8333-421f-87cc-89db826341c8_1829x980.jpeg 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><em><strong>Kernel Ridge Regression</strong></em> (KRR), sits at an interesting point between classical linear models and modern kernel methods. It keeps the structure of <em><strong>Ridge Regression</strong></em> but uses kernels to model nonlinear patterns. </p><p>This lets it handle complex relationships with a relatively simple mathematical foundation.</p><div><hr></div><h2>Introduction</h2><p>Regression methods often end up caught between underfitting and overfitting. Linear models lose power when relationships curve or twist in ways a straight line cannot capture. </p><p>More flexible models can overreact to noise. KRR offers a balanced alternative. It combines the stability of <em>Ridge Regression</em> with the flexibility of kernel functions, which expand the input space without explicitly computing higher dimensional features. The result is a model that can adapt to nonlinear data while keeping training stable.</p><p>Ridge Regression minimizes a squared error loss with a penalty on the magnitude of model weights. Formally, for data matrix <em><strong>X</strong></em> and target vector <em><strong>y</strong></em>, Ridge solves:</p><div class="captioned-image-container"><figure><a class="image-link image2" target="_blank" href="https://substackcdn.com/image/fetch/$s_!DLOe!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffe4eb611-98f2-4ee6-b6d1-942cfb340344_232x42.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!DLOe!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffe4eb611-98f2-4ee6-b6d1-942cfb340344_232x42.png 424w, https://substackcdn.com/image/fetch/$s_!DLOe!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffe4eb611-98f2-4ee6-b6d1-942cfb340344_232x42.png 848w, https://substackcdn.com/image/fetch/$s_!DLOe!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffe4eb611-98f2-4ee6-b6d1-942cfb340344_232x42.png 1272w, https://substackcdn.com/image/fetch/$s_!DLOe!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffe4eb611-98f2-4ee6-b6d1-942cfb340344_232x42.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!DLOe!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffe4eb611-98f2-4ee6-b6d1-942cfb340344_232x42.png" width="232" height="42" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/fe4eb611-98f2-4ee6-b6d1-942cfb340344_232x42.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:42,&quot;width&quot;:232,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:3432,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:&quot;&quot;,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://abouttrading.substack.com/i/179536222?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffe4eb611-98f2-4ee6-b6d1-942cfb340344_232x42.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!DLOe!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffe4eb611-98f2-4ee6-b6d1-942cfb340344_232x42.png 424w, https://substackcdn.com/image/fetch/$s_!DLOe!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffe4eb611-98f2-4ee6-b6d1-942cfb340344_232x42.png 848w, https://substackcdn.com/image/fetch/$s_!DLOe!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffe4eb611-98f2-4ee6-b6d1-942cfb340344_232x42.png 1272w, https://substackcdn.com/image/fetch/$s_!DLOe!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffe4eb611-98f2-4ee6-b6d1-942cfb340344_232x42.png 1456w" sizes="100vw"></picture><div></div></div></a></figure></div><p>The regularization term<em><strong> &#955;&#8741;w&#8741; </strong></em>controls model complexity. Larger <em><strong>&#955; </strong></em>shrinks the weights and reduces the risk of overfitting.</p><p><em><strong>Linear Ridge Regression</strong></em> can be rewritten in a dual form that depends only on inner products between samples. Replace those inner products with a kernel function <em><strong>k(xi,xj)</strong> </em>and the model can learn nonlinear boundaries. Popular kernels include:</p><ul><li><p><em>Gaussian (RBF) kernel</em></p></li><li><p><em>Polynomial kernel</em></p></li><li><p><em>Sigmoid kernel</em></p></li><li><p><em>Linear kernel (as a baseline)</em></p></li></ul><p>These functions measure similarity between data points in ways that emulate high dimensional feature mappings. KRR solves the system:</p><div class="captioned-image-container"><figure><a class="image-link image2" target="_blank" href="https://substackcdn.com/image/fetch/$s_!2bPn!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F64c2d018-b6dc-4be0-9773-35ec8605a0f5_179x47.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!2bPn!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F64c2d018-b6dc-4be0-9773-35ec8605a0f5_179x47.png 424w, https://substackcdn.com/image/fetch/$s_!2bPn!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F64c2d018-b6dc-4be0-9773-35ec8605a0f5_179x47.png 848w, https://substackcdn.com/image/fetch/$s_!2bPn!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F64c2d018-b6dc-4be0-9773-35ec8605a0f5_179x47.png 1272w, https://substackcdn.com/image/fetch/$s_!2bPn!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F64c2d018-b6dc-4be0-9773-35ec8605a0f5_179x47.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!2bPn!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F64c2d018-b6dc-4be0-9773-35ec8605a0f5_179x47.png" width="179" height="47" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/64c2d018-b6dc-4be0-9773-35ec8605a0f5_179x47.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:47,&quot;width&quot;:179,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2328,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:&quot;&quot;,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://abouttrading.substack.com/i/179536222?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F64c2d018-b6dc-4be0-9773-35ec8605a0f5_179x47.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!2bPn!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F64c2d018-b6dc-4be0-9773-35ec8605a0f5_179x47.png 424w, https://substackcdn.com/image/fetch/$s_!2bPn!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F64c2d018-b6dc-4be0-9773-35ec8605a0f5_179x47.png 848w, https://substackcdn.com/image/fetch/$s_!2bPn!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F64c2d018-b6dc-4be0-9773-35ec8605a0f5_179x47.png 1272w, https://substackcdn.com/image/fetch/$s_!2bPn!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F64c2d018-b6dc-4be0-9773-35ec8605a0f5_179x47.png 1456w" sizes="100vw" loading="lazy"></picture><div></div></div></a></figure></div><p>where<em> <strong>K</strong></em> is the kernel matrix. Predictions for a new input <em><strong>x</strong></em> follow:</p><div class="captioned-image-container"><figure><a class="image-link image2" target="_blank" href="https://substackcdn.com/image/fetch/$s_!2p9g!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3019052a-cc96-46d9-9b24-ba6bcfdf7ac1_190x68.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!2p9g!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3019052a-cc96-46d9-9b24-ba6bcfdf7ac1_190x68.png 424w, https://substackcdn.com/image/fetch/$s_!2p9g!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3019052a-cc96-46d9-9b24-ba6bcfdf7ac1_190x68.png 848w, https://substackcdn.com/image/fetch/$s_!2p9g!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3019052a-cc96-46d9-9b24-ba6bcfdf7ac1_190x68.png 1272w, https://substackcdn.com/image/fetch/$s_!2p9g!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3019052a-cc96-46d9-9b24-ba6bcfdf7ac1_190x68.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!2p9g!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3019052a-cc96-46d9-9b24-ba6bcfdf7ac1_190x68.png" width="190" height="68" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/3019052a-cc96-46d9-9b24-ba6bcfdf7ac1_190x68.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:68,&quot;width&quot;:190,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:3665,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:&quot;&quot;,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://abouttrading.substack.com/i/179536222?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3019052a-cc96-46d9-9b24-ba6bcfdf7ac1_190x68.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!2p9g!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3019052a-cc96-46d9-9b24-ba6bcfdf7ac1_190x68.png 424w, https://substackcdn.com/image/fetch/$s_!2p9g!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3019052a-cc96-46d9-9b24-ba6bcfdf7ac1_190x68.png 848w, https://substackcdn.com/image/fetch/$s_!2p9g!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3019052a-cc96-46d9-9b24-ba6bcfdf7ac1_190x68.png 1272w, https://substackcdn.com/image/fetch/$s_!2p9g!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3019052a-cc96-46d9-9b24-ba6bcfdf7ac1_190x68.png 1456w" sizes="100vw" loading="lazy"></picture><div></div></div></a></figure></div><p>This solution is simple, but computing <em><strong>K</strong> </em>and inverting <em><strong>K+&#955;I</strong></em> are both expensive when the dataset is large.</p><div class="pullquote"><p><strong>&#128680; Get your Quant Atlas Free trial (no credit card required) &#128680;</strong></p><p style="text-align: center;"><strong>Sign up takes ~9 seconds before you have unconditional 10-day access to 100+ market forecasts.</strong></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.quant-atlas.com/&quot;,&quot;text&quot;:&quot;Start Your Free Trial&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="https://www.quant-atlas.com/"><span>Start Your Free Trial</span></a></p></div><h2>Understanding the Hyperparameters</h2><h4>Regularization strength (&#955;)</h4><p>Controls the bias-variance tradeoff. Smaller values allow the model to fit the training data more tightly. Larger values promote smoother functions.</p><h4>Kernel choice</h4><p>The kernel defines the geometry of the model&#8217;s hypothesis space. An RBF kernel gives smooth, flexible functions. A polynomial kernel introduces interactions of controlled degree. Kernel choice shapes what patterns the model can learn.</p><h4>Kernel parameters</h4><p>For example, the RBF kernel uses a bandwidth parameter &#947;. A small <em><strong>&#947;</strong></em> creates a broad influence for each data point. A large <em><strong>&#947;</strong> </em>makes the model sensitive to small variations.</p><h2>Implementing the KRR</h2><p>Suppose we have a sine wave-like time series like the following and we want to predict the rest of the sequence.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!QZ4M!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F90b6b22c-c716-4ddf-9005-83a8f6655e56_1000x400.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!QZ4M!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F90b6b22c-c716-4ddf-9005-83a8f6655e56_1000x400.png 424w, https://substackcdn.com/image/fetch/$s_!QZ4M!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F90b6b22c-c716-4ddf-9005-83a8f6655e56_1000x400.png 848w, https://substackcdn.com/image/fetch/$s_!QZ4M!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F90b6b22c-c716-4ddf-9005-83a8f6655e56_1000x400.png 1272w, https://substackcdn.com/image/fetch/$s_!QZ4M!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F90b6b22c-c716-4ddf-9005-83a8f6655e56_1000x400.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!QZ4M!,w_2400,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F90b6b22c-c716-4ddf-9005-83a8f6655e56_1000x400.png" width="1200" height="480" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/90b6b22c-c716-4ddf-9005-83a8f6655e56_1000x400.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:false,&quot;imageSize&quot;:&quot;large&quot;,&quot;height&quot;:400,&quot;width&quot;:1000,&quot;resizeWidth&quot;:1200,&quot;bytes&quot;:36750,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:&quot;&quot;,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://abouttrading.substack.com/i/179536222?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F90b6b22c-c716-4ddf-9005-83a8f6655e56_1000x400.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:&quot;center&quot;,&quot;offset&quot;:false}" class="sizing-large" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!QZ4M!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F90b6b22c-c716-4ddf-9005-83a8f6655e56_1000x400.png 424w, https://substackcdn.com/image/fetch/$s_!QZ4M!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F90b6b22c-c716-4ddf-9005-83a8f6655e56_1000x400.png 848w, https://substackcdn.com/image/fetch/$s_!QZ4M!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F90b6b22c-c716-4ddf-9005-83a8f6655e56_1000x400.png 1272w, https://substackcdn.com/image/fetch/$s_!QZ4M!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F90b6b22c-c716-4ddf-9005-83a8f6655e56_1000x400.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>We will use the algorithm to implement the experiment:</p><pre><code><code>import numpy as np
import matplotlib.pyplot as plt
from sklearn.kernel_ridge import KernelRidge
from sklearn.preprocessing import StandardScaler

np.random.seed(42)

n = 1000
x = np.arange(n)
y = np.sin(0.1 * x)  + np.random.normal(0, 0.05, size=n)

plt.figure(figsize=(10, 4))
plt.plot(x, y)
plt.title(&#8221;Sinewave Series&#8221;)
plt.show()

def make_lag_features(y, nlags=5):
    data = {}
    for i in range(1, nlags + 1):
        data[f&#8221;lag{i}&#8221;] = np.roll(y, i)
    df = np.column_stack([data[f&#8221;lag{i}&#8221;] for i in range(1, nlags + 1)])
    # Fix first rows
    for i in range(nlags):
        df[i, :] = y[0]
    return df

nlags = 50
X = make_lag_features(y, nlags)

# Scale the lag matrix
scaler = StandardScaler()
X_scaled = scaler.fit_transform(X)

model = KernelRidge(kernel=&#8221;rbf&#8221;, alpha=0.1, gamma=1.0)
model.fit(X_scaled, y)

future_steps = 50
forecast = []

# Start from the last observed segment of lags
history = list(y.copy())

for step in range(future_steps):
    # Build lag vector from latest values
    lags = [history[-i] for i in range(1, nlags + 1)]
    row = np.array(lags).reshape(1, -1)

    # Scale features
    row_scaled = scaler.transform(row)

    # Predict next value
    next_val = model.predict(row_scaled)[0]

    # Store prediction
    forecast.append(next_val)

    # Add it to history so next step uses it as a lag
    history.append(next_val)

future_x = np.arange(n, n + future_steps)

plt.figure(figsize=(12, 4))
plt.plot(x, y, label=&#8221;Training series&#8221;)
plt.plot(future_x, forecast, label=&#8221;Recursive forecast&#8221;)
plt.legend()
plt.title(&#8221;Recursive Kernel Ridge Forecast with Lag Features&#8221;)
plt.show()</code></code></pre><p>The following is the output of the code.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!NF9g!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F00c30aa3-4353-41cd-93ec-b741de2ad87a_1200x767.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!NF9g!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F00c30aa3-4353-41cd-93ec-b741de2ad87a_1200x767.png 424w, https://substackcdn.com/image/fetch/$s_!NF9g!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F00c30aa3-4353-41cd-93ec-b741de2ad87a_1200x767.png 848w, https://substackcdn.com/image/fetch/$s_!NF9g!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F00c30aa3-4353-41cd-93ec-b741de2ad87a_1200x767.png 1272w, https://substackcdn.com/image/fetch/$s_!NF9g!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F00c30aa3-4353-41cd-93ec-b741de2ad87a_1200x767.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!NF9g!,w_2400,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F00c30aa3-4353-41cd-93ec-b741de2ad87a_1200x767.png" width="1200" height="767" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/00c30aa3-4353-41cd-93ec-b741de2ad87a_1200x767.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:false,&quot;imageSize&quot;:&quot;large&quot;,&quot;height&quot;:767,&quot;width&quot;:1200,&quot;resizeWidth&quot;:1200,&quot;bytes&quot;:113248,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:&quot;&quot;,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://abouttrading.substack.com/i/179536222?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F00c30aa3-4353-41cd-93ec-b741de2ad87a_1200x767.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:&quot;center&quot;,&quot;offset&quot;:false}" class="sizing-large" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!NF9g!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F00c30aa3-4353-41cd-93ec-b741de2ad87a_1200x767.png 424w, https://substackcdn.com/image/fetch/$s_!NF9g!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F00c30aa3-4353-41cd-93ec-b741de2ad87a_1200x767.png 848w, https://substackcdn.com/image/fetch/$s_!NF9g!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F00c30aa3-4353-41cd-93ec-b741de2ad87a_1200x767.png 1272w, https://substackcdn.com/image/fetch/$s_!NF9g!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F00c30aa3-4353-41cd-93ec-b741de2ad87a_1200x767.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Notice how the algorithm succeeds at capturing the oscillating nature of the time series.</p><p>KRR offers a clean and stable way to build nonlinear models. It unites the strengths of regularization and kernel methods in a simple mathematical framework.</p>]]></content:encoded></item><item><title><![CDATA[The Indigo Technical Indicator - A Primer]]></title><description><![CDATA[A throwback to a previous indicator I have created]]></description><link>https://abouttrading.substack.com/p/the-indigo-technical-indicator-a</link><guid isPermaLink="false">https://abouttrading.substack.com/p/the-indigo-technical-indicator-a</guid><dc:creator><![CDATA[Sofien Kaabar, CFA]]></dc:creator><pubDate>Thu, 02 Jul 2026 20:08:07 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!CvSU!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa6fd0cf-71b3-4ca1-8ac5-9a954c3dfc16_1672x941.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!CvSU!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa6fd0cf-71b3-4ca1-8ac5-9a954c3dfc16_1672x941.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!CvSU!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa6fd0cf-71b3-4ca1-8ac5-9a954c3dfc16_1672x941.png 424w, https://substackcdn.com/image/fetch/$s_!CvSU!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa6fd0cf-71b3-4ca1-8ac5-9a954c3dfc16_1672x941.png 848w, https://substackcdn.com/image/fetch/$s_!CvSU!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa6fd0cf-71b3-4ca1-8ac5-9a954c3dfc16_1672x941.png 1272w, https://substackcdn.com/image/fetch/$s_!CvSU!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa6fd0cf-71b3-4ca1-8ac5-9a954c3dfc16_1672x941.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!CvSU!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa6fd0cf-71b3-4ca1-8ac5-9a954c3dfc16_1672x941.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/fa6fd0cf-71b3-4ca1-8ac5-9a954c3dfc16_1672x941.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2148416,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://abouttrading.substack.com/i/203595474?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa6fd0cf-71b3-4ca1-8ac5-9a954c3dfc16_1672x941.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!CvSU!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa6fd0cf-71b3-4ca1-8ac5-9a954c3dfc16_1672x941.png 424w, https://substackcdn.com/image/fetch/$s_!CvSU!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa6fd0cf-71b3-4ca1-8ac5-9a954c3dfc16_1672x941.png 848w, https://substackcdn.com/image/fetch/$s_!CvSU!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa6fd0cf-71b3-4ca1-8ac5-9a954c3dfc16_1672x941.png 1272w, https://substackcdn.com/image/fetch/$s_!CvSU!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa6fd0cf-71b3-4ca1-8ac5-9a954c3dfc16_1672x941.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>The Indigo Indicator is a reversal tool designed to identify moments when price begins moving against an established directional structure.</p><p>It uses Fibonacci based lookback periods:</p><p><em><strong>1, 2, 3, 5, 8, 13, 21, and 34.</strong></em></p><p>These periods allow the indicator to compare the current price with progressively older market observations.</p>
      <p>
          <a href="https://abouttrading.substack.com/p/the-indigo-technical-indicator-a">
              Read more
          </a>
      </p>
   ]]></content:encoded></item><item><title><![CDATA[Everything You Need to Know About the AUC Metric]]></title><description><![CDATA[What the area under the ROC curve measures, why it became so popular, and when it can mislead you]]></description><link>https://abouttrading.substack.com/p/everything-you-need-to-know-about</link><guid isPermaLink="false">https://abouttrading.substack.com/p/everything-you-need-to-know-about</guid><dc:creator><![CDATA[Sofien Kaabar, CFA]]></dc:creator><pubDate>Wed, 01 Jul 2026 19:51:59 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!Fu2n!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4c76080c-0d25-4447-a5f0-dab4e5ac95d3_1672x941.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!Fu2n!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4c76080c-0d25-4447-a5f0-dab4e5ac95d3_1672x941.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!Fu2n!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4c76080c-0d25-4447-a5f0-dab4e5ac95d3_1672x941.png 424w, https://substackcdn.com/image/fetch/$s_!Fu2n!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4c76080c-0d25-4447-a5f0-dab4e5ac95d3_1672x941.png 848w, https://substackcdn.com/image/fetch/$s_!Fu2n!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4c76080c-0d25-4447-a5f0-dab4e5ac95d3_1672x941.png 1272w, https://substackcdn.com/image/fetch/$s_!Fu2n!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4c76080c-0d25-4447-a5f0-dab4e5ac95d3_1672x941.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!Fu2n!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4c76080c-0d25-4447-a5f0-dab4e5ac95d3_1672x941.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/4c76080c-0d25-4447-a5f0-dab4e5ac95d3_1672x941.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1865776,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://abouttrading.substack.com/i/203595359?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4c76080c-0d25-4447-a5f0-dab4e5ac95d3_1672x941.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!Fu2n!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4c76080c-0d25-4447-a5f0-dab4e5ac95d3_1672x941.png 424w, https://substackcdn.com/image/fetch/$s_!Fu2n!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4c76080c-0d25-4447-a5f0-dab4e5ac95d3_1672x941.png 848w, https://substackcdn.com/image/fetch/$s_!Fu2n!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4c76080c-0d25-4447-a5f0-dab4e5ac95d3_1672x941.png 1272w, https://substackcdn.com/image/fetch/$s_!Fu2n!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4c76080c-0d25-4447-a5f0-dab4e5ac95d3_1672x941.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Suppose a bank builds a model to predict which borrowers are most likely to default.</p><p>The model gives every applicant a score. A borrower with a score of 0.90 is considered riskier than one with a score of 0.30.</p><p>The bank then asks a simple question:</p><blockquote><p><em>Does the model generally assign higher scores to borrowers who eventually default?</em></p></blockquote><p>The AUC metric is one of th&#8230;</p>
      <p>
          <a href="https://abouttrading.substack.com/p/everything-you-need-to-know-about">
              Read more
          </a>
      </p>
   ]]></content:encoded></item><item><title><![CDATA[When Tables Learned to Forecast]]></title><description><![CDATA[How tabular foundation models are turning time series prediction into an ordinary regression problem]]></description><link>https://abouttrading.substack.com/p/when-tables-learned-to-forecast</link><guid isPermaLink="false">https://abouttrading.substack.com/p/when-tables-learned-to-forecast</guid><dc:creator><![CDATA[Sofien Kaabar, CFA]]></dc:creator><pubDate>Tue, 30 Jun 2026 20:02:16 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!k6xY!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F937a59ae-7a2e-4fff-a811-5032f5c24f1d_1536x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!k6xY!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F937a59ae-7a2e-4fff-a811-5032f5c24f1d_1536x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!k6xY!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F937a59ae-7a2e-4fff-a811-5032f5c24f1d_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!k6xY!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F937a59ae-7a2e-4fff-a811-5032f5c24f1d_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!k6xY!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F937a59ae-7a2e-4fff-a811-5032f5c24f1d_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!k6xY!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F937a59ae-7a2e-4fff-a811-5032f5c24f1d_1536x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!k6xY!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F937a59ae-7a2e-4fff-a811-5032f5c24f1d_1536x1024.png" width="1456" height="971" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/937a59ae-7a2e-4fff-a811-5032f5c24f1d_1536x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:971,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1840429,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://abouttrading.substack.com/i/203595274?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F937a59ae-7a2e-4fff-a811-5032f5c24f1d_1536x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!k6xY!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F937a59ae-7a2e-4fff-a811-5032f5c24f1d_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!k6xY!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F937a59ae-7a2e-4fff-a811-5032f5c24f1d_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!k6xY!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F937a59ae-7a2e-4fff-a811-5032f5c24f1d_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!k6xY!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F937a59ae-7a2e-4fff-a811-5032f5c24f1d_1536x1024.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Most of the recent attention in artificial intelligence has gone to language models.</p><p>That makes sense. A system that writes paragraphs and answers questions is considerably easier to demonstrate than one that predicts customer churn from a spreadsheet.</p><p>Yet a large part of the world&#8217;s useful data does not look like language.</p><p>It looks like a table.</p><p>A bank has&#8230;</p>
      <p>
          <a href="https://abouttrading.substack.com/p/when-tables-learned-to-forecast">
              Read more
          </a>
      </p>
   ]]></content:encoded></item><item><title><![CDATA[Attention is All You Need - It All Began Here]]></title><description><![CDATA[How a 2017 paper about machine translation became the foundation of modern artificial intelligence]]></description><link>https://abouttrading.substack.com/p/attention-is-all-you-need-it-all</link><guid isPermaLink="false">https://abouttrading.substack.com/p/attention-is-all-you-need-it-all</guid><dc:creator><![CDATA[Sofien Kaabar, CFA]]></dc:creator><pubDate>Mon, 29 Jun 2026 09:52:39 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!Dqpi!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F918ce1a8-e31b-4b84-9b58-883aea6c179c_1536x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!Dqpi!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F918ce1a8-e31b-4b84-9b58-883aea6c179c_1536x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!Dqpi!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F918ce1a8-e31b-4b84-9b58-883aea6c179c_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!Dqpi!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F918ce1a8-e31b-4b84-9b58-883aea6c179c_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!Dqpi!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F918ce1a8-e31b-4b84-9b58-883aea6c179c_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!Dqpi!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F918ce1a8-e31b-4b84-9b58-883aea6c179c_1536x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!Dqpi!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F918ce1a8-e31b-4b84-9b58-883aea6c179c_1536x1024.png" width="1456" height="971" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/918ce1a8-e31b-4b84-9b58-883aea6c179c_1536x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:971,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2372864,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://abouttrading.substack.com/i/203595154?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F918ce1a8-e31b-4b84-9b58-883aea6c179c_1536x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!Dqpi!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F918ce1a8-e31b-4b84-9b58-883aea6c179c_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!Dqpi!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F918ce1a8-e31b-4b84-9b58-883aea6c179c_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!Dqpi!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F918ce1a8-e31b-4b84-9b58-883aea6c179c_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!Dqpi!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F918ce1a8-e31b-4b84-9b58-883aea6c179c_1536x1024.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>In June 2017, eight Google researchers published a paper with the unusually confident title <em><strong>Attention Is All You Need.</strong></em></p><p>The paper was primarily about machine translation. Its authors wanted to build a system that could take a sentence in one language and produce the equivalent sentence in another.</p><p>What they created became far more important.</p><p>The paper introduced the <em><strong>Transformer</strong></em>, a new type of neural network that could process relationships between words more efficiently than the dominant systems of the time. The Transformer later became the foundation for BERT, the GPT family, ChatGPT, many image generation systems, coding assistants, translation tools, scientific models, and much of the current artificial intelligence industry.</p><p>The title turned out to be slightly exaggerated. Modern AI systems need considerably more than attention. They need enormous datasets, specialised hardware, careful training, human feedback, retrieval systems, safety mechanisms, and an uncomfortable quantity of electricity.</p><p>But the central idea of the paper was sound: <em>a model could process language without reading it strictly one word at a time.</em></p><p>That change mattered enormously.</p><div><hr></div><h2>The problem with reading one word at a time</h2><p>Before Transformers, many language models were built using recurrent neural networks, including more sophisticated versions known as LSTMs.</p><p>These models processed text sequentially.</p><p>To understand the sentence:</p><blockquote><p><em>The analyst who reviewed the company&#8217;s accounts rejected the forecast.</em></p></blockquote><p>the model would begin with &#8220;The,&#8221; update its internal memory, move to &#8220;analyst,&#8221; update its memory again, and continue until it reached &#8220;forecast.&#8221;</p><p>This approach seems natural because humans also encounter language in sequence. The sentence begins somewhere and ends somewhere.</p><p>For computers, however, sequential processing creates two problems.</p><p>The first is speed. A model cannot fully process the tenth word until it has processed the previous nine. Even with powerful computer chips, much of the work must happen in order.</p><p>The second is memory. By the time the model reaches the end of a long passage, information from the beginning may have been compressed, distorted, or partly forgotten.</p><p>Researchers had developed ways to reduce these problems, but the underlying structure remained restrictive. The model still had to pass information through a long chain of calculations.</p><p>The Transformer offered a different arrangement.</p><p>Instead of moving through a sentence step by step, it allowed the model to examine the words together and determine which ones were relevant to each other.</p><div><hr></div><h2>Attention existed before the Transformer</h2><p>The paper did not invent the general concept of attention.</p><p>Earlier language systems already used attention mechanisms, particularly in translation. Attention allowed a model producing a translated word to look back at the most relevant parts of the original sentence.</p><p>Suppose an English to French model was translating:</p><blockquote><p><em>The black cat is sleeping near the window.</em></p></blockquote><p>When generating the French word for &#8220;cat,&#8221; the model could place more weight on &#8220;cat&#8221; and &#8220;black&#8221; than on &#8220;window.&#8221;</p><p>Attention acted like a reference system. Instead of forcing the model to store the entire sentence inside a single compressed memory, it could return to the original words and select the information it needed.</p><p>The important step in the 2017 paper was removing the recurrent structure almost entirely.</p><p>Attention stopped being an additional feature attached to the main system. It became the main system.</p><div><hr></div><h2>What self attention does</h2><p>The core mechanism of the Transformer is called <em><strong>self attention</strong></em>.</p><p>Self attention allows every word, or more precisely every token, to assess the relevance of the other tokens around it.</p><p>A token is a small unit of text. It may be a complete word, part of a word, punctuation, or another recurring piece of language.</p><p>Consider the sentence:</p><blockquote><p><em>The bank raised its interest rates.</em></p></blockquote><p>The word &#8220;bank&#8221; is connected to &#8220;interest rates,&#8221; which suggests that it refers to a financial institution.</p><p>Now consider:</p><blockquote><p><em>The fisherman sat on the bank of the river.</em></p></blockquote><p>Here, &#8220;bank&#8221; is connected to &#8220;fisherman&#8221; and &#8220;river,&#8221; giving it a completely different meaning.</p><p>The word itself has not changed. Its meaning comes from its relationship with the rest of the sentence.</p><p>Self attention helps the model construct that relationship.</p><p>For each token, the model calculates how strongly it should attend to the other tokens. Some connections receive high weights. Others receive very little attention.</p><p>The resulting representation of &#8220;bank&#8221; therefore contains information about the surrounding context. It no longer represents only the dictionary meaning of the word. It represents the role the word is playing in that particular passage.</p><p>The model repeats this process across several layers. Early layers may capture relatively simple patterns. Later layers can combine those patterns into richer representations of syntax, reference, tone, subject matter, and meaning.</p><p>This does not mean the model understands language in the human sense. It means that it can construct highly useful mathematical representations of how pieces of language relate to one another.</p><h2>Queries, keys, and values</h2><p>The Transformer paper describes attention through three concepts: <em><strong>queries, keys, and values</strong>.</em></p><p>The terminology sounds more intimidating than the idea.</p><p>Imagine a search system.</p><p>A query describes what you are looking for. A key describes what each available item contains. A value contains the information that will be returned if the item is considered relevant.</p><p>Each token produces its own query, key, and value.</p><p>The model compares the query of one token with the keys of the other tokens. Strong matches receive larger weights. The model then combines the corresponding values according to those weights.</p><p>Take the sentence:</p><blockquote><p><em>Marie gave Anna the report because she had finished reviewing it.</em></p></blockquote><p>When processing &#8220;she,&#8221; the model needs to identify which earlier person the pronoun most likely refers to.</p><p>The query associated with &#8220;she&#8221; may match more strongly with the key associated with &#8220;Marie&#8221; or &#8220;Anna,&#8221; depending on the broader context learned by the model. The values connected to those words provide the information used to update the representation of &#8220;she.&#8221;</p><p>In practice, this is done through matrix multiplication rather than a miniature librarian searching through sentence fragments. The analogy is still useful because the basic operation resembles retrieval: determine what is relevant, then collect the associated information.</p><div><hr></div><h2>Why the model uses several attention heads</h2><p>A Transformer does not perform this process only once.</p><p>It uses multiple<em> <strong>attention heads</strong></em>, allowing the model to examine several types of relationships at the same time.</p><p>One head might focus on which adjective modifies which noun. Another may track pronouns. Another may connect verbs with their subjects. Another may identify relationships between distant sections of a paragraph.</p><p>The researchers do not manually assign these jobs. The model develops useful attention patterns during training.</p><p>Each head produces its own representation. These representations are then combined and passed through the rest of the network.</p><p>The benefit is similar to examining the same sentence from several perspectives. Language contains grammatical, semantic, positional, and contextual relationships simultaneously. A single measure of relevance would be too restrictive.</p><div><hr></div><h2>The missing ingredient: word order</h2><p>Self attention creates another problem.</p><p>If the model examines all the words together, how does it know which word came first?</p><p>The sentences:</p><blockquote><p><em>The dog chased the man.</em></p></blockquote><p>and:</p><blockquote><p><em>The man chased the dog.</em></p></blockquote><p>contain almost identical words, but their meanings are rather different for both the man and the dog.</p><p>A pure attention mechanism does not automatically contain a sense of order. To solve this, the original Transformer added <em><strong>positional encodings</strong> </em>to the representation of each token.</p><p>These encodings provide information about where a token appears in the sequence.</p><p>The model therefore receives two broad kinds of information: what the token represents and where it appears.</p><p>Later Transformer systems developed other ways to represent position, but the underlying requirement remains. Word order has to be supplied somehow because attention alone does not inherently know that one token came before another.</p><div class="pullquote"><p><strong>&#128680; Get your Quant Atlas Free trial (no credit card required) &#128680;</strong></p><p style="text-align: center;"><strong>Sign up takes ~9 seconds before you have unconditional 10-day access to 100+ market forecasts.</strong></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.quant-atlas.com/&quot;,&quot;text&quot;:&quot;Start Your Free Trial&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="https://www.quant-atlas.com/"><span>Start Your Free Trial</span></a></p></div><h2>The original Transformer had two sides</h2><p>The model described in the paper contained an <em><strong>encoder</strong> </em>and a <em><strong>decoder</strong></em>.</p><p>The encoder processed the input sentence and built contextual representations of its tokens.</p><p>The decoder generated the output sentence, one token at a time, while attending to the encoder&#8217;s representation of the input.</p><p>For translation, the division makes sense.</p><p>The encoder reads:</p><blockquote><p><em>Where is the nearest railway station?</em></p></blockquote><p>The decoder produces the equivalent sentence in another language.</p><p>The decoder also uses masked attention. When predicting the next token, it is prevented from looking at future tokens that have not yet been generated. Otherwise, training would resemble taking an examination while quietly reading the answer sheet.</p><p>This encoder and decoder design became one of several Transformer formats. Later researchers discovered that they could use only the encoder, only the decoder, or both, depending on the task.</p><p>That split would shape the next stage of language model development.</p><div><hr></div><h2>Why the Transformer was easier to scale</h2><p>The Transformer&#8217;s most important practical advantage was parallel processing.</p><p>Recurrent models had to process sequences largely in order. Transformers could process many tokens at the same time during training.</p><p>Modern graphics processors and specialised AI chips are extremely good at performing large groups of matrix calculations in parallel. The Transformer&#8217;s design matched the strengths of that hardware.</p><p>This did not make training cheap. Quite the opposite happened over time. Researchers used the efficiency gains to train much larger models on much larger datasets.</p><p>But the architecture offered a clearer path to scale.</p><p>As researchers added more data, more computing power, more parameters, and improved training methods, Transformer models continued to become more capable. That scaling behaviour helped turn an architecture designed for translation into a general platform for language modelling.</p><div><hr></div><h2>What came after the paper</h2><p>The Transformer paper supplied the architecture. The following years established how broadly that architecture could be used.</p><h3>GPT showed the value of generative pretraining</h3><p>In 2018, OpenAI introduced the first GPT model, short for <em><strong>Generative Pretrained Transformer</strong>.</em></p><p>GPT used the decoder side of the Transformer.</p><p>Its basic training task was straightforward: predict the next token in a sequence.</p><p>Given:</p><blockquote><p><em>The central bank increased interest rates because inflation remained...</em></p></blockquote><p>the model might learn to predict words such as &#8220;high&#8221; or &#8220;persistent.&#8221;</p><p>Repeating this exercise across a large body of text forces the model to learn a remarkable amount about grammar, style, facts, relationships, and recurring patterns in language.</p><p>The early GPT work also demonstrated the value of pretraining. Instead of building a separate model from scratch for every task, researchers could train one general language model on a large collection of text and then adapt it to more specific problems.</p><h3>BERT specialised in understanding context</h3><p>Later in 2018, Google introduced <strong>BERT</strong>, or Bidirectional Encoder Representations from Transformers.</p><p>BERT used the encoder side of the Transformer.</p><p>Instead of reading language only from left to right, BERT learned from context on both sides of a missing or masked word.</p><p>For example:</p><blockquote><p><em>The investor deposited the money at the [MASK].</em></p></blockquote><p>The surrounding words make &#8220;bank&#8221; a likely answer.</p><p>Because BERT could use both earlier and later context, it became particularly effective at tasks such as classification, search, question answering, and extracting information from documents.</p><p>For several years, BERT and related encoder models became standard tools across natural language processing.</p><h3>GPT 2 demonstrated more convincing generation</h3><p>GPT 2, released in 2019, was substantially larger than the original GPT.</p><p>It could generate longer and more coherent passages and perform several language tasks without being trained specifically for each one.</p><p>This helped establish a powerful idea: sufficiently broad language modelling could produce abilities that had previously required separate specialised systems.</p><p>The model still made factual mistakes, lost consistency, and generated nonsense. Those charming traditions remain alive in modern systems. But the direction of travel had become clear.</p><h3>T5 treated every language task as text</h3><p>Google&#8217;s T5 model presented summarisation, translation, classification, and question answering within a single text to text framework.</p><p>A classification task could be written as:</p><blockquote><p><em>sentiment: The film was painfully dull.</em></p></blockquote><p>and the model would output:</p><blockquote><p><em>negative</em></p></blockquote><p>A translation task could be written as:</p><blockquote><p><em>translate English to German: Where is the station?</em></p></blockquote><p>The same basic model could handle both because every task was expressed as text coming in and text going out.</p><p>This helped simplify the increasingly fragmented world of language processing. Researchers no longer needed a completely different model structure for every problem.</p><h3>GPT 3 made prompting a serious interface</h3><p>In 2020, GPT 3 showed that a sufficiently large language model could perform many tasks from instructions or a few examples placed directly in its input.</p><p>A user could provide several examples of a transformation and ask the model to continue the pattern. The model&#8217;s underlying parameters did not need to be updated for each new task.</p><p>This became known as <strong>in context learning</strong>.</p><p>Prompting existed before GPT 3, but the model made it central to how general language systems could be used. Natural language itself became a way of programming the model.</p><p>This development helped move AI away from systems operated mainly by machine learning specialists and toward systems that ordinary users could direct through written instructions.</p><div><hr></div><h2>Transformers moved beyond language</h2><p>Text can be divided into tokens, but it is not the only type of information that can be represented as a sequence.</p><p>Researchers began applying Transformer ideas to images, audio, video, biological data, and other structured information.</p><p>The <em><strong>Vision Transformer</strong></em>, introduced in 2020, divided an image into small patches. Each patch was treated somewhat like a token in a sentence.</p><p>Instead of relating words to one another, the model related areas of the image to one another.</p><p>A patch containing part of an eye could attend to patches containing a nose, an ear, or the outline of a face. Given enough training data, the model could learn visual relationships without depending entirely on the convolutional architecture that had previously dominated computer vision.</p><p>Models such as CLIP later connected text and images inside a shared representational system. This helped systems associate written descriptions with visual concepts and contributed to the development of more capable image search, classification, and generation tools.</p><p>Transformer based methods also spread into speech recognition, music, protein research, robotics, time series modelling, and software development.</p><p>The deeper contribution of the architecture was therefore broader than language. It provided a flexible way to model relationships within almost any information that could be arranged as tokens or structured units.</p><div><hr></div><h2>From language models to assistants</h2><p>A raw language model predicts likely continuations of text.</p><p>That alone does not produce a useful assistant.</p><p>A model trained only to continue text may imitate conversations, complete articles, reproduce biases from its training data, or confidently produce false information. It has no automatic reason to follow instructions, admit uncertainty, or prefer helpful answers.</p><p>The systems that followed GPT 3 added further training stages.</p><p>Researchers trained models on examples of instructions and desired responses. Human reviewers compared different model outputs. Those preferences were used to make models more helpful and easier to direct.</p><p>ChatGPT, released in November 2022, combined a GPT based language model with conversational training and human feedback.</p><p>The result placed the Transformer inside an interface that almost anyone could use.</p><p>The underlying operation was still token prediction. But years of development in pretraining, scaling, instruction tuning, human feedback, safety work, and product design had transformed that operation into something resembling a general purpose assistant.</p><p>Later multimodal models extended the same broad framework to images, documents, audio, and other inputs.</p><div><hr></div><h2>What the paper did not solve</h2><p>The success of Transformers can make the original architecture appear more complete than it was.</p><p>Several limitations remain.</p><p>Self attention can be computationally expensive because the model may need to compare every token with many other tokens. As the context becomes longer, the number of comparisons grows rapidly.</p><p>Transformers also do not possess an internal guarantee of truth. A model learns statistical relationships in its training data. It can produce an answer that is grammatically convincing and factually wrong.</p><p>Larger context windows improve how much information a model can consider, but they do not automatically produce reliable reasoning or perfect memory.</p><p>The architecture also says little about where training data should come from, how biases should be handled, how copyrighted or private information should be treated, how models should interact with tools, or how their outputs should be evaluated.</p><p>Many of the capabilities associated with modern AI came from developments after the original paper: better datasets, more computing power, improved optimisation, scaling research, instruction training, human feedback, retrieval, tool use, multimodal training, and extensive engineering.</p><p>The Transformer made these developments easier to pursue. It did not make them inevitable.</p><div><hr></div><h2>The paper&#8217;s real legacy</h2><p><em><strong>Attention Is All You Need</strong></em> began as a proposal for a better translation model.</p><p>Its lasting importance came from three linked ideas.</p><ul><li><p><em>First, relationships between tokens could be modelled directly through self attention.</em></p></li><li><p><em>Second, sequence processing could be made far more parallel, allowing researchers to use modern computing hardware efficiently.</em></p></li><li><p><em>Third, the same general architecture could be scaled and adapted across many different tasks and types of data.</em></p></li></ul><p>The paper did not contain ChatGPT in finished form. It did not provide the complete recipe for modern artificial intelligence.</p><p>It provided the architectural foundation on which much of that work could be built.</p><p>Before the Transformer, language models moved through text mainly as a sequence to be remembered.</p><p>After the Transformer, text could be processed as a network of relationships.</p><p>That change was enough to redirect the field.</p>]]></content:encoded></item><item><title><![CDATA[A Primer on Support Vector Machines in Python]]></title><description><![CDATA[Everything You Need to Know About Support Vector Machines]]></description><link>https://abouttrading.substack.com/p/a-primer-on-support-vector-machines-094</link><guid isPermaLink="false">https://abouttrading.substack.com/p/a-primer-on-support-vector-machines-094</guid><dc:creator><![CDATA[Sofien Kaabar, CFA]]></dc:creator><pubDate>Fri, 26 Jun 2026 08:42:07 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!TTeU!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F135d79c8-417d-4086-9fee-e9a0234d2454_1024x1536.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!TTeU!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F135d79c8-417d-4086-9fee-e9a0234d2454_1024x1536.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!TTeU!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F135d79c8-417d-4086-9fee-e9a0234d2454_1024x1536.png 424w, https://substackcdn.com/image/fetch/$s_!TTeU!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F135d79c8-417d-4086-9fee-e9a0234d2454_1024x1536.png 848w, https://substackcdn.com/image/fetch/$s_!TTeU!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F135d79c8-417d-4086-9fee-e9a0234d2454_1024x1536.png 1272w, https://substackcdn.com/image/fetch/$s_!TTeU!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F135d79c8-417d-4086-9fee-e9a0234d2454_1024x1536.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!TTeU!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F135d79c8-417d-4086-9fee-e9a0234d2454_1024x1536.png" width="1024" height="1536" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/135d79c8-417d-4086-9fee-e9a0234d2454_1024x1536.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1536,&quot;width&quot;:1024,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!TTeU!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F135d79c8-417d-4086-9fee-e9a0234d2454_1024x1536.png 424w, https://substackcdn.com/image/fetch/$s_!TTeU!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F135d79c8-417d-4086-9fee-e9a0234d2454_1024x1536.png 848w, https://substackcdn.com/image/fetch/$s_!TTeU!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F135d79c8-417d-4086-9fee-e9a0234d2454_1024x1536.png 1272w, https://substackcdn.com/image/fetch/$s_!TTeU!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F135d79c8-417d-4086-9fee-e9a0234d2454_1024x1536.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><em><strong>Support Vector Machines (SVMs) </strong></em>have a reputation. They sound intimidating. They show up in textbooks with dense math. And many people skip them in favor of newer models that feel easier to explain.</p><p><em>That&#8217;s a mistake.</em></p><p>SVMs are one of the cleanest examples of how geometry, optimization, and machine learning come together. They&#8217;re powerful, flexible, and stil&#8230;</p>
      <p>
          <a href="https://abouttrading.substack.com/p/a-primer-on-support-vector-machines-094">
              Read more
          </a>
      </p>
   ]]></content:encoded></item><item><title><![CDATA[Time Series Foundation Models in Finance: Useful Tool or Expensive Illusion?]]></title><description><![CDATA[Why general purpose forecasting models may help financial research, but only if they survive the clean out of sample validation.]]></description><link>https://abouttrading.substack.com/p/time-series-foundation-models-in</link><guid isPermaLink="false">https://abouttrading.substack.com/p/time-series-foundation-models-in</guid><dc:creator><![CDATA[Sofien Kaabar, CFA]]></dc:creator><pubDate>Thu, 25 Jun 2026 21:04:28 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!j8cg!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd727b08c-477b-4c13-9315-f0b7aced8587_1536x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!j8cg!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd727b08c-477b-4c13-9315-f0b7aced8587_1536x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!j8cg!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd727b08c-477b-4c13-9315-f0b7aced8587_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!j8cg!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd727b08c-477b-4c13-9315-f0b7aced8587_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!j8cg!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd727b08c-477b-4c13-9315-f0b7aced8587_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!j8cg!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd727b08c-477b-4c13-9315-f0b7aced8587_1536x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!j8cg!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd727b08c-477b-4c13-9315-f0b7aced8587_1536x1024.png" width="1456" height="971" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d727b08c-477b-4c13-9315-f0b7aced8587_1536x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:971,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2600141,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://abouttrading.substack.com/i/202488156?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd727b08c-477b-4c13-9315-f0b7aced8587_1536x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!j8cg!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd727b08c-477b-4c13-9315-f0b7aced8587_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!j8cg!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd727b08c-477b-4c13-9315-f0b7aced8587_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!j8cg!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd727b08c-477b-4c13-9315-f0b7aced8587_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!j8cg!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd727b08c-477b-4c13-9315-f0b7aced8587_1536x1024.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Time series foundation models are becoming harder to ignore.</p><p>The basic promise is simple. Instead of training a forecasting model from scratch for every dataset, you use a model that has already learned patterns from a large collection of time series. The model is then applied to a new series with little or no extra training.</p><p>In plain English, it is the t&#8230;</p>
      <p>
          <a href="https://abouttrading.substack.com/p/time-series-foundation-models-in">
              Read more
          </a>
      </p>
   ]]></content:encoded></item><item><title><![CDATA[The Prediction Band Is More Important Than the Forecast]]></title><description><![CDATA[A single forecast gives you a number. A prediction band tells you how seriously that number should be taken.]]></description><link>https://abouttrading.substack.com/p/the-prediction-band-is-more-important</link><guid isPermaLink="false">https://abouttrading.substack.com/p/the-prediction-band-is-more-important</guid><dc:creator><![CDATA[Sofien Kaabar, CFA]]></dc:creator><pubDate>Wed, 24 Jun 2026 21:01:56 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!bU2y!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fce9a8012-8135-460f-ae9f-60196f1c89bf_1536x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!bU2y!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fce9a8012-8135-460f-ae9f-60196f1c89bf_1536x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!bU2y!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fce9a8012-8135-460f-ae9f-60196f1c89bf_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!bU2y!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fce9a8012-8135-460f-ae9f-60196f1c89bf_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!bU2y!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fce9a8012-8135-460f-ae9f-60196f1c89bf_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!bU2y!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fce9a8012-8135-460f-ae9f-60196f1c89bf_1536x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!bU2y!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fce9a8012-8135-460f-ae9f-60196f1c89bf_1536x1024.png" width="1456" height="971" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/ce9a8012-8135-460f-ae9f-60196f1c89bf_1536x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:971,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2431890,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://abouttrading.substack.com/i/202487950?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fce9a8012-8135-460f-ae9f-60196f1c89bf_1536x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!bU2y!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fce9a8012-8135-460f-ae9f-60196f1c89bf_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!bU2y!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fce9a8012-8135-460f-ae9f-60196f1c89bf_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!bU2y!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fce9a8012-8135-460f-ae9f-60196f1c89bf_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!bU2y!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fce9a8012-8135-460f-ae9f-60196f1c89bf_1536x1024.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Forecasting is usually presented as a single number.</p><ul><li><p><em>The model expects EURUSD to rise.</em></p></li><li><p><em>The model expects crude oil volatility to expand.</em></p></li><li><p><em>The model expects the S&amp;P 500 to trade higher over the next few sessions.</em></p></li></ul><p>This is simple, but incomplete. A single forecast tells us what the model expects. It does not tell us how uncertain the model is around that expect&#8230;</p>
      <p>
          <a href="https://abouttrading.substack.com/p/the-prediction-band-is-more-important">
              Read more
          </a>
      </p>
   ]]></content:encoded></item><item><title><![CDATA[The Hidden Leakage That Creates Fake Alpha]]></title><description><![CDATA[Why many impressive backtests are not discovering market behavior, but accidentally importing future information into the past.]]></description><link>https://abouttrading.substack.com/p/the-hidden-leakage-that-creates-fake</link><guid isPermaLink="false">https://abouttrading.substack.com/p/the-hidden-leakage-that-creates-fake</guid><dc:creator><![CDATA[Sofien Kaabar, CFA]]></dc:creator><pubDate>Tue, 23 Jun 2026 20:56:26 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!qt2z!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F240d1257-9e6e-4426-8fb7-48163a29752b_1536x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!qt2z!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F240d1257-9e6e-4426-8fb7-48163a29752b_1536x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!qt2z!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F240d1257-9e6e-4426-8fb7-48163a29752b_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!qt2z!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F240d1257-9e6e-4426-8fb7-48163a29752b_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!qt2z!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F240d1257-9e6e-4426-8fb7-48163a29752b_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!qt2z!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F240d1257-9e6e-4426-8fb7-48163a29752b_1536x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!qt2z!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F240d1257-9e6e-4426-8fb7-48163a29752b_1536x1024.png" width="1456" height="971" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/240d1257-9e6e-4426-8fb7-48163a29752b_1536x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:971,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2520656,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://abouttrading.substack.com/i/202487755?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F240d1257-9e6e-4426-8fb7-48163a29752b_1536x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!qt2z!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F240d1257-9e6e-4426-8fb7-48163a29752b_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!qt2z!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F240d1257-9e6e-4426-8fb7-48163a29752b_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!qt2z!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F240d1257-9e6e-4426-8fb7-48163a29752b_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!qt2z!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F240d1257-9e6e-4426-8fb7-48163a29752b_1536x1024.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Machine learning research in finance often fails for reasons that have nothing to do with the model.</p><p>The algorithm may be well chosen. The feature set may look sensible. The performance table may show strong accuracy, high Sharpe, controlled drawdowns, and stable returns.</p><p>The problem is that the research process may be contaminated.</p><p>This contamination is c&#8230;</p>
      <p>
          <a href="https://abouttrading.substack.com/p/the-hidden-leakage-that-creates-fake">
              Read more
          </a>
      </p>
   ]]></content:encoded></item><item><title><![CDATA[My One Technical Indicator You Should Absolutely Use]]></title><description><![CDATA[Back to the Old Days of Creating Custom Technical Indicators]]></description><link>https://abouttrading.substack.com/p/my-one-technical-indicator-you-should</link><guid isPermaLink="false">https://abouttrading.substack.com/p/my-one-technical-indicator-you-should</guid><dc:creator><![CDATA[Sofien Kaabar, CFA]]></dc:creator><pubDate>Mon, 22 Jun 2026 20:48:52 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!FzCq!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffcad34f8-edf0-4f98-be84-814973583fbe_1672x941.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!FzCq!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffcad34f8-edf0-4f98-be84-814973583fbe_1672x941.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!FzCq!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffcad34f8-edf0-4f98-be84-814973583fbe_1672x941.png 424w, https://substackcdn.com/image/fetch/$s_!FzCq!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffcad34f8-edf0-4f98-be84-814973583fbe_1672x941.png 848w, https://substackcdn.com/image/fetch/$s_!FzCq!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffcad34f8-edf0-4f98-be84-814973583fbe_1672x941.png 1272w, https://substackcdn.com/image/fetch/$s_!FzCq!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffcad34f8-edf0-4f98-be84-814973583fbe_1672x941.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!FzCq!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffcad34f8-edf0-4f98-be84-814973583fbe_1672x941.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/fcad34f8-edf0-4f98-be84-814973583fbe_1672x941.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1867827,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://abouttrading.substack.com/i/202485959?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffcad34f8-edf0-4f98-be84-814973583fbe_1672x941.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!FzCq!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffcad34f8-edf0-4f98-be84-814973583fbe_1672x941.png 424w, https://substackcdn.com/image/fetch/$s_!FzCq!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffcad34f8-edf0-4f98-be84-814973583fbe_1672x941.png 848w, https://substackcdn.com/image/fetch/$s_!FzCq!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffcad34f8-edf0-4f98-be84-814973583fbe_1672x941.png 1272w, https://substackcdn.com/image/fetch/$s_!FzCq!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffcad34f8-edf0-4f98-be84-814973583fbe_1672x941.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><em><strong>The Yellow Indicator </strong></em>is built around a simple idea: <em>momentum extremes are often more useful when they are viewed as a sequence, not as isolated readings.</em></p><p>Many RSI based tools focus only on whether the oscillator is above or below a fixed threshold. This indicator adds a timing condition around the RSI movement itself. It does not simply mark every interaction with the 30 or 70 levels. Instead, it waits for a specific change in short term RSI behavior after the oscillator has recently interacted with one of those zones.</p><p>The result is a clean chart overlay that plots yellow triangle signals directly on price.</p><p>Signals below the candle represent one type of momentum condition. Signals above the candle represent the opposite type of momentum condition. The indicator is designed to be visually simple, with the logic hidden behind the chart markers rather than displayed as a separate oscillator panel.</p><div><hr></div><h2>What the Indicator Measures</h2><p>The indicator uses the Relative Strength Index with a period of 13.</p><p>The RSI is a momentum oscillator that measures the speed and magnitude of recent price changes. In this script, it is not plotted directly. It is used internally to detect specific shifts in momentum behavior.</p><p>The key levels are 30 and 70.</p><p>These levels are widely used in RSI analysis, but the indicator does not treat them as automatic signal points. A signal only appears when several conditions are met at the same time.</p><p>The script checks:</p><ol><li><p><em>The current RSI direction compared with the previous RSI value.</em></p></li><li><p><em>Whether the previous RSI value was positioned around one of the key threshold zones.</em></p></li><li><p><em>Whether the RSI interacted with the opposite side of that threshold sequence two bars ago.</em></p></li><li><p><em>Whether the RSI state thirteen bars ago confirms that the setup is not just a single isolated fluctuation.</em></p></li></ol><p>This gives the indicator a small structural memory. It looks at the current RSI, the previous two RSI values, and the RSI value thirteen bars earlier.</p><p>That is the main difference between a basic RSI threshold marker and this indicator.</p><p>Yellow is not just asking:</p><p><em>&#8220;Is RSI low or high?&#8221;</em></p><p>It is asking:</p><p><em>&#8220;Has RSI recently moved through a specific threshold sequence, and is the current behavior consistent with a signal condition?&#8221;</em></p><div class="pullquote"><p><strong>&#128680; Get your Quant Atlas Free trial (no credit card required) &#128680;</strong></p><p style="text-align: center;"><strong>Sign up takes ~9 seconds before you have unconditional 10-day access to 100+ market forecasts.</strong></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.quant-atlas.com/&quot;,&quot;text&quot;:&quot;Start Your Free Trial&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="https://www.quant-atlas.com/"><span>Start Your Free Trial</span></a></p></div><h2>How the Signal Logic Works</h2><p>The script creates two internal signal conditions.</p><p>The first condition is plotted as a yellow upward triangle below the candle.</p><p>This condition requires the RSI to be lower than its previous value. It also requires the previous RSI value to be above 30, the RSI from two bars ago to be below 30, and the RSI from thirteen bars ago to be above 30.</p><p>In practical terms, the indicator is looking for a short term RSI sequence around the lower threshold zone, with an additional lookback condition to avoid treating every small fluctuation as a signal.</p><p>The second condition is plotted as a yellow downward triangle above the candle.</p><p>This condition requires the RSI to be higher than its previous value. It also requires the previous RSI value to be below 70, the RSI from two bars ago to be above 70, and the RSI from thirteen bars ago to be below 70.</p><p>This creates a mirrored logic around the upper threshold zone.</p><p>The two signal types are symmetrical in structure. Both use the same RSI period, the same short term comparison logic, and the same thirteen bar reference check.</p><p>The purpose is not to mark every RSI extreme. The purpose is to isolate a specific momentum transition around the threshold zones.</p><div><hr></div><h2>Why the Indicator Is Plotted on Price</h2><p>Although the calculation is based on RSI, the output is plotted directly on the price chart.</p><p>This makes the indicator easier to use visually. Instead of watching a separate oscillator window, the trader can see where the signal appears relative to the candle structure, recent swings, and surrounding price action.</p><p>The indicator uses yellow triangles for both signal types.</p><p>The visual design is intentionally minimal. There are no bands, no colored clouds, no complex dashboard, and no extra moving parts. The signal either appears or it does not.</p><p>This helps keep the chart clean.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!e7zr!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F329519ef-33ff-4c74-bd56-7cb5ffbfc778_1814x877.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!e7zr!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F329519ef-33ff-4c74-bd56-7cb5ffbfc778_1814x877.png 424w, https://substackcdn.com/image/fetch/$s_!e7zr!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F329519ef-33ff-4c74-bd56-7cb5ffbfc778_1814x877.png 848w, https://substackcdn.com/image/fetch/$s_!e7zr!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F329519ef-33ff-4c74-bd56-7cb5ffbfc778_1814x877.png 1272w, https://substackcdn.com/image/fetch/$s_!e7zr!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F329519ef-33ff-4c74-bd56-7cb5ffbfc778_1814x877.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!e7zr!,w_2400,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F329519ef-33ff-4c74-bd56-7cb5ffbfc778_1814x877.png" width="1200" height="580.2197802197802" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/329519ef-33ff-4c74-bd56-7cb5ffbfc778_1814x877.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:false,&quot;imageSize&quot;:&quot;large&quot;,&quot;height&quot;:704,&quot;width&quot;:1456,&quot;resizeWidth&quot;:1200,&quot;bytes&quot;:91862,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://abouttrading.substack.com/i/202485959?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F329519ef-33ff-4c74-bd56-7cb5ffbfc778_1814x877.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:&quot;center&quot;,&quot;offset&quot;:false}" class="sizing-large" alt="" srcset="https://substackcdn.com/image/fetch/$s_!e7zr!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F329519ef-33ff-4c74-bd56-7cb5ffbfc778_1814x877.png 424w, https://substackcdn.com/image/fetch/$s_!e7zr!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F329519ef-33ff-4c74-bd56-7cb5ffbfc778_1814x877.png 848w, https://substackcdn.com/image/fetch/$s_!e7zr!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F329519ef-33ff-4c74-bd56-7cb5ffbfc778_1814x877.png 1272w, https://substackcdn.com/image/fetch/$s_!e7zr!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F329519ef-33ff-4c74-bd56-7cb5ffbfc778_1814x877.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div><hr></div><h2>Signal Filtering</h2><p>The script also includes a simple one bar filter.</p><p>For the lower chart signal, the script checks that the opposite signal was not active on the previous bar.</p><p>For the upper chart signal, the script checks that the lower chart signal was not active on the previous bar.</p><p>This reduces immediate back to back conflict between opposite signal types.</p><p>The filter is not complicated, but it improves the visual behavior of the indicator. It helps avoid situations where the chart becomes crowded with alternating markers in a very short period.</p><p>The indicator remains reactive, but the signal output is slightly cleaner.</p><div><hr></div><h2>What the Code Does</h2><p>The script begins by defining the indicator:</p><pre><code><code>indicator("Rainbow Collection - Yellow", overlay = true)</code></code></pre><p>The overlay setting means the signals are displayed directly on the price chart instead of in a separate panel.</p><p>The RSI calculation is then created:</p><pre><code><code>rsi = ta.rsi(close, 13)</code></code></pre><p>This calculates a 13 period RSI using the closing price.</p><p>The first signal condition is:</p><pre><code><code>buy  = rsi &lt; rsi[1] and rsi[1] &gt; 30 and rsi[2] &lt; 30 and rsi[13] &gt; 30</code></code></pre><p>This condition checks four things:</p><ol><li><p><em>The current RSI is lower than the previous RSI.</em></p></li><li><p><em>The previous RSI was above 30.</em></p></li><li><p><em>The RSI two bars ago was below 30.</em></p></li><li><p><em>The RSI thirteen bars ago was above 30.</em></p></li></ol><p>The second signal condition is:</p><pre><code><code>sell = rsi &gt; rsi[1] and rsi[1] &lt; 70 and rsi[2] &gt; 70 and rsi[13] &lt; 70</code></code></pre><p>This condition mirrors the previous logic around the 70 level.</p><p>It checks:</p><ol><li><p><em>The current RSI is higher than the previous RSI.</em></p></li><li><p><em>The previous RSI was below 70.</em></p></li><li><p><em>The RSI two bars ago was above 70.</em></p></li><li><p><em>The RSI thirteen bars ago was below 70.</em></p></li></ol><p>The plotting section then displays the signals:</p><pre><code><code>plotshape(buy and sell[1] == 0, style = shape.triangleup, color = color.yellow, location = location.belowbar, size = size.small)
plotshape(sell and buy[1] == 0, style = shape.triangledown, color = color.yellow, location = location.abovebar, size = size.small)</code></code></pre><p>The first line plots a yellow upward triangle below the candle.</p><p>The second line plots a yellow downward triangle above the candle.</p><p>Both signals are small, clean, and designed to avoid unnecessary chart clutter.</p><div><hr></div><h2>Practical Interpretation</h2><p>Yellow should be understood as a signal timing tool based on RSI threshold behavior.</p><p>It does not forecast price directly. It does not produce targets, stops, or position sizing. It identifies specific momentum conditions and displays them visually on the chart.</p><p>This makes the indicator useful as a supporting layer rather than a complete trading system. A trader can study the signals in relation to:</p><ol><li><p><em>Recent price structure.</em></p></li><li><p><em>Support and resistance zones.</em></p></li><li><p><em>Trend direction.</em></p></li><li><p><em>Volatility conditions.</em></p></li><li><p><em>Candle behavior around the signal.</em></p></li><li><p><em>Broader market context.</em></p></li></ol><p>The signal itself is only one piece of information. Its usefulness depends on where it appears and how it behaves across different market conditions.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!NZuv!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5bba2861-f36c-45c0-b215-c3e497562e48_1814x877.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!NZuv!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5bba2861-f36c-45c0-b215-c3e497562e48_1814x877.png 424w, https://substackcdn.com/image/fetch/$s_!NZuv!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5bba2861-f36c-45c0-b215-c3e497562e48_1814x877.png 848w, https://substackcdn.com/image/fetch/$s_!NZuv!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5bba2861-f36c-45c0-b215-c3e497562e48_1814x877.png 1272w, https://substackcdn.com/image/fetch/$s_!NZuv!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5bba2861-f36c-45c0-b215-c3e497562e48_1814x877.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!NZuv!,w_2400,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5bba2861-f36c-45c0-b215-c3e497562e48_1814x877.png" width="1200" height="580.2197802197802" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/5bba2861-f36c-45c0-b215-c3e497562e48_1814x877.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:false,&quot;imageSize&quot;:&quot;large&quot;,&quot;height&quot;:704,&quot;width&quot;:1456,&quot;resizeWidth&quot;:1200,&quot;bytes&quot;:92832,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://abouttrading.substack.com/i/202485959?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5bba2861-f36c-45c0-b215-c3e497562e48_1814x877.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:&quot;center&quot;,&quot;offset&quot;:false}" class="sizing-large" alt="" srcset="https://substackcdn.com/image/fetch/$s_!NZuv!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5bba2861-f36c-45c0-b215-c3e497562e48_1814x877.png 424w, https://substackcdn.com/image/fetch/$s_!NZuv!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5bba2861-f36c-45c0-b215-c3e497562e48_1814x877.png 848w, https://substackcdn.com/image/fetch/$s_!NZuv!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5bba2861-f36c-45c0-b215-c3e497562e48_1814x877.png 1272w, https://substackcdn.com/image/fetch/$s_!NZuv!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5bba2861-f36c-45c0-b215-c3e497562e48_1814x877.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!BLza!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa278063b-94ea-45d8-a753-bdae0873e522_1815x877.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!BLza!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa278063b-94ea-45d8-a753-bdae0873e522_1815x877.png 424w, https://substackcdn.com/image/fetch/$s_!BLza!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa278063b-94ea-45d8-a753-bdae0873e522_1815x877.png 848w, https://substackcdn.com/image/fetch/$s_!BLza!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa278063b-94ea-45d8-a753-bdae0873e522_1815x877.png 1272w, https://substackcdn.com/image/fetch/$s_!BLza!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa278063b-94ea-45d8-a753-bdae0873e522_1815x877.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!BLza!,w_2400,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa278063b-94ea-45d8-a753-bdae0873e522_1815x877.png" width="1200" height="580.2197802197802" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/a278063b-94ea-45d8-a753-bdae0873e522_1815x877.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:false,&quot;imageSize&quot;:&quot;large&quot;,&quot;height&quot;:704,&quot;width&quot;:1456,&quot;resizeWidth&quot;:1200,&quot;bytes&quot;:84023,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://abouttrading.substack.com/i/202485959?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa278063b-94ea-45d8-a753-bdae0873e522_1815x877.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:&quot;center&quot;,&quot;offset&quot;:false}" class="sizing-large" alt="" srcset="https://substackcdn.com/image/fetch/$s_!BLza!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa278063b-94ea-45d8-a753-bdae0873e522_1815x877.png 424w, https://substackcdn.com/image/fetch/$s_!BLza!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa278063b-94ea-45d8-a753-bdae0873e522_1815x877.png 848w, https://substackcdn.com/image/fetch/$s_!BLza!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa278063b-94ea-45d8-a753-bdae0873e522_1815x877.png 1272w, https://substackcdn.com/image/fetch/$s_!BLza!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa278063b-94ea-45d8-a753-bdae0873e522_1815x877.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div><hr></div><h2>Strengths of the Indicator</h2><p>The indicator has three main strengths.</p><p>First, it is simple.</p><p>The calculation uses one RSI period, two threshold zones, and a short lookback structure. This makes it easy to understand and easy to inspect.</p><p>Second, it is clean.</p><p>The output is limited to yellow triangles on price. There is no visual overload.</p><p>Third, it uses sequence logic.</p><p>Instead of marking every RSI threshold event, the indicator checks how RSI behaved across several bars. This creates a more selective signal than a basic overbought or oversold marker.</p><div><hr></div><h2>Limitations</h2><p>The indicator should not be interpreted as a standalone decision system.</p><p>RSI based signals can behave differently across market regimes. In strongly directional markets, threshold based signals can appear early. In range bound markets, they may appear more frequently. In volatile markets, the sequence may trigger during unstable price behavior.</p><p>This is why the signal should be tested across assets, timeframes, and market conditions. The indicator gives a structured signal.</p><p>The research process determines whether that signal is useful.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!3ovG!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4b5fa7f-478a-47a4-a721-395f4d55974f_1815x877.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!3ovG!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4b5fa7f-478a-47a4-a721-395f4d55974f_1815x877.png 424w, https://substackcdn.com/image/fetch/$s_!3ovG!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4b5fa7f-478a-47a4-a721-395f4d55974f_1815x877.png 848w, https://substackcdn.com/image/fetch/$s_!3ovG!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4b5fa7f-478a-47a4-a721-395f4d55974f_1815x877.png 1272w, https://substackcdn.com/image/fetch/$s_!3ovG!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4b5fa7f-478a-47a4-a721-395f4d55974f_1815x877.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!3ovG!,w_2400,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4b5fa7f-478a-47a4-a721-395f4d55974f_1815x877.png" width="1200" height="580.2197802197802" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/e4b5fa7f-478a-47a4-a721-395f4d55974f_1815x877.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:false,&quot;imageSize&quot;:&quot;large&quot;,&quot;height&quot;:704,&quot;width&quot;:1456,&quot;resizeWidth&quot;:1200,&quot;bytes&quot;:90747,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://abouttrading.substack.com/i/202485959?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4b5fa7f-478a-47a4-a721-395f4d55974f_1815x877.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:&quot;center&quot;,&quot;offset&quot;:false}" class="sizing-large" alt="" srcset="https://substackcdn.com/image/fetch/$s_!3ovG!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4b5fa7f-478a-47a4-a721-395f4d55974f_1815x877.png 424w, https://substackcdn.com/image/fetch/$s_!3ovG!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4b5fa7f-478a-47a4-a721-395f4d55974f_1815x877.png 848w, https://substackcdn.com/image/fetch/$s_!3ovG!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4b5fa7f-478a-47a4-a721-395f4d55974f_1815x877.png 1272w, https://substackcdn.com/image/fetch/$s_!3ovG!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4b5fa7f-478a-47a4-a721-395f4d55974f_1815x877.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div>]]></content:encoded></item><item><title><![CDATA[Forecasting the Journey, Not Just the Destination]]></title><description><![CDATA[Presenting the ECAPR Forecasting Model]]></description><link>https://abouttrading.substack.com/p/forecasting-the-journey-not-just</link><guid isPermaLink="false">https://abouttrading.substack.com/p/forecasting-the-journey-not-just</guid><dc:creator><![CDATA[Sofien Kaabar, CFA]]></dc:creator><pubDate>Fri, 19 Jun 2026 20:26:51 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!8gkH!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3eb40043-e851-41d7-bf35-66158e614792_1055x895.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!8gkH!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3eb40043-e851-41d7-bf35-66158e614792_1055x895.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!8gkH!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3eb40043-e851-41d7-bf35-66158e614792_1055x895.png 424w, https://substackcdn.com/image/fetch/$s_!8gkH!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3eb40043-e851-41d7-bf35-66158e614792_1055x895.png 848w, https://substackcdn.com/image/fetch/$s_!8gkH!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3eb40043-e851-41d7-bf35-66158e614792_1055x895.png 1272w, https://substackcdn.com/image/fetch/$s_!8gkH!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3eb40043-e851-41d7-bf35-66158e614792_1055x895.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!8gkH!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3eb40043-e851-41d7-bf35-66158e614792_1055x895.png" width="1055" height="895" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/3eb40043-e851-41d7-bf35-66158e614792_1055x895.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:895,&quot;width&quot;:1055,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1187725,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://abouttrading.substack.com/i/201443492?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3eb40043-e851-41d7-bf35-66158e614792_1055x895.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!8gkH!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3eb40043-e851-41d7-bf35-66158e614792_1055x895.png 424w, https://substackcdn.com/image/fetch/$s_!8gkH!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3eb40043-e851-41d7-bf35-66158e614792_1055x895.png 848w, https://substackcdn.com/image/fetch/$s_!8gkH!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3eb40043-e851-41d7-bf35-66158e614792_1055x895.png 1272w, https://substackcdn.com/image/fetch/$s_!8gkH!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3eb40043-e851-41d7-bf35-66158e614792_1055x895.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Most forecasting models try to answer one question: <em><strong>Where will the price be in the future?</strong></em></p><p>That sounds useful, but it leaves out something important.</p><p>The path matters.</p><p>A market can end higher after moving smoothly upward. It can also end higher after first collapsing, then violently recovering. Both futures may land at the same final price, but they are no&#8230;</p>
      <p>
          <a href="https://abouttrading.substack.com/p/forecasting-the-journey-not-just">
              Read more
          </a>
      </p>
   ]]></content:encoded></item><item><title><![CDATA[Trend Following Secrets Part III - The MACD Way]]></title><description><![CDATA[A Short Series About Lesser Known Trend Following Techniques]]></description><link>https://abouttrading.substack.com/p/trend-following-secrets-part-iii</link><guid isPermaLink="false">https://abouttrading.substack.com/p/trend-following-secrets-part-iii</guid><dc:creator><![CDATA[Sofien Kaabar, CFA]]></dc:creator><pubDate>Thu, 18 Jun 2026 20:14:50 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!xsnM!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2f3ed4a-05ea-42d3-9b4e-3f2409c87848_1672x941.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!xsnM!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2f3ed4a-05ea-42d3-9b4e-3f2409c87848_1672x941.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!xsnM!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2f3ed4a-05ea-42d3-9b4e-3f2409c87848_1672x941.png 424w, https://substackcdn.com/image/fetch/$s_!xsnM!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2f3ed4a-05ea-42d3-9b4e-3f2409c87848_1672x941.png 848w, https://substackcdn.com/image/fetch/$s_!xsnM!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2f3ed4a-05ea-42d3-9b4e-3f2409c87848_1672x941.png 1272w, https://substackcdn.com/image/fetch/$s_!xsnM!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2f3ed4a-05ea-42d3-9b4e-3f2409c87848_1672x941.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!xsnM!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2f3ed4a-05ea-42d3-9b4e-3f2409c87848_1672x941.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/a2f3ed4a-05ea-42d3-9b4e-3f2409c87848_1672x941.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1351668,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://abouttrading.substack.com/i/201443645?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2f3ed4a-05ea-42d3-9b4e-3f2409c87848_1672x941.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!xsnM!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2f3ed4a-05ea-42d3-9b4e-3f2409c87848_1672x941.png 424w, https://substackcdn.com/image/fetch/$s_!xsnM!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2f3ed4a-05ea-42d3-9b4e-3f2409c87848_1672x941.png 848w, https://substackcdn.com/image/fetch/$s_!xsnM!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2f3ed4a-05ea-42d3-9b4e-3f2409c87848_1672x941.png 1272w, https://substackcdn.com/image/fetch/$s_!xsnM!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2f3ed4a-05ea-42d3-9b4e-3f2409c87848_1672x941.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Trend following is about staying aligned with the market&#8217;s main direction. The challenge is knowing when a trend has enough strength to continue, and when a pullback is only a temporary pause.</p><p>This is where the MACD can help.</p><p>The MACD is one of the most popular momentum indicators because it gives traders a simple way to read trend strength, momentum shif&#8230;</p>
      <p>
          <a href="https://abouttrading.substack.com/p/trend-following-secrets-part-iii">
              Read more
          </a>
      </p>
   ]]></content:encoded></item><item><title><![CDATA[Trend Following Secrets Part II - Invalidated Doji Patterns]]></title><description><![CDATA[A Short Series About Lesser Known Trend Following Techniques]]></description><link>https://abouttrading.substack.com/p/trend-following-secrets-part-ii-invalidated</link><guid isPermaLink="false">https://abouttrading.substack.com/p/trend-following-secrets-part-ii-invalidated</guid><dc:creator><![CDATA[Sofien Kaabar, CFA]]></dc:creator><pubDate>Wed, 17 Jun 2026 20:02:55 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!D9z_!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4a904e4a-3d02-4754-9247-8a7f1e7a329b_1672x941.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!D9z_!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4a904e4a-3d02-4754-9247-8a7f1e7a329b_1672x941.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!D9z_!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4a904e4a-3d02-4754-9247-8a7f1e7a329b_1672x941.png 424w, https://substackcdn.com/image/fetch/$s_!D9z_!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4a904e4a-3d02-4754-9247-8a7f1e7a329b_1672x941.png 848w, https://substackcdn.com/image/fetch/$s_!D9z_!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4a904e4a-3d02-4754-9247-8a7f1e7a329b_1672x941.png 1272w, https://substackcdn.com/image/fetch/$s_!D9z_!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4a904e4a-3d02-4754-9247-8a7f1e7a329b_1672x941.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!D9z_!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4a904e4a-3d02-4754-9247-8a7f1e7a329b_1672x941.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/4a904e4a-3d02-4754-9247-8a7f1e7a329b_1672x941.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1335035,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://abouttrading.substack.com/i/201443594?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4a904e4a-3d02-4754-9247-8a7f1e7a329b_1672x941.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!D9z_!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4a904e4a-3d02-4754-9247-8a7f1e7a329b_1672x941.png 424w, https://substackcdn.com/image/fetch/$s_!D9z_!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4a904e4a-3d02-4754-9247-8a7f1e7a329b_1672x941.png 848w, https://substackcdn.com/image/fetch/$s_!D9z_!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4a904e4a-3d02-4754-9247-8a7f1e7a329b_1672x941.png 1272w, https://substackcdn.com/image/fetch/$s_!D9z_!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4a904e4a-3d02-4754-9247-8a7f1e7a329b_1672x941.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Trend following is not only about finding strong trends. It is also about understanding what happens when the market pauses.</p><p>One of the most common pause candles is the doji. Traders often treat a doji as a warning sign. They see it and immediately think, &#8220;The trend may reverse.&#8221;</p><p>Sometimes that is true. But many times, a doji simply shows hesitation befor&#8230;</p>
      <p>
          <a href="https://abouttrading.substack.com/p/trend-following-secrets-part-ii-invalidated">
              Read more
          </a>
      </p>
   ]]></content:encoded></item><item><title><![CDATA[Trend Following Secrets Part I - Hidden Divergences]]></title><description><![CDATA[A Short Series About Lesser Known Trend Following Techniques]]></description><link>https://abouttrading.substack.com/p/trend-following-secrets-part-i-hidden</link><guid isPermaLink="false">https://abouttrading.substack.com/p/trend-following-secrets-part-i-hidden</guid><dc:creator><![CDATA[Sofien Kaabar, CFA]]></dc:creator><pubDate>Tue, 16 Jun 2026 19:29:16 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!zB3W!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79b9e791-3d4c-41be-af7b-6a66a32dde32_1672x941.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!zB3W!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79b9e791-3d4c-41be-af7b-6a66a32dde32_1672x941.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!zB3W!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79b9e791-3d4c-41be-af7b-6a66a32dde32_1672x941.png 424w, https://substackcdn.com/image/fetch/$s_!zB3W!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79b9e791-3d4c-41be-af7b-6a66a32dde32_1672x941.png 848w, https://substackcdn.com/image/fetch/$s_!zB3W!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79b9e791-3d4c-41be-af7b-6a66a32dde32_1672x941.png 1272w, https://substackcdn.com/image/fetch/$s_!zB3W!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79b9e791-3d4c-41be-af7b-6a66a32dde32_1672x941.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!zB3W!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79b9e791-3d4c-41be-af7b-6a66a32dde32_1672x941.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/79b9e791-3d4c-41be-af7b-6a66a32dde32_1672x941.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1258284,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://abouttrading.substack.com/i/201443539?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79b9e791-3d4c-41be-af7b-6a66a32dde32_1672x941.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!zB3W!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79b9e791-3d4c-41be-af7b-6a66a32dde32_1672x941.png 424w, https://substackcdn.com/image/fetch/$s_!zB3W!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79b9e791-3d4c-41be-af7b-6a66a32dde32_1672x941.png 848w, https://substackcdn.com/image/fetch/$s_!zB3W!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79b9e791-3d4c-41be-af7b-6a66a32dde32_1672x941.png 1272w, https://substackcdn.com/image/fetch/$s_!zB3W!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79b9e791-3d4c-41be-af7b-6a66a32dde32_1672x941.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Trend following sounds simple: find the direction of the market and follow it. In practice, though, the hard part is knowing when a trend is likely to continue after a pullback, and when it may be losing strength.</p><p><em>This is where divergences can help.</em></p><p>A divergence happens when price and an indicator tell different stories. Price may be moving one way, while&#8230;</p>
      <p>
          <a href="https://abouttrading.substack.com/p/trend-following-secrets-part-i-hidden">
              Read more
          </a>
      </p>
   ]]></content:encoded></item><item><title><![CDATA[Indicators, Expert Advisors, and Chaos - How to Detect Real Opportunities?]]></title><description><![CDATA[A Rundown of my Free Indicators Published on Metatrader5 Because I'm Sick of TradingView]]></description><link>https://abouttrading.substack.com/p/indicators-expert-advisors-and-chaos</link><guid isPermaLink="false">https://abouttrading.substack.com/p/indicators-expert-advisors-and-chaos</guid><dc:creator><![CDATA[Sofien Kaabar, CFA]]></dc:creator><pubDate>Mon, 15 Jun 2026 20:01:59 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!xxUQ!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F15d13bef-92ee-47fa-83b3-cdd7fc02132f_1672x941.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!xxUQ!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F15d13bef-92ee-47fa-83b3-cdd7fc02132f_1672x941.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!xxUQ!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F15d13bef-92ee-47fa-83b3-cdd7fc02132f_1672x941.png 424w, https://substackcdn.com/image/fetch/$s_!xxUQ!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F15d13bef-92ee-47fa-83b3-cdd7fc02132f_1672x941.png 848w, https://substackcdn.com/image/fetch/$s_!xxUQ!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F15d13bef-92ee-47fa-83b3-cdd7fc02132f_1672x941.png 1272w, https://substackcdn.com/image/fetch/$s_!xxUQ!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F15d13bef-92ee-47fa-83b3-cdd7fc02132f_1672x941.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!xxUQ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F15d13bef-92ee-47fa-83b3-cdd7fc02132f_1672x941.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/15d13bef-92ee-47fa-83b3-cdd7fc02132f_1672x941.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1505052,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://abouttrading.substack.com/i/201443715?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F15d13bef-92ee-47fa-83b3-cdd7fc02132f_1672x941.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!xxUQ!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F15d13bef-92ee-47fa-83b3-cdd7fc02132f_1672x941.png 424w, https://substackcdn.com/image/fetch/$s_!xxUQ!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F15d13bef-92ee-47fa-83b3-cdd7fc02132f_1672x941.png 848w, https://substackcdn.com/image/fetch/$s_!xxUQ!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F15d13bef-92ee-47fa-83b3-cdd7fc02132f_1672x941.png 1272w, https://substackcdn.com/image/fetch/$s_!xxUQ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F15d13bef-92ee-47fa-83b3-cdd7fc02132f_1672x941.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>MetaTrader 5 is full of possibilities. That is exactly what makes it dangerous.</p><p>A good indicator can help you read the market more clearly. A good Expert Advisor can help you execute a defined strategy with discipline. But neither of them can remove uncertainty from trading. And when someone tells you otherwise, that is usually the first warning sign.</p><p>The trading world is packed with beautiful screenshots, perfect backtests, aggressive marketing, and promises that sound almost too clean:</p><p><em><strong>&#8220;99% win rate.&#8221;<br>&#8220;Fully automated income.&#8221;<br>&#8220;No experience needed.&#8221;<br>&#8220;Works on every pair, every timeframe.&#8221;<br>&#8220;Never miss a signal again.&#8221;</strong></em></p><p>This is not how real markets work.</p><p>Markets are noisy. They change. They punish overconfidence. They behave differently during news, low liquidity, trend exhaustion, sudden volatility, and long periods of chop. Any tool that pretends to solve all of that with one magic setting deserves serious suspicion.</p><div><hr></div><h2>The Problem With &#8220;Perfect&#8221; Indicators and EAs</h2><p>Most bad trading tools are not obviously bad at first glance. In fact, many of them look impressive.</p><p>They show clean arrows at the exact top and bottom. They show backtests with smooth equity curves. They show users turning small accounts into huge ones in a few weeks. Some even come with Telegram groups full of &#8220;proof.&#8221;</p><p>But here is the problem: <em><strong>a screenshot is not a strategy.</strong></em></p><p>Many indicators repaint, meaning they change past signals after the market has already moved. Some EAs are over-optimized for one specific historical period, so they look amazing in a backtest but fail in live conditions. Others use dangerous risk models, such as martingale or grid systems, where small profits hide the risk of one catastrophic loss.</p><p>The tool may work for a while. That does not mean it is robust.</p><p>99.99% of expert advisors on MT5 look like this:</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!IkNt!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff153ec04-d1dd-4799-830b-51bbdfa7cc20_1598x762.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!IkNt!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff153ec04-d1dd-4799-830b-51bbdfa7cc20_1598x762.png 424w, https://substackcdn.com/image/fetch/$s_!IkNt!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff153ec04-d1dd-4799-830b-51bbdfa7cc20_1598x762.png 848w, https://substackcdn.com/image/fetch/$s_!IkNt!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff153ec04-d1dd-4799-830b-51bbdfa7cc20_1598x762.png 1272w, https://substackcdn.com/image/fetch/$s_!IkNt!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff153ec04-d1dd-4799-830b-51bbdfa7cc20_1598x762.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!IkNt!,w_2400,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff153ec04-d1dd-4799-830b-51bbdfa7cc20_1598x762.png" width="1200" height="571.978021978022" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/f153ec04-d1dd-4799-830b-51bbdfa7cc20_1598x762.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:false,&quot;imageSize&quot;:&quot;large&quot;,&quot;height&quot;:694,&quot;width&quot;:1456,&quot;resizeWidth&quot;:1200,&quot;bytes&quot;:382129,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://abouttrading.substack.com/i/201443715?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff153ec04-d1dd-4799-830b-51bbdfa7cc20_1598x762.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:&quot;center&quot;,&quot;offset&quot;:false}" class="sizing-large" alt="" srcset="https://substackcdn.com/image/fetch/$s_!IkNt!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff153ec04-d1dd-4799-830b-51bbdfa7cc20_1598x762.png 424w, https://substackcdn.com/image/fetch/$s_!IkNt!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff153ec04-d1dd-4799-830b-51bbdfa7cc20_1598x762.png 848w, https://substackcdn.com/image/fetch/$s_!IkNt!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff153ec04-d1dd-4799-830b-51bbdfa7cc20_1598x762.png 1272w, https://substackcdn.com/image/fetch/$s_!IkNt!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff153ec04-d1dd-4799-830b-51bbdfa7cc20_1598x762.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>So, you know that you have a 99.99% chance of losing all your money. This EA which is rated 4.85/5.00 by the way is promising to turn your $10,000 into more than $5,000,000 in one year with a maximum drawdown of 7%. This doesn&#8217;t even exist by pure random chance and planetary alignment.</p><p>Oh, and the reviews? They&#8217;re fabricated, friends, family, paid buyers, you name it. Here&#8217;s the simplest way to know if one of those to the moon equity curves is real or not:</p><p>Ask yourself this, why would someone share that type of strategy? If I had that, I&#8217;d go straight to Renaissance Capital, pitch them this, get 1 Billion dollar, and live off my Yacht. Instead, you see shady profiles, weird promises, bizarre descriptions, and many comments saying that they lost their money. The pattern couldn&#8217;t be clearer.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!yViW!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb93b85a3-d919-46a8-ad9f-52459ef80981_908x648.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!yViW!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb93b85a3-d919-46a8-ad9f-52459ef80981_908x648.png 424w, https://substackcdn.com/image/fetch/$s_!yViW!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb93b85a3-d919-46a8-ad9f-52459ef80981_908x648.png 848w, https://substackcdn.com/image/fetch/$s_!yViW!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb93b85a3-d919-46a8-ad9f-52459ef80981_908x648.png 1272w, https://substackcdn.com/image/fetch/$s_!yViW!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb93b85a3-d919-46a8-ad9f-52459ef80981_908x648.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!yViW!,w_2400,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb93b85a3-d919-46a8-ad9f-52459ef80981_908x648.png" width="1200" height="856.3876651982379" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b93b85a3-d919-46a8-ad9f-52459ef80981_908x648.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:false,&quot;imageSize&quot;:&quot;large&quot;,&quot;height&quot;:648,&quot;width&quot;:908,&quot;resizeWidth&quot;:1200,&quot;bytes&quot;:443416,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://abouttrading.substack.com/i/201443715?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb93b85a3-d919-46a8-ad9f-52459ef80981_908x648.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:&quot;center&quot;,&quot;offset&quot;:false}" class="sizing-large" alt="" srcset="https://substackcdn.com/image/fetch/$s_!yViW!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb93b85a3-d919-46a8-ad9f-52459ef80981_908x648.png 424w, https://substackcdn.com/image/fetch/$s_!yViW!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb93b85a3-d919-46a8-ad9f-52459ef80981_908x648.png 848w, https://substackcdn.com/image/fetch/$s_!yViW!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb93b85a3-d919-46a8-ad9f-52459ef80981_908x648.png 1272w, https://substackcdn.com/image/fetch/$s_!yViW!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb93b85a3-d919-46a8-ad9f-52459ef80981_908x648.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>This one is promising a Sharpe ratio of 28 and a profit factor of 10 on a hit ratio of 89%. Sign me up!</p><div><hr></div><h2>Due Diligence Before Trusting Any MT5 Tool</h2><p>Before using any indicator or Expert Advisor on a real account, slow down.</p><p>Start with the basic question: <em><strong>what is this tool actually measuring?</strong></em></p><p>Is it detecting momentum, volatility, trend direction, liquidity zones, reversals, or market structure? Or is it just giving signals without explanation?</p><p>A serious tool should have logic behind it. You do not need to know every line of code, but you should understand the market idea behind the signal.</p><p>Then test it properly.</p><p>Do not rely on marketing examples. Use your own charts. Check different instruments, different timeframes, and different market conditions. Look at trending markets, ranging markets, high-impact news days, and ugly sideways periods.</p><p>For Expert Advisors, backtesting is only the beginning. A backtest should include realistic spread, commission, slippage, and enough historical data. Then comes forward testing on a demo account. Only after that should live testing begin, and even then with small size.</p><p>Also look for what the seller does not show.</p><p><em><strong>Do they show losing periods?<br>Do they explain risk?<br>Do they warn about bad market conditions?<br>Do they provide real live results, not just selected screenshots?<br>Do they tell you when not to trade?</strong></em></p><p>That last point matters. A tool that only says &#8220;buy&#8221; and &#8220;sell&#8221; is incomplete. Real opportunity detection is not only about finding entries. It is also about filtering out bad trades.</p><div class="pullquote"><p><strong>&#128680; Check out my new Metatrader5 marketplace&#128680;</strong></p><p style="text-align: center;"><strong>More than 80% of my best indicators are Free to use on the platform. Give them a try!</strong></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.mql5.com/en/users/quant-atlas/seller#!category=2&quot;,&quot;text&quot;:&quot;MT5 Indicators&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="https://www.mql5.com/en/users/quant-atlas/seller#!category=2"><span>MT5 Indicators</span></a></p></div><h2>Real Opportunities Are Usually Not Loud</h2><p>A real trading opportunity is not always the trade with the brightest arrow or strongest promise.</p><p>A real opportunity appears when several conditions line up: market structure, timing, volatility, risk-to-reward, and context. The best tools help you see those conditions more clearly. They do not replace judgment.</p><ul><li><p><em>Good indicators should reduce noise, not create dependency.</em></p></li><li><p><em>Good EAs should execute a defined process, not gamble.</em></p></li><li><p><em>And good traders should always ask: &#8220;What is the risk if this signal is wrong?&#8221;</em></p></li></ul><p>Because every signal can be wrong.</p><h2>Where My FREE Indicators Fit In</h2><p>My indicators are built with that philosophy in mind.</p><p>They are not designed to promise easy money, automatic profits, or perfect entries. They are designed to help traders read the market with more structure and less emotional noise.</p><p>The goal is simple: highlight conditions that may deserve attention, while still leaving the final decision in the hands of the trader.</p><p>Depending on the tool, my indicators can help identify areas such as trend direction, momentum shifts, potential reversal zones, volatility changes, or trade filtering conditions. They are meant to support analysis, not replace it.</p><p>I believe a trading tool should be transparent, practical, and honest about its limits. No indicator can predict the future. No EA can remove risk. But the right tool can help you avoid random decisions and focus on higher-quality setups.</p><p>That is where real value begins.</p><p>This is to say that some EAs are properly created and tuned for stability and risk management. A proper equity curve can look like this:</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!tOJ3!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4fa9b05-36a0-497f-b34d-097383c9ca6a_1868x482.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!tOJ3!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4fa9b05-36a0-497f-b34d-097383c9ca6a_1868x482.png 424w, https://substackcdn.com/image/fetch/$s_!tOJ3!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4fa9b05-36a0-497f-b34d-097383c9ca6a_1868x482.png 848w, https://substackcdn.com/image/fetch/$s_!tOJ3!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4fa9b05-36a0-497f-b34d-097383c9ca6a_1868x482.png 1272w, https://substackcdn.com/image/fetch/$s_!tOJ3!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4fa9b05-36a0-497f-b34d-097383c9ca6a_1868x482.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!tOJ3!,w_2400,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4fa9b05-36a0-497f-b34d-097383c9ca6a_1868x482.png" width="1200" height="309.8901098901099" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/e4fa9b05-36a0-497f-b34d-097383c9ca6a_1868x482.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:false,&quot;imageSize&quot;:&quot;large&quot;,&quot;height&quot;:376,&quot;width&quot;:1456,&quot;resizeWidth&quot;:1200,&quot;bytes&quot;:276120,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://abouttrading.substack.com/i/201443715?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4fa9b05-36a0-497f-b34d-097383c9ca6a_1868x482.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:&quot;center&quot;,&quot;offset&quot;:false}" class="sizing-large" alt="" srcset="https://substackcdn.com/image/fetch/$s_!tOJ3!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4fa9b05-36a0-497f-b34d-097383c9ca6a_1868x482.png 424w, https://substackcdn.com/image/fetch/$s_!tOJ3!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4fa9b05-36a0-497f-b34d-097383c9ca6a_1868x482.png 848w, https://substackcdn.com/image/fetch/$s_!tOJ3!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4fa9b05-36a0-497f-b34d-097383c9ca6a_1868x482.png 1272w, https://substackcdn.com/image/fetch/$s_!tOJ3!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4fa9b05-36a0-497f-b34d-097383c9ca6a_1868x482.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>It&#8217;s not perfect nor magical, but it&#8217;s based on real, stable, stress-tested market events. Sometimes, market regimes change, sometimes volatility regimes switch, and the strategy must adapt. This is why most strategies can have periods of underperformance (unlike the rocket launch showed in almost every EA on the MT5 marketplace).</p><p><em><strong>This was frustrating for me because I saw many comments of people saying they lost money. People who once trusted the system and believed the fake results.</strong></em></p><div><hr></div><h2>Final Thought</h2><p>MT5 is powerful, but power attracts both innovation and scams.</p><p>Before trusting any indicator or Expert Advisor, test it. Question it. Try to break it. Understand when it works and when it does not. Be especially careful with anything that looks too smooth, too easy, or too certain.</p><p>In trading, the most dangerous products are often the ones that make chaos look predictable.</p><p>Real opportunities exist, but they rarely come from blind trust.</p><p>They come from preparation, patience, testing, and tools that respect the reality of the market.</p>]]></content:encoded></item></channel></rss>