Files
externals/linux/doc/Onixs.CME.4.8.0/html/LowLatencyBestPractices_8md_source.html

82 lines
17 KiB
HTML

<!-- HTML header for doxygen 1.8.11-->
<!DOCTYPE html>
<html>
<head>
<meta http-equiv="Content-Type" content="text/xhtml;charset=UTF-8"/>
<meta http-equiv="X-UA-Compatible" content="IE=9"/>
<meta name="generator" content="Doxygen 1.8.11"/>
<title>OnixS C++ CME Market Data Handler: Pages/LowLatencyBestPractices.md Source File</title>
<link href="tabs.css" rel="stylesheet" type="text/css"/>
<script type="text/javascript" src="jquery.js"></script>
<script type="text/javascript" src="dynsections.js"></script>
<link href="doxygen.css" rel="stylesheet" type="text/css" />
<link href="onixs-doxygen.css" rel="stylesheet" type="text/css"/>
<script type="text/javascript">
$(window).scroll(function() {
if ($(this).scrollTop() > 1)
{
$('header').addClass("sticky");
}
else
{
$('header').removeClass("sticky");
}
});
</script>
</head>
<body>
<header>
<div id="titlearea">
<table cellspacing="0" cellpadding="0">
<tbody>
<tr style="height: 56px;">
<td id="projectlogo"><a href="http://www.onixs.biz"><img alt="Logo" src="onixs.svg"/></a></td>
<td style="padding-left: 0.5em;">
<div id="projectname">OnixS C++ CME Market Data Handler
&#160;<span id="projectnumber">4.8.0.10</span>
</div>
<div id="projectbrief">API documentation</div>
</td>
</tr>
</tbody>
</table>
</div>
</header>
<div id="wrapper">
<div id="top"><!-- do not remove this div, it is closed by doxygen! -->
<!-- end header part -->
<!-- Generated by Doxygen 1.8.11 -->
<div id="navrow1" class="tabs">
<ul class="tablist">
<li><a href="index.html"><span>Home</span></a></li>
<li><a href="modules.html"><span>Contents</span></a></li>
<li><a href="namespaces.html"><span>Namespaces</span></a></li>
<li><a href="annotated.html"><span>Classes</span></a></li>
<li class="current"><a href="files.html"><span>Files</span></a></li>
</ul>
</div>
<div id="navrow2" class="tabs2">
<ul class="tablist">
<li><a href="files.html"><span>File&#160;List</span></a></li>
<li><a href="globals.html"><span>File&#160;Members</span></a></li>
</ul>
</div>
</div><!-- top -->
<div class="header">
<div class="headertitle">
<div class="title">Pages/LowLatencyBestPractices.md</div> </div>
</div><!--header-->
<div class="contents">
<a href="LowLatencyBestPractices_8md.html">Go to the documentation of this file.</a><div class="fragment"><div class="line"><a name="l00001"></a><span class="lineno"> 1</span>&#160;\addtogroup low-latency-best-practices </div><div class="line"><a name="l00002"></a><span class="lineno"> 2</span>&#160;</div><div class="line"><a name="l00003"></a><span class="lineno"> 3</span>&#160;\brief Uncovers how to configure the Handler to achieve maximal </div><div class="line"><a name="l00004"></a><span class="lineno"> 4</span>&#160;performance characteristics and lowest processing latency.</div><div class="line"><a name="l00005"></a><span class="lineno"> 5</span>&#160;</div><div class="line"><a name="l00006"></a><span class="lineno"> 6</span>&#160;The given topic uncovers how to configure the Handler in order to </div><div class="line"><a name="l00007"></a><span class="lineno"> 7</span>&#160;achieve maximal performance characteristics and lowest processing </div><div class="line"><a name="l00008"></a><span class="lineno"> 8</span>&#160;latency.</div><div class="line"><a name="l00009"></a><span class="lineno"> 9</span>&#160;</div><div class="line"><a name="l00010"></a><span class="lineno"> 10</span>&#160;\section configure-logging-for-low-latency Configuring Logging Subsystem</div><div class="line"><a name="l00011"></a><span class="lineno"> 11</span>&#160;</div><div class="line"><a name="l00012"></a><span class="lineno"> 12</span>&#160;Under normal conditions, the Handler logs important events and market data </div><div class="line"><a name="l00013"></a><span class="lineno"> 13</span>&#160;transmitted by MDP into a log file. As far as logging entries represent </div><div class="line"><a name="l00014"></a><span class="lineno"> 14</span>&#160;textual information, binary data like incoming market data packets are </div><div class="line"><a name="l00015"></a><span class="lineno"> 15</span>&#160;encoded using base64-encoding before stored in a log. That adds extra time </div><div class="line"><a name="l00016"></a><span class="lineno"> 16</span>&#160;to a processing cycle. Finally, if the Logger implementation stores its </div><div class="line"><a name="l00017"></a><span class="lineno"> 17</span>&#160;data into a file, that may be a relatively slow operation.</div><div class="line"><a name="l00018"></a><span class="lineno"> 18</span>&#160;</div><div class="line"><a name="l00019"></a><span class="lineno"> 19</span>&#160;If the users want to eliminate slowdowns caused by flushing data to filesystem </div><div class="line"><a name="l00020"></a><span class="lineno"> 20</span>&#160;and/or extra encoding operations, they can disable logging by binding instance </div><div class="line"><a name="l00021"></a><span class="lineno"> 21</span>&#160;of the OnixS::CME::MDH::NullLogger class to the Handler. In such case </div><div class="line"><a name="l00022"></a><span class="lineno"> 22</span>&#160;log events are not constructed by the Handler, and nothing is logged at </div><div class="line"><a name="l00023"></a><span class="lineno"> 23</span>&#160;all. </div><div class="line"><a name="l00024"></a><span class="lineno"> 24</span>&#160;</div><div class="line"><a name="l00025"></a><span class="lineno"> 25</span>&#160;\section configure-threads-for-low-latency Turning Up Working Threads</div><div class="line"><a name="l00026"></a><span class="lineno"> 26</span>&#160;</div><div class="line"><a name="l00027"></a><span class="lineno"> 27</span>&#160;Market data processing is done asynchronously by using working threads. </div><div class="line"><a name="l00028"></a><span class="lineno"> 28</span>&#160;Under normal conditions, threads are executed on any processor available </div><div class="line"><a name="l00029"></a><span class="lineno"> 29</span>&#160;in the system. That may have negative influence on overall performance </div><div class="line"><a name="l00030"></a><span class="lineno"> 30</span>&#160;due to unnecessary thread context switching. </div><div class="line"><a name="l00031"></a><span class="lineno"> 31</span>&#160;</div><div class="line"><a name="l00032"></a><span class="lineno"> 32</span>&#160;To avoid switching threads between processors, the Feed Engine as a </div><div class="line"><a name="l00033"></a><span class="lineno"> 33</span>&#160;manager of working threads, allows to establish processor affinity for </div><div class="line"><a name="l00034"></a><span class="lineno"> 34</span>&#160;each working thread:</div><div class="line"><a name="l00035"></a><span class="lineno"> 35</span>&#160;</div><div class="line"><a name="l00036"></a><span class="lineno"> 36</span>&#160;~~~{.cpp}</div><div class="line"><a name="l00037"></a><span class="lineno"> 37</span>&#160;</div><div class="line"><a name="l00038"></a><span class="lineno"> 38</span>&#160;FeedEngineSettings feSettings1;</div><div class="line"><a name="l00039"></a><span class="lineno"> 39</span>&#160;FeedEngineSettings feSettings2;</div><div class="line"><a name="l00040"></a><span class="lineno"> 40</span>&#160;</div><div class="line"><a name="l00041"></a><span class="lineno"> 41</span>&#160;// Scheduling Feed Engines to use different processors.</div><div class="line"><a name="l00042"></a><span class="lineno"> 42</span>&#160;</div><div class="line"><a name="l00043"></a><span class="lineno"> 43</span>&#160;feSettings1.threadAffinity().insert(1);</div><div class="line"><a name="l00044"></a><span class="lineno"> 44</span>&#160;feSettings2.threadAffinity().insert(2);</div><div class="line"><a name="l00045"></a><span class="lineno"> 45</span>&#160;</div><div class="line"><a name="l00046"></a><span class="lineno"> 46</span>&#160;~~~</div><div class="line"><a name="l00047"></a><span class="lineno"> 47</span>&#160;</div><div class="line"><a name="l00048"></a><span class="lineno"> 48</span>&#160;In addition to the ability to manipulate thread affinity for working </div><div class="line"><a name="l00049"></a><span class="lineno"> 49</span>&#160;threads of the Feed Engine, it also provides a set of events triggered </div><div class="line"><a name="l00050"></a><span class="lineno"> 50</span>&#160;by working threads at the beginning of processing and before ending </div><div class="line"><a name="l00051"></a><span class="lineno"> 51</span>&#160;a processing loop. See \ref feed-engine-events for more information.</div><div class="line"><a name="l00052"></a><span class="lineno"> 52</span>&#160;</div><div class="line"><a name="l00053"></a><span class="lineno"> 53</span>&#160;With the help of working threads events, it is possible to perform </div><div class="line"><a name="l00054"></a><span class="lineno"> 54</span>&#160;more advanced thread turning like updating thread priority:</div><div class="line"><a name="l00055"></a><span class="lineno"> 55</span>&#160;</div><div class="line"><a name="l00056"></a><span class="lineno"> 56</span>&#160;~~~{.cpp}</div><div class="line"><a name="l00057"></a><span class="lineno"> 57</span>&#160;</div><div class="line"><a name="l00058"></a><span class="lineno"> 58</span>&#160;using namespace OnixS::CME::MDH;</div><div class="line"><a name="l00059"></a><span class="lineno"> 59</span>&#160;</div><div class="line"><a name="l00060"></a><span class="lineno"> 60</span>&#160;struct ThreadPriorityManager : FeedEngineListener</div><div class="line"><a name="l00061"></a><span class="lineno"> 61</span>&#160;{</div><div class="line"><a name="l00062"></a><span class="lineno"> 62</span>&#160; void onFeedEngineThreadBegin(const FeedEngine&amp;)</div><div class="line"><a name="l00063"></a><span class="lineno"> 63</span>&#160; {</div><div class="line"><a name="l00064"></a><span class="lineno"> 64</span>&#160; SetThreadPriority(</div><div class="line"><a name="l00065"></a><span class="lineno"> 65</span>&#160; GetCurrentThread(),</div><div class="line"><a name="l00066"></a><span class="lineno"> 66</span>&#160; THREAD_PRIORITY_TIME_CRITICAL);</div><div class="line"><a name="l00067"></a><span class="lineno"> 67</span>&#160; }</div><div class="line"><a name="l00068"></a><span class="lineno"> 68</span>&#160;};</div><div class="line"><a name="l00069"></a><span class="lineno"> 69</span>&#160;</div><div class="line"><a name="l00070"></a><span class="lineno"> 70</span>&#160;FeedEngineSettings feSettings;</div><div class="line"><a name="l00071"></a><span class="lineno"> 71</span>&#160;ThreadPriorityManager priorityManager;</div><div class="line"><a name="l00072"></a><span class="lineno"> 72</span>&#160;</div><div class="line"><a name="l00073"></a><span class="lineno"> 73</span>&#160;FeedEngine feedEngine(feSettings, &amp;priorityManager); </div><div class="line"><a name="l00074"></a><span class="lineno"> 74</span>&#160;</div><div class="line"><a name="l00075"></a><span class="lineno"> 75</span>&#160;~~~</div><div class="line"><a name="l00076"></a><span class="lineno"> 76</span>&#160;</div><div class="line"><a name="l00077"></a><span class="lineno"> 77</span>&#160;\section decreasing-data-waiting-time Decreasing Time Handler Spends on Waiting for Incoming Data</div><div class="line"><a name="l00078"></a><span class="lineno"> 78</span>&#160;</div><div class="line"><a name="l00079"></a><span class="lineno"> 79</span>&#160;When the Handler accomplishes processing of the previously </div><div class="line"><a name="l00080"></a><span class="lineno"> 80</span>&#160;received market data, it initiates reception of new incoming </div><div class="line"><a name="l00081"></a><span class="lineno"> 81</span>&#160;data if it is available in the feed. In reality, data packets </div><div class="line"><a name="l00082"></a><span class="lineno"> 82</span>&#160;do not come each after another, but there&#39;s a certain time </div><div class="line"><a name="l00083"></a><span class="lineno"> 83</span>&#160;interval between two neighbor packets. Pauses between incoming </div><div class="line"><a name="l00084"></a><span class="lineno"> 84</span>&#160;packets cause the Feed Engine bound to the Handler to suspend </div><div class="line"><a name="l00085"></a><span class="lineno"> 85</span>&#160;activities and sleep in a kernel while waiting for incoming data. </div><div class="line"><a name="l00086"></a><span class="lineno"> 86</span>&#160;As a result, data and an execution code can be ejected from a </div><div class="line"><a name="l00087"></a><span class="lineno"> 87</span>&#160;processor&#39;s cache. That brings to the fact that the next iteration </div><div class="line"><a name="l00088"></a><span class="lineno"> 88</span>&#160;of processing loop is performed slower compare to the previous </div><div class="line"><a name="l00089"></a><span class="lineno"> 89</span>&#160;one. The Feed Engine provides the </div><div class="line"><a name="l00090"></a><span class="lineno"> 90</span>&#160;OnixS::CME::MDH::FeedEngineSettings::dataWaitTime parameter, which </div><div class="line"><a name="l00091"></a><span class="lineno"> 91</span>&#160;value defines the time the Feed Engine spends in I/O operation while </div><div class="line"><a name="l00092"></a><span class="lineno"> 92</span>&#160;waiting for incoming data. Reducing a value of the noted parameter </div><div class="line"><a name="l00093"></a><span class="lineno"> 93</span>&#160;increases the number of wake-ups, and thus reduces the probability for </div><div class="line"><a name="l00094"></a><span class="lineno"> 94</span>&#160;the Feed Engine to be thrown out of a processor&#39;s cache. If the parameter </div><div class="line"><a name="l00095"></a><span class="lineno"> 95</span>&#160;is set to zero, the Feed Engine just checks for data availability, but </div><div class="line"><a name="l00096"></a><span class="lineno"> 96</span>&#160;does not enter into a kernel for sleep. The drawback of reducing waiting </div><div class="line"><a name="l00097"></a><span class="lineno"> 97</span>&#160;time is an increase of processor consumption (up to 100% in case of zero </div><div class="line"><a name="l00098"></a><span class="lineno"> 98</span>&#160;parameter value).</div><div class="line"><a name="l00099"></a><span class="lineno"> 99</span>&#160;</div><div class="line"><a name="l00100"></a><span class="lineno"> 100</span>&#160;\section suppress-coping-for-low-latency Suppressing Market Data Copying </div><div class="line"><a name="l00101"></a><span class="lineno"> 101</span>&#160;</div><div class="line"><a name="l00102"></a><span class="lineno"> 102</span>&#160;Under normal conditions, the Handler effectively utilizes internal structures </div><div class="line"><a name="l00103"></a><span class="lineno"> 103</span>&#160;used to keep incoming market data. Packets and messages are re-used once the </div><div class="line"><a name="l00104"></a><span class="lineno"> 104</span>&#160;Handler processes the contained data. Therefore, no data is allocated during </div><div class="line"><a name="l00105"></a><span class="lineno"> 105</span>&#160;a real-time market data processing. </div><div class="line"><a name="l00106"></a><span class="lineno"> 106</span>&#160;</div><div class="line"><a name="l00107"></a><span class="lineno"> 107</span>&#160;However, data may be copied within callbacks, which the Handler invokes </div><div class="line"><a name="l00108"></a><span class="lineno"> 108</span>&#160;as listeners for various market data events. Thus, when a book is copied, </div><div class="line"><a name="l00109"></a><span class="lineno"> 109</span>&#160;that assumes memory allocation and thus has a negative effect on performance </div><div class="line"><a name="l00110"></a><span class="lineno"> 110</span>&#160;and latency. Copying should be minimized or strategies with preallocation </div><div class="line"><a name="l00111"></a><span class="lineno"> 111</span>&#160;should be used to improve the results.</div><div class="line"><a name="l00112"></a><span class="lineno"> 112</span>&#160;</div><div class="line"><a name="l00113"></a><span class="lineno"> 113</span>&#160;For example, book snapshots can be constructed of a certain capacity capable </div><div class="line"><a name="l00114"></a><span class="lineno"> 114</span>&#160;of storing a particular number of price levels. Constructing book snapshots with </div><div class="line"><a name="l00115"></a><span class="lineno"> 115</span>&#160;initial capacity, sufficient to hold books of maximal possible depth, eliminates </div><div class="line"><a name="l00116"></a><span class="lineno"> 116</span>&#160;reallocations. </div></div><!-- fragment --></div><!-- contents -->
<!-- HTML footer for doxygen 1.8.11-->
<!-- start footer part -->
<footer>
<hr class="footer"/>
<address class="footer">
<small>&copy; <a href="http://www.onixs.biz">Onix Solutions [On<span class="corporate-orange">i</span>x<span class="corporate-orange">S</span>]</a>. All rights reserved.</small>
</address>
</footer>
</div> <!-- wrapper -->
</body>
</html>