Commit Graph
13189 Commits
Author SHA1 Message Date
John Colvin 97c82c4869 feat: Add [incremental] MongoCollectionStream 2024-05-25 15:09:42 -04:00
John Colvin 250d9fb7cb refactor: Impl IDictionary<int, IBlueRow> in BlueTable 2024-05-25 14:30:43 -04:00
John Colvin 150075e34a Normalize indentation in MongoDBStream 2024-05-25 14:30:43 -04:00
John Colvin 6771fcd219 Add echoDelay param to SimpleTCPServer 2024-05-25 14:30:43 -04:00
John Colvin e721a94d72 Add IObservable ViewStream wrapper 2024-05-25 14:30:42 -04:00
John Colvin faaa0ba8f1 refactor: Rename WebsocketServerConfig proto pkg 'bts.websocket_core'
This matches the namespace used in spark_websocket csproj. Eventually,
I'd like to use conventional capitalization (TitleCase namespaces/types,
etc.), but let's shelf that until we have enough time/energy to do a
more comprehensive refactoring.
2024-03-13 13:43:35 -05:00
John Colvin be97879db0 Add json facilities for DataStream websocket api 2024-03-13 13:43:34 -05:00
John Colvin b54d839aaf refactor: Add handy WebsocketExtensions
* IsSocketStateOpen
* IsClosedProperly
2024-03-13 13:43:34 -05:00
John Colvin 3af79a239a feat: Add Bts.DataStream.Websocket/Server 2024-03-13 13:43:34 -05:00
John Colvin d6d5e1d292 Add bones for Bts.DataStreamWebApp.Client 2024-03-13 13:43:33 -05:00
John Colvin e92e5d5039 Add bones for Bts.DataStreamWebApp.Server 2024-03-13 13:43:33 -05:00
John Colvin c47226f965 feat: Add JsonRpc types for websocket paradigm 2024-03-13 13:43:33 -05:00
John Colvin f19f2c7a81 cleanup: Remove empty file (clearly added by accident) 2024-03-13 13:43:33 -05:00
John Colvin b92fac9e55 Add more descriptive logs (via stdout) during initialization
The C++ configure/initialize routines were particularly opaque
2024-03-13 13:43:33 -05:00
John Colvin a1fe672271 fix: Fix improper 'OfType' linq cast
Previously, animations were expressed through polymorphism (derived from the
base class CellAnimation), but the new impl uses composition. This 'OfType' call
was leftover from the polymorphism implementation, an attempt to linq cast
elements of base class (CellAnimation) to BackgroundAnimation.
2024-03-13 13:43:33 -05:00
John Colvin 99d01fd25d cleanup: Remove static service Locator class
It relied on a static singleton 'ServiceContext'. Replace references with a
properly scoped (i.e., non-static) ServiceContext
2024-03-13 13:43:32 -05:00
John Colvin ae1a420d5f refactor: Reduce code (simplify) in BTS.init
Remove the 'args' parameter, since the cmd line can be obtained from
Environment.GetCommandLine anyways
2024-03-13 13:43:32 -05:00
John Colvin a162640b5e Dispose connections in SimpleTCPServer.Dispose 2024-03-13 13:43:32 -05:00
John Colvin 61db677c2a improvement: Polish clis in DataStreamSuite
Namely, PubSubServer and DataStreamPublisher

* Use CommandLineParser (nuget pkg)
* Clean up csproj files a bit while we're at it
2024-03-13 13:43:32 -05:00
John Colvin c1ebb1f7c5 editorconfig: Use standard c# capitalization rules
* Use 'PascalCase' for public members (instead of 'snake_case')
* Use 'camelCase' for private members (instead of '_snake_case')
2024-03-13 13:43:32 -05:00
John Colvin 96cb88505d refactor: Change WebsocketServerConfig.port to uint32
It should always be a number between 1-65535
2024-03-13 13:43:32 -05:00
John Colvin ed31ea8c67 refactor: Add WebsocketClient class
Basically an ISubject (I/O) wrapper for IWebsocketConnectionGateway
2024-03-13 13:43:31 -05:00
John Colvin 82e9939343 refactor: Remove nullability constraint in GetValueOrDefault 2024-03-13 13:43:31 -05:00
John Colvin 8021cb49cc refactor: Use events to avoid circular deps for ws sync/gateway 2024-03-13 13:43:31 -05:00
John Colvin a7eb58311d refactor: Let caller specify nullability of T in json parse fn 2024-03-13 13:43:31 -05:00
John Colvin 45ea54bdde refactor: Reorganize NumericComparer, support all types
Get rid of redundant UniversalNumericComparer while we're at it
2024-03-13 13:43:31 -05:00
John Colvin 0266d09e20 docker: Update and clean up Dockerfile
* Upgrade dotnet 7 -> 8
* Upgrade clang (13, 15) -> 17
* Upgrade gcc (11, 12) -> 13
* Remove kitware release candidate apt repo (probably shouldn't have
  been added in the first place).
* Install gdb for c++ debugging (VS Code debugger depends on this)
* Use explicit release ubuntu:22.04 (not 'latest'). We don't want the
  distro to automatically upgrade one day, when 'latest' suddenly points
  to a new release. Upgrades like that need to be done deliberately.
* Use more granular RUN cmds to reduce rebuild times.

  When a Dockerfile is built, the RUN cmds are executed in the order
  in which they were written (duh!). Checkpoints called "cache layers"
  are saved for each RUN cmd, so if the Dockerfile is later modified,
  the image can be rebuilt from the most recent layer that wasn't
  invalidated by the modifications.
2024-03-13 13:43:31 -05:00
John Colvin b6fa2bd1c2 cleanup: Remove leftover legacy files 2024-03-13 13:43:30 -05:00
John Colvin d43fd5bce7 build: Upgrade c# to net8.0 2024-03-13 13:43:30 -05:00
John Colvin 60df5b2a68 refactor: Move OrderDataHelper to spark_api.csproj
So it can be called from the websocket api server to parse
CustomOrderDefinitions
2024-03-13 12:45:17 -05:00
Taha Afzal bada5dc961 Fixing SimExecution for CME 2024-03-06 14:11:02 -05:00
Taha Afzal 4510e120ab enabling some streams like max, that were dependent on AddCOlumns (thta John fixed in the last commit) 2024-02-12 13:21:28 -05:00
Taha Afzal da2af06ee6 Merging 2024-02-08 15:48:51 -05:00
John Colvin 9212c6d097 Line ending changes in yacc/lex generated code
I recently upgrade the YaccLexTools nuget to 1.2.2, perhaps these new
line endings are related to that.
2024-02-08 14:28:36 -06:00
John Colvin 8660dea85a build: Downgrade new DataStream code from net8 -> net7
The AddColumnsStream, SortStream, and requisite yacc/lex grammar were
originally added to a new branch, off of development, which is on net8.
I forgot to change it to net7 when I cherry-picked the commits for the
regular development branch.

It's wasn't quite as simple as flipping net8 -> net7 in csproj files,
because I was eager to use new language features only available in net8!
Namely, primary constructors and collection expressions.
2024-02-08 14:24:31 -06:00
Taha Afzal 8c1342230b RowDiff added 2024-02-08 14:11:10 -05:00
John Colvin d0ddc1d57b Resurrect SortStream
Add ColumnSortExpressions grammar (lex/yacc)
2024-02-08 10:04:53 -06:00
John Colvin fe1e953030 Resurrect AddColumnStream
Add ColumnExpressions grammar (lex/yacc)
2024-02-08 10:04:53 -06:00
John Colvin dab17af5a9 build: Upgrade YaccLexTools to 1.2.2 2024-02-08 00:51:16 -06:00
Taha Afzal 8dd2775092 Added volatility to trade bars 2024-02-04 23:22:52 -05:00
John Colvin 7fb7b1e4af Fix PriceStatsStream
* Store subscription IDisposable in class (we need to control the life of the subscription)
* Flip typo '_dirty = false' -> '_dirty = true'
2024-02-04 22:14:00 -06:00
Taha Afzal 8966b73ac9 Merge branch 'development' of bitbucket.org:bluetradesys/spark into development 2024-02-04 18:04:06 -05:00
Taha Afzal ddb2a91763 Adding TradBar stream 2024-02-04 18:03:51 -05:00
John Colvin bc5bcbf11e fix: Bootstrap MarketDataClient.price_ticker/stats w/ init state
Bugs (fixed):
  * MarketDataClient.price_ticker, and price_stats streams don't fire update
    with initial state (they only tick as subsequent changes are observed)
2024-02-04 15:33:20 -06:00
Taha Afzal 287ee291cc Adding a stream that send a TCP packet to the echo server and monitors the n_sends and n_recvs 2024-01-25 13:37:41 -05:00
Taha Afzal 2bceda01ae Added code in BlueDataUtility to create schema from data 2024-01-22 16:28:23 -05:00
John Colvin c39a270115 fix: Support all exchs in QueryServer::get_names 2024-01-17 11:15:01 -05:00
Taha Afzal 6e3f9f99c0 Merge branch 'development' of bitbucket.org:bluetradesys/spark into development 2024-01-17 10:08:17 -05:00
John Colvin b53d9d7d4c refactor: Remove 'Platform' (md source) config
Good riddance. Improper 'PlatformMap' config was often the reason market
data mysteriously wouldn't show up in the client. Especially with new
exchanges. We should keep all md source/connection configuration in one
place (one proto message), to avoid any confusion.
2024-01-17 01:42:57 -05:00
Taha Afzal cc3e289345 KeyValueToRelationalStream added 2024-01-16 19:08:40 -05:00