Commit Graph
12209 Commits
Author SHA1 Message Date
John Colvin f03b571f05 Generate a few row types with new t4 templates 2024-11-26 18:53:32 +00:00
John Colvin 07aa53dffa fix SQLiteEnumerator 2024-11-26 18:53:32 +00:00
John Colvin 68b42bdb01 Add async SQLiteEnumerator to read sqlite tables as IBlueRowCollection 2024-11-26 18:53:32 +00:00
John Colvin 2d7e6b1ec2 build: Generate c# code for RowTypes
Produces structs that implement IBlueRow with strongly typed
properties for each column.
2024-11-26 18:53:32 +00:00
John Colvin db0df50b53 Add some nifty DataPacket/TableUpdate IObservable utils 2024-11-26 18:53:32 +00:00
John Colvin bb6662a2c1 fix: Remove query from literal error stream
The parser can't handle colons in the expression (it throws/crashes)
2024-11-26 18:53:32 +00:00
John Colvin e1f98a3209 Tweak new streams database config 2024-11-26 18:53:32 +00:00
John Colvin 1f3b2c5cab fix build: Disable some includes on windows 2024-11-26 18:53:32 +00:00
John Colvin cd1f4631dd build: Move lib_spark tests into separate exe
So we don't have to run them through sparkd
2024-11-26 18:53:32 +00:00
John Colvin 4a1a7308dd refactor: Move catch_test_runner from spark (lib) to sparkd (app)
This source file provides the entry point for catch2
2024-11-26 18:53:32 +00:00
John Colvin 7da668c136 Add gen purpose blue row/table utils for data streams
* Add BlueRowReflection<T> so ViewStream implementations can use
  strong row types without needing to implement IBlueRow
* Add default implementations for IDictionary members in IBlueRow to make
  implementing IBlueRow less tedious
2024-11-26 18:53:32 +00:00
John Colvin 304e669de2 Extend dsl to support explicit param names 2024-11-26 18:53:32 +00:00
John Colvin 9d86c85686 Remove erroneous "DSL: " prefix in ai prompt stream
This causes parse errors since we extended the dsl syntax to support named
params in the form of "name: arg".
2024-11-26 18:53:32 +00:00
John Colvin 410680cadf Configure directory browser endpt for vite dev server 2024-11-26 18:53:32 +00:00
John Colvin 64bd5eef4f Load IDataStremFactory impls with dependency injection
So we can create ViewStreams that depend on other services, config, etc.
Previously, the PrimitiveManager relied purely on static construction of types
through reflection.
2024-11-26 18:53:32 +00:00
John Colvin 3619d4b22c refactor: Use generic collections in PrimitiveManager
The class that instantiates ViewStreams via reflection
2024-11-26 18:53:32 +00:00
John Colvin baa9dbfe76 Fix typo in NLStream's namespace 2024-11-26 18:53:32 +00:00
John Colvin 11241b9b37 Fix LiteralStream syntax in md publisher appsettings.json 2024-11-26 18:53:32 +00:00
John Colvin eb3fad64b0 fix build: Upgrade Newtonsoft.Json 13.0.2 -> 13.0.3 in spark_websocket
The DataStreamSuite.sln build was broken because other projects in the sln were
already using the newer version (can't mix and match).
2024-11-26 18:53:32 +00:00
John Colvin bdfb00aa22 Add c# Variant class, modeled after std::variant in c++ 2024-11-26 18:53:32 +00:00
John Colvin 50611fe4a3 Add generic ViewStream, BlueRow types/interfaces 2024-11-26 18:53:32 +00:00
John Colvin 73d670c0dc fix: Add null check 2024-11-26 18:53:32 +00:00
John Colvin 551430e256 fix: Update source paths for api server docker 2024-11-26 18:53:32 +00:00
John Colvin c57312fb4d feat: Add stream subscriptions to websocket api 2024-11-26 18:53:32 +00:00
John Colvin 418201de6b fix build: Update proto path in csproj file 2024-11-26 18:53:32 +00:00
John Colvin 5e1a83db8d fix build: Install actual dir instead of symlink 2024-11-26 18:53:32 +00:00
John Colvin e0ad6f72c0 fix build (c#): Update source file paths, namespaces, etc.
The c# builds have been broken ever since we reorganized the c++ projects with
stuttering dirs.
2024-11-26 18:53:32 +00:00
John Colvin 8a22d7e318 fix: Load logging config at runtime
Don't use hardcoded default
2024-11-26 18:53:29 +00:00
John Colvin 856ba177aa refactor: Replace BoolName w/ FormattedBool 2024-11-26 18:40:34 +00:00
John Colvin 54819d7d9b Init hb timestamp to avoid false drops
Mainly when debugging.
2024-11-26 18:40:34 +00:00
John Colvin aaf9229f7e fix: Run heartbeat timer in MarketDataGateway
This is why we were getting those heartbeat asserts. Previously,
only ExchangeSimApplication would start this timer. Since
MarketDataGateway doesn't share its MDProducer with
ExchangeSimApplication, it must start one itself.
2024-11-26 18:40:34 +00:00
John Colvin 009a00c041 Make utils::TimeStamp formattable for logs, etc. 2024-11-26 18:40:34 +00:00
John Colvin 104742c9c0 fix build: Link Onixs dep libACE with --no-as-needed
libACE is an Onixs dep that isn't called directly by our code. For some
reason, gcc builds fail to resolve this dep at runtime unless this flag
is used. This isn't a problem with clang builds.
2024-11-26 18:40:34 +00:00
John Colvin e68f6d5eb1 fix build: Remove unused refs
Sparkd release builds were failing with warnings-as-errors about unused refs
2024-11-26 18:40:34 +00:00
John Colvin 6bc397b497 Fix eslint config and use modern flat style
https://eslint.org/docs/latest/use/configure/configuration-files#configuration-file
2024-11-26 18:40:34 +00:00
John Colvin 343af5d8a3 cleanup: Move global var into function scope in vite cfg 2024-11-26 18:40:34 +00:00
John Colvin ff8727b92d Update node pkgs in datastream webapp 2024-11-26 18:40:34 +00:00
John Colvin 842740ceb3 Put cme config url in GlbxMarketDataConfig proto
Instead of using magic strings
2024-11-26 18:40:27 +00:00
John Colvin 79894864a0 refactor: Change raw IDGenerator ptr to shared_ptr 2024-11-26 18:19:43 +00:00
John Colvin f3021651eb fix: Actually use include/exclude params in SymbolLoader 2024-11-26 18:08:44 +00:00
John Colvin 459b808f4a fix build: Remove unnecessary link lib ssl 2024-11-26 17:31:45 +00:00
John Colvin 49497c9be5 refactor: Replace ConfigDownloader w/ lib_http fns
Essentially all it did was fetch config files via http GET. I ported some http
fns over from the cme-websocket-connector repo, which uses curlpp instead of
curl, and also supports async requests (coroutines) via the 'concurrencpp'

https://github.com/David-Haim/concurrencpp
2024-11-26 16:45:22 +00:00
John Colvin 585524a8b2 cleanup: Get rid of another Security type aliases 2024-11-26 16:45:20 +00:00
John Colvin c46771e8b6 cleanup: Remove unused code in Security.h/cpp 2024-11-26 16:38:29 +00:00
John Colvin 244fc647fb Fix typo in 'Quantity' FMT_IMPL
I didn't realize the "value()" function rounded out the decimal,
so I replaced it with a call to "full_value()".
2024-11-26 16:35:35 +00:00
John Colvin 57d7b4ba50 diag: Log when an MDProducer is created 2024-11-26 16:35:30 +00:00
John Colvin 97e4276e20 diag: Add logs around synthetic security discovery in MDConsumer 2024-11-26 16:32:09 +00:00
John Colvin d947882b0e refactor: Break shared mem md code up into smaller files
For easier reading/navigation
2024-11-26 16:32:09 +00:00
John Colvin 61479c1198 refactor: Break md relay/query server code up into smaller files
To make code navigation easier. This was a difficulty which I recently
confronted, while investigating a bug that prevented synthetics from
showing up the ui.
2024-11-26 16:32:09 +00:00
John Colvin 1871358bde refactor: Get rid of 'TimeStamp' typedef in MDStructure.h
Before this commit, we had 4 different TimeStamp types/identifiers, which is
confusing enough as it is:

* bts::core::TimeStamp
  - in system/time_stamp.h
* bts::utils::TimeStamp
  - in spark/utils/TimeStamp.h
* bts::TimeStamp
  - in system/bts_chrono.h
  - alias for std::chrono::system_clock::time_point
* bts::md::TimeStamp
  - in spark/md/Shm/MDStructure.h
  - alias for bts::utils::TimeStamp
  - removed in this commit

Additional aliases for these TimeStamps only adds to the confusion (esp
when the alias comes from a nested include).
2024-11-26 16:32:09 +00:00