John Colvin
e4745a587f
Fix mismatched types in PubSubServerTagStatsStream schema
2024-11-29 14:57:43 +00:00
John Colvin
adfc0b5235
Add DataStreamPublisher service modules designed for Dependency Injection
...
* Change DataStreamPublisher json fields to match cs class property names verbatim
* Rename Publishers -> PublisherNodes in DataStreamPublisherConfig
2024-11-29 14:57:43 +00:00
John Colvin
30cf7ac5f9
refactor: Decouple ViewPublisher from IPubTableBroker impl
2024-11-29 14:57:43 +00:00
John Colvin
31b065c854
Add PubSub service modules designed for Dependency Injection
...
* Get rid of JsonPropertyName attributes in PubSubConfig
- The Dependency Injection framework (based around dotnet ApplicationBuilder)
does not support this attribute, and maps property names verbatim to json fields.
* Change PubSubServer json fields to match cs class property names verbatim
2024-11-29 14:57:43 +00:00
John Colvin
04a0cf9144
refactor: Decouple RemoteQueryManager from IManagedSubscriber, IPubTableBroker impl
2024-11-29 14:57:43 +00:00
John Colvin
37d6ffa27a
refactor: Decouple ManagedSubscriber from ISubscriberCore impl
2024-11-29 14:57:43 +00:00
John Colvin
2760867093
refactor: Only support 1 tag type in IPubSubServerTagHandler
2024-11-29 14:57:43 +00:00
John Colvin
191de2ae46
refactor: Decouple PubTableBroker from IPublisherCore impl
...
Reference interface rather than the PublisherCore impl.
2024-11-29 14:57:43 +00:00
John Colvin
0b444d5f2f
improvement: Accept CancellationToken in JsonRpcRequestObservable
2024-11-29 14:57:43 +00:00
John Colvin
702eac44d3
fix: Dispose market data sub in various md streams
2024-11-29 14:57:43 +00:00
John Colvin
30b23d36fa
cleanup: Remove unused pubsub tag handler code
...
* Removed 'IPubSubServerTagHandler.register'
- All implementations of this function were empty
* Removed 'IPubSubServerTagHandler.supportedTagTypes'
- This property wasn't referenced anywhere
* Remove IWorker inheritance from IPubSubServerTagHandler
- No reason these interfaces have to be tied together
2024-11-29 14:57:43 +00:00
John Colvin
202a9f6206
refactor: Rename CloudStreamManager.cs -> RemoteQueryManager.cs
...
This matches the file name
2024-11-29 14:57:43 +00:00
John Colvin
0d1966e752
Change pub sub schema prefix 'bluto://' -> 'bts-cloud://'
...
In config json files (not actual code change)
2024-11-29 14:57:43 +00:00
John Colvin
a25905d55d
fix build: Fix prop names after refactoring PubSubRoute
...
* Change 'server_address' -> 'ServerAddress'
* Change 'tag_reg_exp' -> 'TagRegExp'
2024-11-29 14:57:43 +00:00
John Colvin
dddf14e356
build: Add scripts to publish data stream apps
2024-11-29 14:57:42 +00:00
John Colvin
962fd8712a
Fix typo in log msg
2024-11-29 14:57:13 +00:00
John Colvin
7685b1f628
Fix build scripts so they propagate the exit code back to the shell
...
I noticed this was broken because launch.json configurations would still start the debugger
even when the preLaunchTask (build) failed!
2024-11-29 14:57:13 +00:00
John Colvin
ef94ecf6a6
vscode: Add DataStreamPublisher debug cfg to skip build
2024-11-29 14:57:13 +00:00
John Colvin
26f9a76fc8
build: Use separate cmd to build DataStreamSuite/QueryAnalyzer.sln
...
The DataStreamSuite.sln builds the new webapp now, which will
(eventually) replace DSQA. We'll keep it around for now, but with a
clean separation from the main build.
2024-11-29 14:57:13 +00:00
John Colvin
806c204f08
feat: Add DataStream WebApp
...
Included in DataStreamSuite.sln, but not DataStreamQueryAnalyzer.sln
2024-11-29 14:57:13 +00:00
John Colvin
4aa3c67e87
Add spark service modules designed for Dependency Injection
2024-11-29 14:57:13 +00:00
John Colvin
614adac241
build: Copy libspark to all dotnet dirs in single cmake target
...
This is cleaner than the previous impl, which used separate build
targets to copy libspark to "net7.0", and "net7.0-windows" (dirs).
2024-11-29 14:57:13 +00:00
John Colvin
63ece377de
fix: Parse ServerAddress as normal string
...
The "JsonValueOrArrayConverter<T>" doesn't work the way I thought it
would. When it is associated with a property via the JsonConverter
attribute, dotnet json parsing code throws an exception if "T" isn't
assignable to the property type.
2024-11-29 14:57:13 +00:00
John Colvin
e49efc2bbf
fix build (api server): Change namespace to bts.websocket_core
2024-11-29 14:57:13 +00:00
John Colvin
e431c309ed
Remove docker submodules again
2024-11-29 14:57:13 +00:00
John Colvin
3c5769b3da
Change externals url from ssh to https style
...
So we don't need ssh keys to clone it (the builtin credential manager
makes https authentication safe/easy)
2024-11-29 14:57:13 +00:00
John Colvin
efe09eb1b7
cleanup: Fix benign typos in build scripts
...
Change BUILD_SPARK_PY var name to BUILD_PY (because these scripts to actually build 'spark')
2024-11-29 14:57:13 +00:00
John Colvin
ca0cc90a24
fix build (warn): Only use Registry on windows
2024-11-29 14:57:13 +00:00
John Colvin
ce2c3d930a
cleanup: Fix numerous build warnings in DataStreamSuite
...
Nearly all warnings were due to nullability issues, since the concept of
nullable reference types did not exist when the DataStream code was
originally written.
* PubSubClientMessage
- Normalize indentation/whitespace
- Fix some typos
- Address nullability issues to fix build warnings
- Modernize code
* Compression related files
- ZipEntry
- ZipFile
- ZipInputStream
- TarHeader
* RemoteMessage
- make 'message' nullable to resolve warnings elsewhere (in calling code)
* PubSubSingleTagStateEvent.cs
* PubSubMessageReactor
* PubSubState
* SystemHeartbeatPublisher
* SystemStatsPublisher
* SingleTagData
* ManagedTCPMessageHub
* PubsubDeserializationController
* PublisherCore
* InflaterHuffmanTree
* AsyncTCPConnection_APM
* ThreadSafeQueue
* ManagedSubscriber
* SubscriberCore
* PubSubServerManagedTCPConnection
* AsyncTCPConnection_APM
* SuperMapStream
* MapStream
* TradeBarsStream
2024-11-29 14:57:13 +00:00
John Colvin
e7725233e4
cleanup: Disable nullability warnings
...
* BZip2InputStream
* TarInputStream
* Inflater
* InflaterDynHeader
* BZip2OutputStream
* DeflaterHuffman
* ParallelJoinTest
2024-11-29 14:57:13 +00:00
John Colvin
6ed6b65027
cleanup: Modernize PubSubRoute code, json parsing
2024-11-29 14:57:13 +00:00
John Colvin
899e57cfef
cleanup: Remove unused DateTime grammar from exp parser
2024-11-29 14:57:13 +00:00
John Colvin
2fae6f6312
Add JsonRpcRequestObservable, AsyncEnumerable
2024-11-29 14:57:13 +00:00
John Colvin
030f1adaed
Add json facilities for DataStream websocket api
2024-11-29 14:57:13 +00:00
John Colvin
1ce7912b8c
refactor: Add handy WebsocketExtensions
...
* IsSocketStateOpen
* IsClosedProperly
2024-11-29 14:57:13 +00:00
John Colvin
3f73b811db
feat: Add JsonRpc types for websocket paradigm
2024-11-29 14:57:13 +00:00
John Colvin
fee48eab80
cleanup: Remove empty file (clearly added by accident)
2024-11-29 14:57:13 +00:00
John Colvin
ac6dde22f4
fix: Fix improper 'OfType' linq cast
...
Previously, animations were expressed through polymorphism (derived from the
base class CellAnimation), but the new impl uses composition. This 'OfType' call
was leftover from the polymorphism implementation, an attempt to linq cast
elements of base class (CellAnimation) to BackgroundAnimation.
2024-11-29 14:57:13 +00:00
John Colvin
83c1498e75
editorconfig: Use standard c# capitalization rules
...
* Use 'PascalCase' for public members (instead of 'snake_case')
* Use 'camelCase' for private members (instead of '_snake_case')
2024-11-29 14:57:13 +00:00
John Colvin
3a04775a4d
refactor: Add WebsocketClient class
...
Basically an ISubject (I/O) wrapper for IWebsocketConnectionGateway
2024-11-29 14:57:12 +00:00
John Colvin
b68daf48c8
refactor: Change WebsocketServerConfig.port to uint32
...
It should always be a number between 1-65535
2024-11-29 14:57:12 +00:00
John Colvin
efcf4f66a1
refactor: Rename WebsocketServerConfig proto pkg 'bts.websocket_core'
...
This matches the namespace used in spark_websocket csproj. Eventually,
I'd like to use conventional capitalization (TitleCase namespaces/types,
etc.), but let's shelf that until we have enough time/energy to do a
more comprehensive refactoring.
2024-11-29 14:57:12 +00:00
John Colvin
39002b0829
refactor: Remove nullability constraint in GetValueOrDefault
2024-11-29 14:57:12 +00:00
John Colvin
71803ddcd6
refactor: Use events to avoid circular deps for ws sync/gateway
2024-11-29 14:57:12 +00:00
John Colvin
8cde8ee6e1
build: Add script to publish the api server
...
This will build the app as a self-contained executable here:
build/Release/bin/net7.0/linux-x64/publish
2024-11-28 16:35:21 +00:00
John Colvin
4f8fad444e
fix build: Add missing csproj deps to Spark.Api.Server.sln
2024-11-28 16:35:20 +00:00
John Colvin
832c645a30
build: Map cmake install dir to associated preset
...
Cpp bins are now installed to "install/<cmake_preset>/bin". For example,
"install/sparkd-release-gcc/bin", "install/spark-api-server-linux/bin", etc.
2024-11-28 16:35:20 +00:00
John Colvin
691343d9b6
feat: Add datastreams to spark api server
2024-11-28 06:14:00 +00:00
Taha
461cbad338
Adding FakeBBO stream
2024-11-27 13:36:14 -05:00
Taha
fecbcbb6b6
Merge branch 'development' of bitbucket.org:bluetradesys/spark into development
2024-11-26 22:33:31 -05:00