John Colvin
fc40ea412f
cleanup: Remove unused code in Bts.DataStreamWebApp.Client
2024-11-29 14:57:43 +00:00
John Colvin
e03b7d5991
Capture OperationCanceledException (instead of TaskCanceledException)
...
The former is the base class for the latter, so this will widen the umbrella to catch a few corner cases
that would otherwise been handled by the generic "Exception" catch block. One corner case I know
of is when an op is canceled via "CancellationToken.ThrowIfCancellationRequested". In that case,
an OperationCanceledException is thrown (not a TaskCanceledException).
https://stackoverflow.com/questions/34359129/operationcanceledexception-vs-taskcanceledexception-when-task-is-canceled
2024-11-29 14:57:43 +00:00
John Colvin
0e198e0ebf
Hardcode webSocketUrl to aws server in DataStreamWebApp client
2024-11-29 14:57:43 +00:00
John Colvin
27a9bf66bb
Assert that System publishers 'doWork' is always called on same thread
2024-11-29 14:57:43 +00:00
John Colvin
2a390c7c2e
fix: Make InternalPublisherQueue thread safe
2024-11-29 14:57:43 +00:00
John Colvin
ee0d444ae6
Improve error reporting in DataStreamWebSocketServer
2024-11-29 14:57:43 +00:00
John Colvin
b058cde0ca
data stream web app client check pt
2024-11-29 14:57:43 +00:00
John Colvin
39bb411bda
fix build: Fix Spark build after making config init async
2024-11-29 14:57:43 +00:00
John Colvin
7423721c72
refactor: Tweak SparkCoreServices to synchronize Configuration.init globally
2024-11-29 14:57:43 +00:00
John Colvin
ffbf7b5e8d
refactor: Change Configuration.initialize to be async
2024-11-29 14:57:43 +00:00
John Colvin
eb5aa9c3c7
vscode: Add 'isSparkApiEnabled' input to launch.json
2024-11-29 14:57:43 +00:00
John Colvin
b90730fd11
SparkApiService check pt
2024-11-29 14:57:43 +00:00
John Colvin
142d530999
datastreamwebapp server checkpt
2024-11-29 14:57:43 +00:00
John Colvin
a5670d2aaa
datastream webapp client check pt
2024-11-29 14:57:43 +00:00
John Colvin
3179e9add3
Remove unused PubSubConfig props
2024-11-29 14:57:43 +00:00
John Colvin
8dae6e37e6
Fix dsqa config json
2024-11-29 14:57:43 +00:00
John Colvin
eb0086d2c6
fix: Always call 'handle_internal_pubs' in PubSubMessageReactor main loop
2024-11-29 14:57:43 +00:00
John Colvin
0f680b1947
improvement: Accept CancellationToken, catch exceptions when running ds websocket server
2024-11-29 14:57:43 +00:00
John Colvin
e4745a587f
Fix mismatched types in PubSubServerTagStatsStream schema
2024-11-29 14:57:43 +00:00
John Colvin
adfc0b5235
Add DataStreamPublisher service modules designed for Dependency Injection
...
* Change DataStreamPublisher json fields to match cs class property names verbatim
* Rename Publishers -> PublisherNodes in DataStreamPublisherConfig
2024-11-29 14:57:43 +00:00
John Colvin
30cf7ac5f9
refactor: Decouple ViewPublisher from IPubTableBroker impl
2024-11-29 14:57:43 +00:00
John Colvin
31b065c854
Add PubSub service modules designed for Dependency Injection
...
* Get rid of JsonPropertyName attributes in PubSubConfig
- The Dependency Injection framework (based around dotnet ApplicationBuilder)
does not support this attribute, and maps property names verbatim to json fields.
* Change PubSubServer json fields to match cs class property names verbatim
2024-11-29 14:57:43 +00:00
John Colvin
04a0cf9144
refactor: Decouple RemoteQueryManager from IManagedSubscriber, IPubTableBroker impl
2024-11-29 14:57:43 +00:00
John Colvin
37d6ffa27a
refactor: Decouple ManagedSubscriber from ISubscriberCore impl
2024-11-29 14:57:43 +00:00
John Colvin
2760867093
refactor: Only support 1 tag type in IPubSubServerTagHandler
2024-11-29 14:57:43 +00:00
John Colvin
191de2ae46
refactor: Decouple PubTableBroker from IPublisherCore impl
...
Reference interface rather than the PublisherCore impl.
2024-11-29 14:57:43 +00:00
John Colvin
0b444d5f2f
improvement: Accept CancellationToken in JsonRpcRequestObservable
2024-11-29 14:57:43 +00:00
John Colvin
702eac44d3
fix: Dispose market data sub in various md streams
2024-11-29 14:57:43 +00:00
John Colvin
30b23d36fa
cleanup: Remove unused pubsub tag handler code
...
* Removed 'IPubSubServerTagHandler.register'
- All implementations of this function were empty
* Removed 'IPubSubServerTagHandler.supportedTagTypes'
- This property wasn't referenced anywhere
* Remove IWorker inheritance from IPubSubServerTagHandler
- No reason these interfaces have to be tied together
2024-11-29 14:57:43 +00:00
John Colvin
202a9f6206
refactor: Rename CloudStreamManager.cs -> RemoteQueryManager.cs
...
This matches the file name
2024-11-29 14:57:43 +00:00
John Colvin
0d1966e752
Change pub sub schema prefix 'bluto://' -> 'bts-cloud://'
...
In config json files (not actual code change)
2024-11-29 14:57:43 +00:00
John Colvin
a25905d55d
fix build: Fix prop names after refactoring PubSubRoute
...
* Change 'server_address' -> 'ServerAddress'
* Change 'tag_reg_exp' -> 'TagRegExp'
2024-11-29 14:57:43 +00:00
John Colvin
dddf14e356
build: Add scripts to publish data stream apps
2024-11-29 14:57:42 +00:00
John Colvin
962fd8712a
Fix typo in log msg
2024-11-29 14:57:13 +00:00
John Colvin
7685b1f628
Fix build scripts so they propagate the exit code back to the shell
...
I noticed this was broken because launch.json configurations would still start the debugger
even when the preLaunchTask (build) failed!
2024-11-29 14:57:13 +00:00
John Colvin
ef94ecf6a6
vscode: Add DataStreamPublisher debug cfg to skip build
2024-11-29 14:57:13 +00:00
John Colvin
26f9a76fc8
build: Use separate cmd to build DataStreamSuite/QueryAnalyzer.sln
...
The DataStreamSuite.sln builds the new webapp now, which will
(eventually) replace DSQA. We'll keep it around for now, but with a
clean separation from the main build.
2024-11-29 14:57:13 +00:00
John Colvin
806c204f08
feat: Add DataStream WebApp
...
Included in DataStreamSuite.sln, but not DataStreamQueryAnalyzer.sln
2024-11-29 14:57:13 +00:00
John Colvin
4aa3c67e87
Add spark service modules designed for Dependency Injection
2024-11-29 14:57:13 +00:00
John Colvin
614adac241
build: Copy libspark to all dotnet dirs in single cmake target
...
This is cleaner than the previous impl, which used separate build
targets to copy libspark to "net7.0", and "net7.0-windows" (dirs).
2024-11-29 14:57:13 +00:00
John Colvin
63ece377de
fix: Parse ServerAddress as normal string
...
The "JsonValueOrArrayConverter<T>" doesn't work the way I thought it
would. When it is associated with a property via the JsonConverter
attribute, dotnet json parsing code throws an exception if "T" isn't
assignable to the property type.
2024-11-29 14:57:13 +00:00
John Colvin
e49efc2bbf
fix build (api server): Change namespace to bts.websocket_core
2024-11-29 14:57:13 +00:00
John Colvin
e431c309ed
Remove docker submodules again
2024-11-29 14:57:13 +00:00
John Colvin
3c5769b3da
Change externals url from ssh to https style
...
So we don't need ssh keys to clone it (the builtin credential manager
makes https authentication safe/easy)
2024-11-29 14:57:13 +00:00
John Colvin
efe09eb1b7
cleanup: Fix benign typos in build scripts
...
Change BUILD_SPARK_PY var name to BUILD_PY (because these scripts to actually build 'spark')
2024-11-29 14:57:13 +00:00
John Colvin
ca0cc90a24
fix build (warn): Only use Registry on windows
2024-11-29 14:57:13 +00:00
John Colvin
ce2c3d930a
cleanup: Fix numerous build warnings in DataStreamSuite
...
Nearly all warnings were due to nullability issues, since the concept of
nullable reference types did not exist when the DataStream code was
originally written.
* PubSubClientMessage
- Normalize indentation/whitespace
- Fix some typos
- Address nullability issues to fix build warnings
- Modernize code
* Compression related files
- ZipEntry
- ZipFile
- ZipInputStream
- TarHeader
* RemoteMessage
- make 'message' nullable to resolve warnings elsewhere (in calling code)
* PubSubSingleTagStateEvent.cs
* PubSubMessageReactor
* PubSubState
* SystemHeartbeatPublisher
* SystemStatsPublisher
* SingleTagData
* ManagedTCPMessageHub
* PubsubDeserializationController
* PublisherCore
* InflaterHuffmanTree
* AsyncTCPConnection_APM
* ThreadSafeQueue
* ManagedSubscriber
* SubscriberCore
* PubSubServerManagedTCPConnection
* AsyncTCPConnection_APM
* SuperMapStream
* MapStream
* TradeBarsStream
2024-11-29 14:57:13 +00:00
John Colvin
e7725233e4
cleanup: Disable nullability warnings
...
* BZip2InputStream
* TarInputStream
* Inflater
* InflaterDynHeader
* BZip2OutputStream
* DeflaterHuffman
* ParallelJoinTest
2024-11-29 14:57:13 +00:00
John Colvin
6ed6b65027
cleanup: Modernize PubSubRoute code, json parsing
2024-11-29 14:57:13 +00:00
John Colvin
899e57cfef
cleanup: Remove unused DateTime grammar from exp parser
2024-11-29 14:57:13 +00:00