John Colvin
554ceea2ee
check pt
2024-07-07 22:19:25 +00:00
John Colvin
d54b0437b0
Add config for PubSub tag handler factory
2024-07-05 13:50:39 +00:00
John Colvin
81f51352b4
devcontainer: Install dotnet8 expose ports for DataStream Web App
2024-07-04 17:33:37 +00:00
John Colvin
6f521f8f6a
fix build: Copy libspark to net8.0 dir
...
For the DataStream Web App
2024-07-04 17:33:37 +00:00
John Colvin
7a0f36f686
fix build: Copy dll to all dirs in DOTNET_BINARY_DIR
...
Needed to wrap the var in double quotes
2024-07-04 17:33:37 +00:00
John Colvin
a14aa58a24
build: Add scripts to publish data stream apps
2024-07-04 17:33:37 +00:00
John Colvin
667ec4ca10
Fix typo in log msg
2024-07-04 17:33:37 +00:00
John Colvin
7698fa15f6
Fix work scheduler issues
2024-07-04 13:32:22 -04:00
John Colvin
e78b405139
refactor: Remove JsonPropertyName attributes from PubSubConfig
...
The ApplicationBuilder doesn't support these attributes when parsing config.
2024-07-04 13:32:22 -04:00
John Colvin
bf96899fa3
refactor: Add config for IPubSubTagHandlerFactory
2024-07-04 13:32:22 -04:00
John Colvin
e919aa9d05
fix: Make sure transient streams are attached to IServiceProvider
...
So they can retrieve services necessary to function (e.g., add themselves
to the master IWorkScheduler so doWork gets called, etc.)
2024-07-04 13:32:22 -04:00
John Colvin
a05c7410dc
refactor: Use DependencyInjection paradigm in DataStreamSuite
...
This allows us to create loosely coupled services with automatic
dependency resolution
2024-07-02 11:30:14 -04:00
John Colvin
6cc0ad4f66
Fix net7 -> net8 typo in publish_data_stream_web_app.py
...
The DataStream Web App is on net8
2024-07-01 23:36:04 -04:00
John Colvin
8fff414c4c
Fix build scripts so they propagate the exit code back to the shell
...
I noticed this was broken because launch.json configurations would still start the debugger
even when the preLaunchTask (build) failed!
2024-07-01 23:36:04 -04:00
John Colvin
8421e4ae1a
Change PubSub scheme prefix from 'bluto' -> 'bts-cloud'
2024-07-01 23:36:04 -04:00
Taha
a8d0712e30
Added pubsub routes to the Title of DSQA
2024-07-01 23:36:04 -04:00
John Colvin
aa36a7393c
vscode: Add DataStreamPublisher debug cfg to skip build
2024-07-01 11:23:46 -04:00
John Colvin
7e0d5e4f59
build: Use separate cmd to build DataStreamSuite/QueryAnalyzer.sln
...
The DataStreamSuite.sln builds the new webapp now, which will
(eventually) replace DSQA. We'll keep it around for now, but with a
clean separation from the main build.
2024-07-01 11:23:46 -04:00
John Colvin
d26e653a6b
Tweak grid colors in DataStream web app
2024-07-01 11:23:46 -04:00
John Colvin
56e087ab8b
refactor: Move DataStreamWebApp themes to their own js file
2024-07-01 11:23:45 -04:00
Taha
c71bb8c301
Fixing the bug where messages were being sent by the pubsubserver out of order
2024-06-27 01:32:18 -04:00
John Colvin
44d6173ddf
feat: Add DataStream WebApp
...
Included in DataStreamSuite.sln, but not DataStreamQueryAnalyzer.sln
2024-06-26 14:33:04 -04:00
John Colvin
322152c743
build: Copy libspark to all dotnet dirs in single cmake target
...
This is cleaner than the previous impl, which used separate build
targets to copy libspark to "net7.0", and "net7.0-windows" (dirs).
Note: I decided to clean this up now because I'm about to upgrade the
new DataStream WebApp to net8.0, and did not want to add yet another
build target to copy libspark to "net8.0".
2024-06-26 14:33:04 -04:00
John Colvin
9ab39587e2
fix: Parse ServerAddress as normal string
...
The "JsonValueOrArrayConverter<T>" doesn't work the way I thought it
would. When it is associated with a property via the JsonConverter
attribute, dotnet json parsing code throws an exception if "T" isn't
assignable to the property type.
2024-06-26 14:33:04 -04:00
John Colvin
72f59924ea
fix build (api server): Change namespace to bts.websocket_core
2024-06-26 14:33:04 -04:00
John Colvin
98ab9741b5
fix build: Update vcpkg
...
On some vs versions, vcpkg cmake scripts would fail w/ an error saying
"Could not locate a complete Visual Studio instance"
2024-06-26 14:33:04 -04:00
John Colvin
11f0143845
Remove docker/windows again?
2024-06-26 14:33:04 -04:00
John Colvin
35d47f9cce
Remove docker/linux again?
2024-06-26 14:33:04 -04:00
John Colvin
18662fcc0d
Change externals url from ssh to https style
...
So we don't need ssh keys to clone it (the builtin credential manager
makes https authentication safe/easy)
2024-06-26 14:33:04 -04:00
John Colvin
16ffc48846
cleanup: Fix benign typos in build scripts
...
Change BUILD_SPARK_PY var name to BUILD_PY (because these scripts to actually build 'spark')
2024-06-26 14:33:04 -04:00
John Colvin
3cf388f041
fix build (warn): Only use Registry on windows
2024-06-26 14:33:03 -04:00
John Colvin
3e401a766d
cleanup: Fix numerous build warnings in DataStreamSuite
...
Nearly all warnings were due to nullability issues, since the concept of
nullable reference types did not exist when the DataStream code was
originally written.
* PubSubClientMessage
- Normalize indentation/whitespace
- Fix some typos
- Address nullability issues to fix build warnings
- Modernize code
* Compression related files
- ZipEntry
- ZipFile
- ZipInputStream
- TarHeader
* RemoteMessage
- make 'message' nullable to resolve warnings elsewhere (in calling code)
* PubSubSingleTagStateEvent.cs
* PubSubMessageReactor
* PubSubState
* SystemHeartbeatPublisher
* SystemStatsPublisher
* SingleTagData
* ManagedTCPMessageHub
* PubsubDeserializationController
* PublisherCore
* InflaterHuffmanTree
* AsyncTCPConnection_APM
* ThreadSafeQueue
* ManagedSubscriber
* SubscriberCore
* PubSubServerManagedTCPConnection
* AsyncTCPConnection_APM
* SuperMapStream
* MapStream
* TradeBarsStream
2024-06-26 14:33:03 -04:00
John Colvin
b16ff50120
cleanup: Normalize indentation in TradeBarsStream
2024-06-26 14:33:03 -04:00
John Colvin
44564f7d56
cleanup: Disable nullability warnings
...
* BZip2InputStream
* TarInputStream
* Inflater
* InflaterDynHeader
* BZip2OutputStream
* DeflaterHuffman
* ParallelJoinTest
2024-06-26 14:33:03 -04:00
John Colvin
eaa5580e89
cleanup: Modernize PubSubRoute code, json parsing
2024-06-26 14:33:03 -04:00
John Colvin
5de4e31880
cleanup: Remove unused DateTime grammar from exp parser
2024-06-26 14:33:03 -04:00
John Colvin
7cf90d95da
Add JsonRpcRequestObservable, AsyncEnumerable
2024-06-26 14:33:03 -04:00
John Colvin
ec36d84412
Add json facilities for DataStream websocket api
2024-06-26 14:33:03 -04:00
John Colvin
95aad773a2
refactor: Add handy WebsocketExtensions
...
* IsSocketStateOpen
* IsClosedProperly
2024-06-26 14:33:03 -04:00
John Colvin
fb476de0a3
feat: Add JsonRpc types for websocket paradigm
2024-06-26 14:33:03 -04:00
John Colvin
41b42719ce
cleanup: Remove empty file (clearly added by accident)
2024-06-26 14:33:03 -04:00
John Colvin
c1f8aadd5d
fix: Fix improper 'OfType' linq cast
...
Previously, animations were expressed through polymorphism (derived from the
base class CellAnimation), but the new impl uses composition. This 'OfType' call
was leftover from the polymorphism implementation, an attempt to linq cast
elements of base class (CellAnimation) to BackgroundAnimation.
2024-06-26 14:33:03 -04:00
John Colvin
ad5e0c77fe
editorconfig: Use standard c# capitalization rules
...
* Use 'PascalCase' for public members (instead of 'snake_case')
* Use 'camelCase' for private members (instead of '_snake_case')
2024-06-26 14:33:03 -04:00
John Colvin
90ee45db30
refactor: Add WebsocketClient class
...
Basically an ISubject (I/O) wrapper for IWebsocketConnectionGateway
2024-06-26 14:33:03 -04:00
John Colvin
6dd701dd33
refactor: Change WebsocketServerConfig.port to uint32
...
It should always be a number between 1-65535
2024-06-26 14:33:03 -04:00
John Colvin
456c953839
refactor: Rename WebsocketServerConfig proto pkg 'bts.websocket_core'
...
This matches the namespace used in spark_websocket csproj. Eventually,
I'd like to use conventional capitalization (TitleCase namespaces/types,
etc.), but let's shelf that until we have enough time/energy to do a
more comprehensive refactoring.
2024-06-26 14:33:03 -04:00
John Colvin
492f02eb21
refactor: Remove nullability constraint in GetValueOrDefault
2024-06-26 14:33:03 -04:00
John Colvin
41d2fd9c51
refactor: Use events to avoid circular deps for ws sync/gateway
2024-06-26 14:33:03 -04:00
John Colvin
59f3c446ba
refactor: Let caller specify nullability of T in json parse fn
2024-06-26 14:33:03 -04:00
Taha
9aadda2429
some buf gixes + cleanup
2024-06-26 14:29:22 -04:00