Commit Graph
13371 Commits
Author SHA1 Message Date
John Colvin 0b8643ac8e devcontainer: Install dotnet8 expose ports for DataStream Web App 2024-07-07 18:16:38 -04:00
John Colvin 7d128f2b47 fix build: Copy libspark to net8.0 dir
For the DataStream Web App
2024-07-07 18:16:38 -04:00
John Colvin e32b925660 fix build: Copy dll to all dirs in DOTNET_BINARY_DIR
Needed to wrap the var in double quotes
2024-07-07 18:16:38 -04:00
John Colvin b97023f159 build: Add scripts to publish data stream apps 2024-07-07 18:16:38 -04:00
John Colvin eb0e055573 Fix typo in log msg 2024-07-07 18:16:38 -04:00
John Colvin d82749af15 Fix work scheduler issues 2024-07-07 18:16:38 -04:00
John Colvin e2686564b4 refactor: Remove JsonPropertyName attributes from PubSubConfig
The ApplicationBuilder doesn't support these attributes when parsing config.
2024-07-07 18:16:35 -04:00
John Colvin 64aea5b068 refactor: Add config for IPubSubTagHandlerFactory 2024-07-07 18:14:01 -04:00
John Colvin 3ce9f57e95 fix: Make sure transient streams are attached to IServiceProvider
So they can retrieve services necessary to function (e.g., add themselves
to the master IWorkScheduler so doWork gets called, etc.)
2024-07-07 18:14:01 -04:00
John Colvin 5fa284cad3 refactor: Use DependencyInjection paradigm in DataStreamSuite
This allows us to create loosely coupled services with automatic
dependency resolution
2024-07-07 18:13:59 -04:00
John Colvin becd19d7e6 Fix net7 -> net8 typo in publish_data_stream_web_app.py
The DataStream Web App is on net8
2024-07-07 17:54:21 -04:00
John Colvin 9be5166c83 Fix build scripts so they propagate the exit code back to the shell
I noticed this was broken because launch.json configurations would still start the debugger
even when the preLaunchTask (build) failed!
2024-07-07 17:54:21 -04:00
John Colvin 64863cf28f vscode: Add DataStreamPublisher debug cfg to skip build 2024-07-07 17:50:26 -04:00
John Colvin 907a1288d9 build: Use separate cmd to build DataStreamSuite/QueryAnalyzer.sln
The DataStreamSuite.sln builds the new webapp now, which will
(eventually) replace DSQA. We'll keep it around for now, but with a
clean separation from the main build.
2024-07-07 17:50:26 -04:00
John Colvin 24f4669425 Tweak grid colors in DataStream web app 2024-07-07 17:50:26 -04:00
John Colvin 7cd8805b48 refactor: Move DataStreamWebApp themes to their own js file 2024-07-07 17:50:26 -04:00
John Colvin 7e776299a4 feat: Add DataStream WebApp
Included in DataStreamSuite.sln, but not DataStreamQueryAnalyzer.sln
2024-07-07 17:48:26 -04:00
John Colvin c7d2071047 build: Copy libspark to all dotnet dirs in single cmake target
This is cleaner than the previous impl, which used separate build
targets to copy libspark to "net7.0", and "net7.0-windows" (dirs).

Note: I decided to clean this up now because I'm about to upgrade the
new DataStream WebApp to net8.0, and did not want to add yet another
build target to copy libspark to "net8.0".
2024-07-07 17:48:26 -04:00
John Colvin a2b9f7d140 fix: Parse ServerAddress as normal string
The "JsonValueOrArrayConverter<T>" doesn't work the way I thought it
would. When it is associated with a property via the JsonConverter
attribute, dotnet json parsing code throws an exception if "T" isn't
assignable to the property type.
2024-07-07 17:48:25 -04:00
John Colvin 0970adec91 fix build (api server): Change namespace to bts.websocket_core 2024-07-07 17:48:25 -04:00
John Colvin 484b69897d fix build: Update vcpkg
On some vs versions, vcpkg cmake scripts would fail w/ an error saying
"Could not locate a complete Visual Studio instance"
2024-07-07 17:48:25 -04:00
John Colvin b600377bce Remove docker/windows again? 2024-07-07 17:48:25 -04:00
John Colvin 0fe92f4ecc Remove docker/linux again? 2024-07-07 17:48:25 -04:00
John Colvin 9e047cf3ff Change externals url from ssh to https style
So we don't need ssh keys to clone it (the builtin credential manager
makes https authentication safe/easy)
2024-07-07 17:48:25 -04:00
John Colvin a463c27704 cleanup: Fix benign typos in build scripts
Change BUILD_SPARK_PY var name to BUILD_PY (because these scripts to actually build 'spark')
2024-07-07 17:48:25 -04:00
John Colvin 0532b4a490 fix build (warn): Only use Registry on windows 2024-07-07 17:48:25 -04:00
John Colvin 8acf07d23c cleanup: Fix numerous build warnings in DataStreamSuite
Nearly all warnings were due to nullability issues, since the concept of
nullable reference types did not exist when the DataStream code was
originally written.

* PubSubClientMessage
  - Normalize indentation/whitespace
  - Fix some typos
  - Address nullability issues to fix build warnings
  - Modernize code

* Compression related files
  - ZipEntry
  - ZipFile
  - ZipInputStream
  - TarHeader

* RemoteMessage
  - make 'message' nullable to resolve warnings elsewhere (in calling code)

* PubSubSingleTagStateEvent.cs
* PubSubMessageReactor
* PubSubState
* SystemHeartbeatPublisher
* SystemStatsPublisher
* SingleTagData
* ManagedTCPMessageHub
* PubsubDeserializationController
* PublisherCore
* InflaterHuffmanTree
* AsyncTCPConnection_APM
* ThreadSafeQueue
* ManagedSubscriber
* SubscriberCore
* PubSubServerManagedTCPConnection
* AsyncTCPConnection_APM
* SuperMapStream
* MapStream
* TradeBarsStream
2024-07-07 17:47:39 -04:00
John Colvin 148d7e6ba3 cleanup: Normalize indentation in TradeBarsStream 2024-07-07 17:45:36 -04:00
John Colvin 0bc3394724 cleanup: Disable nullability warnings
* BZip2InputStream
* TarInputStream
* Inflater
* InflaterDynHeader
* BZip2OutputStream
* DeflaterHuffman
* ParallelJoinTest
2024-07-07 17:45:35 -04:00
John Colvin 165f573465 cleanup: Modernize PubSubRoute code, json parsing 2024-07-07 17:45:33 -04:00
John Colvin 6f982f1ae9 cleanup: Remove unused DateTime grammar from exp parser 2024-07-07 17:43:45 -04:00
John Colvin d709504bb6 Add JsonRpcRequestObservable, AsyncEnumerable 2024-07-07 17:43:45 -04:00
John Colvin a86d4490e4 Add json facilities for DataStream websocket api 2024-07-07 17:43:45 -04:00
John Colvin 1531c6e794 refactor: Add handy WebsocketExtensions
* IsSocketStateOpen
* IsClosedProperly
2024-07-07 17:43:45 -04:00
John Colvin 90f2c85b0b feat: Add JsonRpc types for websocket paradigm 2024-07-07 17:42:33 -04:00
John Colvin 9858ba07c8 cleanup: Remove empty file (clearly added by accident) 2024-07-07 17:42:33 -04:00
John Colvin d939c0efb3 fix: Fix improper 'OfType' linq cast
Previously, animations were expressed through polymorphism (derived from the
base class CellAnimation), but the new impl uses composition. This 'OfType' call
was leftover from the polymorphism implementation, an attempt to linq cast
elements of base class (CellAnimation) to BackgroundAnimation.
2024-07-07 17:42:33 -04:00
John Colvin 71f38f6712 editorconfig: Use standard c# capitalization rules
* Use 'PascalCase' for public members (instead of 'snake_case')
* Use 'camelCase' for private members (instead of '_snake_case')
2024-07-07 17:42:33 -04:00
John Colvin f5fc6d560a refactor: Add WebsocketClient class
Basically an ISubject (I/O) wrapper for IWebsocketConnectionGateway
2024-07-07 17:42:33 -04:00
John Colvin 036f5b9c90 refactor: Change WebsocketServerConfig.port to uint32
It should always be a number between 1-65535
2024-07-07 17:42:33 -04:00
John Colvin a29a64b842 refactor: Rename WebsocketServerConfig proto pkg 'bts.websocket_core'
This matches the namespace used in spark_websocket csproj. Eventually,
I'd like to use conventional capitalization (TitleCase namespaces/types,
etc.), but let's shelf that until we have enough time/energy to do a
more comprehensive refactoring.
2024-07-07 17:42:33 -04:00
John Colvin 15949dbab4 refactor: Remove nullability constraint in GetValueOrDefault 2024-07-07 17:42:33 -04:00
John Colvin bcb9056672 refactor: Use events to avoid circular deps for ws sync/gateway 2024-07-07 17:42:33 -04:00
John Colvin f665062b35 refactor: Let caller specify nullability of T in json parse fn 2024-07-07 17:40:04 -04:00
Taha Afzal 4fb3a15ef0 Added pss_echo() 2024-07-07 10:24:09 -04:00
Taha Afzal 146676bfba Merging 2024-07-07 10:24:09 -04:00
Taha Afzal 51b631f09f src/DataStreamSuite/PubSub/ManagedTCP/AsyncTCPConnection_AsyncWrapper.cs 2024-07-07 10:24:09 -04:00
Taha bcfc89f95b Adding TableMetaDataStream 2024-07-07 10:24:09 -04:00
Taha Afzal 0026ecbfaa Cleaning Config 1.0 (not completely done) 2024-07-07 10:24:09 -04:00
Taha f964689a0c Added pubsub routes to the Title of DSQA 2024-07-07 10:24:09 -04:00