Commit Graph
13347 Commits
Author SHA1 Message Date
John Colvin 322152c743 build: Copy libspark to all dotnet dirs in single cmake target
This is cleaner than the previous impl, which used separate build
targets to copy libspark to "net7.0", and "net7.0-windows" (dirs).

Note: I decided to clean this up now because I'm about to upgrade the
new DataStream WebApp to net8.0, and did not want to add yet another
build target to copy libspark to "net8.0".
2024-06-26 14:33:04 -04:00
John Colvin 9ab39587e2 fix: Parse ServerAddress as normal string
The "JsonValueOrArrayConverter<T>" doesn't work the way I thought it
would. When it is associated with a property via the JsonConverter
attribute, dotnet json parsing code throws an exception if "T" isn't
assignable to the property type.
2024-06-26 14:33:04 -04:00
John Colvin 72f59924ea fix build (api server): Change namespace to bts.websocket_core 2024-06-26 14:33:04 -04:00
John Colvin 98ab9741b5 fix build: Update vcpkg
On some vs versions, vcpkg cmake scripts would fail w/ an error saying
"Could not locate a complete Visual Studio instance"
2024-06-26 14:33:04 -04:00
John Colvin 11f0143845 Remove docker/windows again? 2024-06-26 14:33:04 -04:00
John Colvin 35d47f9cce Remove docker/linux again? 2024-06-26 14:33:04 -04:00
John Colvin 18662fcc0d Change externals url from ssh to https style
So we don't need ssh keys to clone it (the builtin credential manager
makes https authentication safe/easy)
2024-06-26 14:33:04 -04:00
John Colvin 16ffc48846 cleanup: Fix benign typos in build scripts
Change BUILD_SPARK_PY var name to BUILD_PY (because these scripts to actually build 'spark')
2024-06-26 14:33:04 -04:00
John Colvin 3cf388f041 fix build (warn): Only use Registry on windows 2024-06-26 14:33:03 -04:00
John Colvin 3e401a766d cleanup: Fix numerous build warnings in DataStreamSuite
Nearly all warnings were due to nullability issues, since the concept of
nullable reference types did not exist when the DataStream code was
originally written.

* PubSubClientMessage
  - Normalize indentation/whitespace
  - Fix some typos
  - Address nullability issues to fix build warnings
  - Modernize code

* Compression related files
  - ZipEntry
  - ZipFile
  - ZipInputStream
  - TarHeader

* RemoteMessage
  - make 'message' nullable to resolve warnings elsewhere (in calling code)

* PubSubSingleTagStateEvent.cs
* PubSubMessageReactor
* PubSubState
* SystemHeartbeatPublisher
* SystemStatsPublisher
* SingleTagData
* ManagedTCPMessageHub
* PubsubDeserializationController
* PublisherCore
* InflaterHuffmanTree
* AsyncTCPConnection_APM
* ThreadSafeQueue
* ManagedSubscriber
* SubscriberCore
* PubSubServerManagedTCPConnection
* AsyncTCPConnection_APM
* SuperMapStream
* MapStream
* TradeBarsStream
2024-06-26 14:33:03 -04:00
John Colvin b16ff50120 cleanup: Normalize indentation in TradeBarsStream 2024-06-26 14:33:03 -04:00
John Colvin 44564f7d56 cleanup: Disable nullability warnings
* BZip2InputStream
* TarInputStream
* Inflater
* InflaterDynHeader
* BZip2OutputStream
* DeflaterHuffman
* ParallelJoinTest
2024-06-26 14:33:03 -04:00
John Colvin eaa5580e89 cleanup: Modernize PubSubRoute code, json parsing 2024-06-26 14:33:03 -04:00
John Colvin 5de4e31880 cleanup: Remove unused DateTime grammar from exp parser 2024-06-26 14:33:03 -04:00
John Colvin 7cf90d95da Add JsonRpcRequestObservable, AsyncEnumerable 2024-06-26 14:33:03 -04:00
John Colvin ec36d84412 Add json facilities for DataStream websocket api 2024-06-26 14:33:03 -04:00
John Colvin 95aad773a2 refactor: Add handy WebsocketExtensions
* IsSocketStateOpen
* IsClosedProperly
2024-06-26 14:33:03 -04:00
John Colvin fb476de0a3 feat: Add JsonRpc types for websocket paradigm 2024-06-26 14:33:03 -04:00
John Colvin 41b42719ce cleanup: Remove empty file (clearly added by accident) 2024-06-26 14:33:03 -04:00
John Colvin c1f8aadd5d fix: Fix improper 'OfType' linq cast
Previously, animations were expressed through polymorphism (derived from the
base class CellAnimation), but the new impl uses composition. This 'OfType' call
was leftover from the polymorphism implementation, an attempt to linq cast
elements of base class (CellAnimation) to BackgroundAnimation.
2024-06-26 14:33:03 -04:00
John Colvin ad5e0c77fe editorconfig: Use standard c# capitalization rules
* Use 'PascalCase' for public members (instead of 'snake_case')
* Use 'camelCase' for private members (instead of '_snake_case')
2024-06-26 14:33:03 -04:00
John Colvin 90ee45db30 refactor: Add WebsocketClient class
Basically an ISubject (I/O) wrapper for IWebsocketConnectionGateway
2024-06-26 14:33:03 -04:00
John Colvin 6dd701dd33 refactor: Change WebsocketServerConfig.port to uint32
It should always be a number between 1-65535
2024-06-26 14:33:03 -04:00
John Colvin 456c953839 refactor: Rename WebsocketServerConfig proto pkg 'bts.websocket_core'
This matches the namespace used in spark_websocket csproj. Eventually,
I'd like to use conventional capitalization (TitleCase namespaces/types,
etc.), but let's shelf that until we have enough time/energy to do a
more comprehensive refactoring.
2024-06-26 14:33:03 -04:00
John Colvin 492f02eb21 refactor: Remove nullability constraint in GetValueOrDefault 2024-06-26 14:33:03 -04:00
John Colvin 41d2fd9c51 refactor: Use events to avoid circular deps for ws sync/gateway 2024-06-26 14:33:03 -04:00
John Colvin 59f3c446ba refactor: Let caller specify nullability of T in json parse fn 2024-06-26 14:33:03 -04:00
Taha 9aadda2429 some buf gixes + cleanup 2024-06-26 14:29:22 -04:00
Taha 57ac078469 PubSuMessageReactor empties the message queue (instead oif one elem ata a time) in the main loop 2024-06-26 14:28:52 -04:00
Taha c39fc70a64 PubSubServer's linux issues fixed 2024-06-26 14:28:51 -04:00
Taha 5cf7eacd82 Fixing the extra .0 in the default pubsub server routeplusfixing acorner cae issue of gettign a fast streaming data cakback after an unsubscribe 2024-06-24 00:28:07 -04:00
John Colvin 087d8ab8c9 Set text=auto in gitattributes
Otherwise git can cause files to show as "permanently modified" when you
apply changes from the index (e.g., by running 'git rebase', or 'git
stash pop')
2024-06-11 17:39:12 +00:00
John Colvin b69b7b3350 vscode: Use '\' dir separator in show_last_run.cmd
This script only runs on Windows
2024-06-08 15:08:25 -05:00
John Colvin 5620f33524 vscode: Add task to view logs for last PubSubServer run 2024-06-08 14:42:13 +00:00
John Colvin f3e33fa390 vscode: Add task to run PubSubServer without building 2024-06-07 16:41:42 +00:00
John Colvin 3b631e0d5f Fix a couple more typos in logs 2024-06-07 16:35:06 +00:00
John Colvin f93d28ee76 vscode: Add task to view logs for last DSQA run 2024-06-07 11:34:36 -05:00
John Colvin 23d7d3775d cleanup: Delete unused files 2024-06-07 10:40:34 -05:00
John Colvin 4940771166 fix: Don't login to sparkd from DSQA 2024-06-07 10:02:42 -05:00
John Colvin c1967a8f6a vscode: Add tasks to edit Spark, DataStream config 2024-06-06 11:12:56 -05:00
John Colvin 8c797ee76b Fix typo in log msg 2024-06-06 09:21:01 -05:00
John Colvin ce80957d07 DSQA shouldn't connect to sparkd by default 2024-06-06 09:21:01 -05:00
John Colvin c60018b59e DataStreamPublisher shouldn't connect to sparkd by default
It only needs to connect to sparkd if it's publishing market data
2024-06-06 09:21:01 -05:00
John Colvin 3a27af87d1 PubSubServer shouldn't download config from sparkd by default
As far as I know, it only needs spark/protobuf config to initialize the
c++ logging system. Eventually, we should get rid of that dependency and
use builtin Microsoft Logging facilities for c# instead. In the
meantime, PubSubServer will load config from local files by default
(i.e., spark.conf).
2024-06-06 09:21:01 -05:00
John Colvin 068c1c6973 cleanup: Remove erroneous comment 2024-06-06 09:21:01 -05:00
John Colvin 645a58c97d vscode: Add launch.json 2024-06-06 09:21:01 -05:00
John Colvin b7f455b29a vscode: Remove launch/tasks.json from gitignore 2024-06-06 09:21:00 -05:00
John Colvin 4a2735839e Change line endings to crlf in a few cs files 2024-06-06 09:21:00 -05:00
John Colvin d2e9fe8237 Change line endings to crlf in a few cs files 2024-06-06 09:21:00 -05:00
John Colvin cfc60766d8 Change line endings to crlf in a few cs files 2024-06-06 09:21:00 -05:00