John Colvin
c43151a28c
Fix typo in log msg
2024-07-12 18:28:46 -04:00
John Colvin
3095253aa9
feat: Add DataStream WebApp
...
Included in DataStreamSuite.sln, but not DataStreamQueryAnalyzer.sln
2024-07-12 18:28:46 -04:00
John Colvin
8227304aab
Add spark service modules designed for Dependency Injection
2024-07-12 18:28:46 -04:00
John Colvin
4e022a8a12
build: Copy libspark to all dotnet dirs in single cmake target
...
This is cleaner than the previous impl, which used separate build
targets to copy libspark to "net7.0", and "net7.0-windows" (dirs).
2024-07-12 10:49:04 -04:00
John Colvin
450773f588
fix: Parse ServerAddress as normal string
...
The "JsonValueOrArrayConverter<T>" doesn't work the way I thought it
would. When it is associated with a property via the JsonConverter
attribute, dotnet json parsing code throws an exception if "T" isn't
assignable to the property type.
2024-07-09 15:14:29 -04:00
John Colvin
f09d6badaf
fix build (api server): Change namespace to bts.websocket_core
2024-07-09 15:14:29 -04:00
John Colvin
d7bf82722b
fix build (warn): Only use Registry on windows
2024-07-09 15:14:29 -04:00
John Colvin
e1526e25a7
cleanup: Fix numerous build warnings in DataStreamSuite
...
Nearly all warnings were due to nullability issues, since the concept of
nullable reference types did not exist when the DataStream code was
originally written.
* PubSubClientMessage
- Normalize indentation/whitespace
- Fix some typos
- Address nullability issues to fix build warnings
- Modernize code
* Compression related files
- ZipEntry
- ZipFile
- ZipInputStream
- TarHeader
* RemoteMessage
- make 'message' nullable to resolve warnings elsewhere (in calling code)
* PubSubSingleTagStateEvent.cs
* PubSubMessageReactor
* PubSubState
* SystemHeartbeatPublisher
* SystemStatsPublisher
* SingleTagData
* ManagedTCPMessageHub
* PubsubDeserializationController
* PublisherCore
* InflaterHuffmanTree
* AsyncTCPConnection_APM
* ThreadSafeQueue
* ManagedSubscriber
* SubscriberCore
* PubSubServerManagedTCPConnection
* AsyncTCPConnection_APM
* SuperMapStream
* MapStream
* TradeBarsStream
2024-07-09 15:14:26 -04:00
John Colvin
089ba9b369
cleanup: Normalize indentation in TradeBarsStream
2024-07-09 15:09:02 -04:00
John Colvin
567976043f
cleanup: Disable nullability warnings
...
* BZip2InputStream
* TarInputStream
* Inflater
* InflaterDynHeader
* BZip2OutputStream
* DeflaterHuffman
* ParallelJoinTest
2024-07-09 15:07:24 -04:00
John Colvin
2fd3382939
cleanup: Modernize PubSubRoute code, json parsing
2024-07-09 15:06:34 -04:00
John Colvin
a96f1c8f17
cleanup: Remove unused DateTime grammar from exp parser
2024-07-09 15:03:30 -04:00
John Colvin
6f623f9a37
Add JsonRpcRequestObservable, AsyncEnumerable
2024-07-09 15:03:30 -04:00
John Colvin
827189cdb4
Add json facilities for DataStream websocket api
2024-07-09 15:03:30 -04:00
John Colvin
123f12ab88
refactor: Add handy WebsocketExtensions
...
* IsSocketStateOpen
* IsClosedProperly
2024-07-09 14:59:06 -04:00
John Colvin
f51ba8fb56
feat: Add JsonRpc types for websocket paradigm
2024-07-09 14:59:06 -04:00
John Colvin
2506fb4f2b
cleanup: Remove empty file (clearly added by accident)
2024-07-09 14:59:06 -04:00
John Colvin
f92964114e
fix: Fix improper 'OfType' linq cast
...
Previously, animations were expressed through polymorphism (derived from the
base class CellAnimation), but the new impl uses composition. This 'OfType' call
was leftover from the polymorphism implementation, an attempt to linq cast
elements of base class (CellAnimation) to BackgroundAnimation.
2024-07-09 14:59:06 -04:00
John Colvin
7104bd787a
refactor: Add WebsocketClient class
...
Basically an ISubject (I/O) wrapper for IWebsocketConnectionGateway
2024-07-09 14:59:06 -04:00
John Colvin
5db92d1f7d
refactor: Change WebsocketServerConfig.port to uint32
...
It should always be a number between 1-65535
2024-07-09 14:59:06 -04:00
John Colvin
eb0fcf0b84
refactor: Rename WebsocketServerConfig proto pkg 'bts.websocket_core'
...
This matches the namespace used in spark_websocket csproj. Eventually,
I'd like to use conventional capitalization (TitleCase namespaces/types,
etc.), but let's shelf that until we have enough time/energy to do a
more comprehensive refactoring.
2024-07-09 14:59:06 -04:00
John Colvin
a52b187313
refactor: Remove nullability constraint in GetValueOrDefault
2024-07-09 14:59:06 -04:00
John Colvin
669b059eb2
refactor: Use events to avoid circular deps for ws sync/gateway
2024-07-09 14:59:06 -04:00
John Colvin
36ab8492d3
refactor: Let caller specify nullability of T in json parse fn
2024-07-09 14:48:59 -04:00
John Colvin
54f37b2401
Merge remote-tracking branch 'origin/development' into development.ps_linux
2024-07-09 14:46:18 -04:00
Taha Afzal
5088b5ebe0
Fixing problems where PSS's client socket's IP was different than what the client was sending in PubSubClientSubscription
2024-07-08 23:09:53 +00:00
Taha Afzal
010dd3a26f
Fixing PubsubEchoTestStream
2024-07-07 06:13:22 +00:00
Taha Afzal
1a18755176
Added pss_echo()
2024-07-06 06:53:35 +00:00
Taha Afzal
233e2576af
Merging
2024-07-05 21:21:27 +00:00
Taha Afzal
543c655bca
src/DataStreamSuite/PubSub/ManagedTCP/AsyncTCPConnection_AsyncWrapper.cs
2024-07-05 21:13:36 +00:00
Taha
050e21e22b
Adding TableMetaDataStream
2024-07-04 23:39:04 -04:00
Taha Afzal
672ad6d237
Cleaning Config 1.0 (not completely done)
2024-06-30 23:17:20 -04:00
Taha
0a8f6e866f
Added pubsub routes to the Title of DSQA
2024-06-27 14:04:07 -04:00
Taha
b177ffef04
Fixing the bug where messages were being sent by the pubsubserver out of order
2024-06-27 00:17:22 -04:00
Taha
393f304be4
some buf gixes + cleanup
2024-06-26 00:23:19 -04:00
Taha
151816bf5e
PubSuMessageReactor empties the message queue (instead oif one elem ata a time) in the main loop
2024-06-24 02:29:28 -04:00
Taha
5cf7eacd82
Fixing the extra .0 in the default pubsub server routeplusfixing acorner cae issue of gettign a fast streaming data cakback after an unsubscribe
2024-06-24 00:28:07 -04:00
Taha
87b6a2044c
PubSubServer's linux issues fixed
2024-06-23 21:13:37 -04:00
John Colvin
5620f33524
vscode: Add task to view logs for last PubSubServer run
2024-06-08 14:42:13 +00:00
John Colvin
3b631e0d5f
Fix a couple more typos in logs
2024-06-07 16:35:06 +00:00
John Colvin
23d7d3775d
cleanup: Delete unused files
2024-06-07 10:40:34 -05:00
John Colvin
4940771166
fix: Don't login to sparkd from DSQA
2024-06-07 10:02:42 -05:00
John Colvin
8c797ee76b
Fix typo in log msg
2024-06-06 09:21:01 -05:00
John Colvin
ce80957d07
DSQA shouldn't connect to sparkd by default
2024-06-06 09:21:01 -05:00
John Colvin
c60018b59e
DataStreamPublisher shouldn't connect to sparkd by default
...
It only needs to connect to sparkd if it's publishing market data
2024-06-06 09:21:01 -05:00
John Colvin
3a27af87d1
PubSubServer shouldn't download config from sparkd by default
...
As far as I know, it only needs spark/protobuf config to initialize the
c++ logging system. Eventually, we should get rid of that dependency and
use builtin Microsoft Logging facilities for c# instead. In the
meantime, PubSubServer will load config from local files by default
(i.e., spark.conf).
2024-06-06 09:21:01 -05:00
John Colvin
068c1c6973
cleanup: Remove erroneous comment
2024-06-06 09:21:01 -05:00
John Colvin
4a2735839e
Change line endings to crlf in a few cs files
2024-06-06 09:21:00 -05:00
John Colvin
d2e9fe8237
Change line endings to crlf in a few cs files
2024-06-06 09:21:00 -05:00
John Colvin
cfc60766d8
Change line endings to crlf in a few cs files
2024-06-06 09:21:00 -05:00