John Colvin
2b80c79eae
check pt: Make subscriber core shared (so all observers see every update)
2025-12-05 15:56:24 +00:00
John Colvin
5a0b90278b
cleanup: Remove unused code
2025-12-05 15:56:23 +00:00
John Colvin
861f60a342
fix: Publish data for all subscribed tags (not just the first one)
...
Remove erroneous early return
2025-12-05 15:56:23 +00:00
John Colvin
23503c2d50
diag: Reduce log noise in pubsub
2025-12-05 15:56:23 +00:00
John Colvin
b7f600b968
diag: Use structured logging in pubsub/streams
2025-12-05 15:56:23 +00:00
John Colvin
25ae34b970
cleanup: Remove unused code
2025-12-05 15:56:23 +00:00
John Colvin
0f5fa229c3
cleanup: Remove unnecessary code from AsyncTCPConnectionAcceptor
2025-12-05 15:56:23 +00:00
John Colvin
a1e905cf0a
fix add pubsub service modules
2025-12-05 15:56:23 +00:00
John Colvin
9a3d996e71
fix: Use List instead of Array in WorkScheduler
...
I should have used a list in the first place...the array wasn't getting trimmed
after removing workers, which was causing null refs at the back of the array.
2025-12-05 15:56:23 +00:00
John Colvin
546a52cb02
feat: Add historic md streams and replay client
2025-12-05 15:56:23 +00:00
John Colvin
0571429375
refactor: Decouple ViewStreamDatabase from TableStream, ISubscriberCore
2025-12-05 15:54:03 +00:00
John Colvin
4b1f31f2b8
diag: Reduce log noise in AsyncTCPConnection_AsyncWrapper
2025-12-05 15:54:03 +00:00
John Colvin
d628f38bb1
diag: Assert that local ip address is successfully obtained
2025-12-05 15:53:32 +00:00
John Colvin
4ade38ef9a
improvement: Resolve hostnames when comparing ip addrs
...
So we can to configure pubsub routes by hostname or ipv4 (ipv6 hasn't
been tested yet...so we should assume it doesn't work).
2025-12-05 15:53:32 +00:00
John Colvin
0f9ea5139c
diag: Assert TcpConnection endpoint matches expected
2025-12-05 15:53:32 +00:00
John Colvin
789f74e3f6
diag: Catch exceptions on AsyncTCPConnector_AsyncWrapper bg thread
...
Since it spawns a new thread on each attempt, uncaught exceptions were
previously undetected, and caused silent failures down the pipe. This
should make it easier to track such bugs down.
2025-12-05 15:53:32 +00:00
John Colvin
75d95080b7
fix: Format PubSubRoute as json in log msgs
...
It was previously using the default ToString, which simply returns the type name
2025-12-05 15:53:32 +00:00
John Colvin
d7b0296fbe
refactor: Run RemoteQueryManager as an IHostedService
...
This paradigm more accurately represents the RemoteQueryManager as a
Service that can be started/stopped.
2025-12-05 15:53:32 +00:00
John Colvin
a8fc2a6179
fix: Catch exception when creating TcpClient
2025-12-05 15:53:31 +00:00
John Colvin
061f323026
fix: Make SystemSubscriptionMapPublisher threadsafe
...
The PubSubState.onTagMapChanged event may not be invoked on
the same thread as doWork.
2025-12-05 15:53:31 +00:00
John Colvin
5f517e4a7c
improvement: Reduce task wait/timeout code in AsyncTCPConnector
2025-12-05 15:53:31 +00:00
John Colvin
a04fb84656
diag: Assert System publishers 'doWork' is always called on same thread
2025-12-05 15:53:31 +00:00
John Colvin
5061a1bbd7
cleanup: Remove unused PubSubConfig props
2025-11-30 16:44:31 +00:00
John Colvin
f6aec08919
fix: Always call 'handle_internal_pubs' in PubSubMessageReactor main loop
2025-11-30 16:44:31 +00:00
John Colvin
6889a971ff
refactor: Add DataStreamPublisher service modules for Dependency Injection
...
* Change DataStreamPublisher json fields to match cs class property names verbatim
* Rename Publishers -> PublisherNodes in DataStreamPublisherConfig
2025-11-30 16:44:31 +00:00
John Colvin
c5f4d146f3
refactor: Add PubSub service modules for Dependency Injection
...
* Get rid of JsonPropertyName attributes in PubSubConfig
- The Dependency Injection framework (based around dotnet ApplicationBuilder)
does not support this attribute, and maps property names verbatim to json fields.
* Change PubSubServer json fields to match cs class property names verbatim
2025-11-30 16:44:31 +00:00
John Colvin
414ced01ee
refactor: Decouple RemoteQueryManager from IManagedSubscriber, IPubTableBroker impl
2025-11-30 16:44:20 +00:00
John Colvin
1fb8cf6220
refactor: Decouple ManagedSubscriber from ISubscriberCore impl
2025-11-30 16:44:20 +00:00
John Colvin
79b17579c3
refactor: Only support 1 tag type in IPubSubServerTagHandler
2025-11-30 16:44:20 +00:00
John Colvin
bbf1e87766
cleanup: Remove unused pubsub tag handler code
...
* Removed 'IPubSubServerTagHandler.register'
- All implementations of this function were empty
* Removed 'IPubSubServerTagHandler.supportedTagTypes'
- This property wasn't referenced anywhere
* Remove IWorker inheritance from IPubSubServerTagHandler
- No reason these interfaces have to be tied together
2025-11-21 14:55:01 -05:00
John Colvin
366769a778
chore: Fix typos in log msgs
...
* Bad string interopolation syntax
2025-11-21 14:55:01 -05:00
John Colvin
a76cbafdbd
cleanup: Fix numerous build warnings in DataStreamSuite
...
Nearly all warnings were due to nullability issues, since the concept of
nullable reference types did not exist when the DataStream code was
originally written.
* Compression related files
- BZip2InputStream (disable nullability warnings)
- BZip2OutputStream (disable nullability warnings)
- DeflaterHuffman (disable nullability warnings)
- Inflater (disable nullability warnings)
- InflaterDynHeader (disable nullability warnings)
- ParallelJoinTest (disable nullability warnings)
- TarHeader
- TarInputStream (disable nullability warnings)
- ZipEntry
- ZipFile
- ZipInputStream
* AsyncTCPConnection_APM
* AsyncTCPConnection_APM
* InflaterHuffmanTree
* ManagedSubscriber
* ManagedTCPMessageHub
* MapStream
* PubSubClientMessage
- Normalize indentation/whitespace
- Fix some typos
- Address nullability issues to fix build warnings
- Modernize code
* PubSubMessageReactor
* PubSubServerManagedTCPConnection
* PubSubSingleTagStateEvent
* PubSubState
* PublisherCore
* PubsubDeserializationController
* RemoteMessage
- make 'message' nullable to resolve warnings elsewhere (in calling code)
* SharedStreamConfig
* SingleTagData
* SubscriberCore
* SuperMapStream
* SystemHeartbeatPublisher
* SystemStatsPublisher
* ThreadSafeQueue
* TradeBarsStream
fix build (warn): Only use Registry on windows
2025-11-21 14:54:58 -05:00
John Colvin
a442e27d3d
cleanup: Modernize PubSubRoute code, json parsing
2025-11-21 14:20:49 -05:00
John Colvin
2014931653
feat: Add live bbo stream
2025-11-19 10:33:31 -05:00
John Colvin
043efab5a2
build: Upgrade c# to net8.0
2025-04-28 17:12:58 +00:00
John Colvin
37e5003cf9
Merge remote-tracking branch 'origin/development.ps_linux' into development
2024-09-19 05:40:59 +00:00
Taha
b68fceb362
Cleaning up FileStreams
2024-08-21 16:11:57 -04:00
Taha
7e219aec7c
Merging
2024-07-17 02:06:17 -04:00
Taha
f06beff22f
Added new benzinga streams
2024-07-17 02:02:01 -04:00
Taha Afzal
6aa39a716a
PubSubSingleTagState is not needed any more
2024-07-16 01:15:51 +00:00
Taha Afzal
5088b5ebe0
Fixing problems where PSS's client socket's IP was different than what the client was sending in PubSubClientSubscription
2024-07-08 23:09:53 +00:00
Taha Afzal
233e2576af
Merging
2024-07-05 21:21:27 +00:00
Taha Afzal
543c655bca
src/DataStreamSuite/PubSub/ManagedTCP/AsyncTCPConnection_AsyncWrapper.cs
2024-07-05 21:13:36 +00:00
Taha Afzal
672ad6d237
Cleaning Config 1.0 (not completely done)
2024-06-30 23:17:20 -04:00
Taha
b177ffef04
Fixing the bug where messages were being sent by the pubsubserver out of order
2024-06-27 00:17:22 -04:00
Taha
393f304be4
some buf gixes + cleanup
2024-06-26 00:23:19 -04:00
Taha
151816bf5e
PubSuMessageReactor empties the message queue (instead oif one elem ata a time) in the main loop
2024-06-24 02:29:28 -04:00
Taha
5cf7eacd82
Fixing the extra .0 in the default pubsub server routeplusfixing acorner cae issue of gettign a fast streaming data cakback after an unsubscribe
2024-06-24 00:28:07 -04:00
Taha
87b6a2044c
PubSubServer's linux issues fixed
2024-06-23 21:13:37 -04:00
John Colvin
3b631e0d5f
Fix a couple more typos in logs
2024-06-07 16:35:06 +00:00