Symbol Management

Each exchange provides different methods for querying available symbols—some via WebSockets and others via REST protocols. To manage symbols across multiple exchanges, create a service that periodically queries available instruments and stores them in a database. This approach enables selective inclusion or exclusion of specific symbols.

For example, in the stock market, there are roughly 50,000 instruments you can get data for. Most people will not require all of these. If you reduce your list down to just stocks and ETFs, you can reduce your list to under 15000 which will simplify your life greatly.

Kubernetes

You should have a main and develop environment where this service runs. It should store your data into PostGreSql in your mangement layer.