Title says about all;
We are starting our cloud-hosting company at 2 sites, in the future it will be 3 sites in total. For now however, we start at 2 sites.
I have a SX1036 with dual PSU that I am using as my main switch for both sites. At each site i have 1x10gbe transit/internet, and 2x (redundand ) 10gbe wave interconnect between the sites.
My question; How will I connect both switches so I can live migrate vm's (Use RDMA) from one DC to another? Is there a max. distance that I can cross? How far is this distance?
How far can I go with 1310ns fiber using SX1036 / ConnectX-3 EN / VPI PRO without losing my RDMA capabilities?
Is the latency important? I am still choosing which area my colocation be in, and i am wondering if datacenters with short distance between eachother (Lets say 250microseconds, or 0.25ms) has any real benefits in terms of RDMA and general application-load balancing. If there is no real benefit in having sub 1ms latency between sites, instead of say 10ms I will consider going with long distance between my sites for geo-redundancy.
Can you guys advise me on the benefits of having multiple datacenters that are very close together, other than redundancy? Would you guys consider this to be a bad idea ? I'm guessing that DC's that are further away from eachother do have some benefits in terms of latency to clients/customers. This is a big plus ofcourse. The thing is though, I am using SSD, NVME and RAM only as storage, and my internal network is very low latency. My gut tells me I should try to also have a minimal latency between my DC's, but I cant really think of any major benefits that would justify not having a wider area of customers that I can offer sub 10ms services. Could you guys share your opinion on this subject?
Anyone managing multiple sites that can give me some advice?