Analysis of the Current Coherent Optical Module Market

Researchers have made great progress in optical devices. The output power of laser, linewidth, stability and noise, as well as the bandwidth of photodetectors, power capacity and common mode rejection ratio have been greatly improved. Microwave electronic devices have also been greatly improved. Then, the coherent optical communication technology has gradually become an important capacity-lifting solution for the current 100G line-side.

Market Demand for Coherent Optical Communication

One of the biggest drivers of growth in the current communications market is the transition from 10G to 100G in the metro, core and Data Center Interconnect (DCI) sectors.

With the explosive growth of information generated by the use of communication technologies such as video conferencing and the spread of the Internet, the market has proposed higher transmission performance requirements for the physical layer that is the basis of the entire communication system.

OSNR: 16QAM vs. 64QAM

In terms of digital communication, how to expand the capacity of C-band amplifiers, overcome the deterioration of fiber dispersion effects, and increase the capacity and range of free-space transmission have become important considerations for researchers; in analog communication, sensitivity and dynamic range are key parameters of systems.

Driven by strong demand, large-scale DWDM systems are gradually depleting their wavelength resources, and the efficiency of Time-Division Multiplexing (TDM) systems through compressed optical pulses also has a large technical bottleneck. People began to consider replacing the original Wavelength Division Multiplexing (WDM) system with a coherent optical communication system.

Advantages of Coherent Optical Modules

The coherent optical communication system modulates the signal to the optical carrier by adjusting the amplitude, phase and frequency by means of external light modulation (such as DP-QPSK) at the transmitting end.

Compared with the traditional direct detection system, coherent detection can obtain more signal information through the signal light and the beat frequency of the local oscillator; after the signal reaches the receiving end, it uses high-speed Digital Signal Processing (DSP) technology to perform front-end processing such as equalization. The optical mixer and the optical signal generated by the local oscillator are coherently mixed to realize signal reconstruction and distortion compensation.

Baud rates: QPSK vs. DP-QPSK

Coherent optics can be used in both 100G and 400G applications, primarily because it enables service providers to send more data over existing fiber, reducing the cost and complexity of network upgrades for bandwidth expansion.

  1. Coherent detection combined with DSP technology:
    • Cleared barriers to traditional coherent reception
    • Compensate for various transmission impairments in the electrical domain, simplifying transmission links
    • Make high-order modulation formats and polarization states possible
  2. At the same time, the application of high-order modulation formats enables coherent optical communication to have higher single-wavelength channel spectrum utilization compared to traditional system systems.
    Coherent receivers have no special requirements for fiber channel, so coherent optical communication can use already laid fiber lines. With the aid of digital signal processing algorithms, coherent receivers compensate for signal distortion caused by fiber dispersion, polarization mode dispersion, and carrier phase noise at a very small cost.
  3. A coherent receiver is about 20 dB more sensitive than a normal receiver, so the distance that is not relayed in the transmission system becomes longer, which reduces the number of amplifications in the transmitted light path.

Based on the above reasons, coherent optical communication can reduce the cost of optical fiber erection for long-distance transmission, simplify optical path amplification and compensation design, and become the main application technology of current long-distance transmission network.

Application Scenarios of Coherent Optical Modules

At present, the coherent optical communication is mainly used on the line side of the backbone network and the metropolitan area network, and belongs to the technical research field of DWDM long-distance transmission. In the application scenarios of the metropolitan area network and the core network with distance more than 80km, the coherent optical communication features good performance of Optical Signal-to-Noise Ratio (OSNR), sensitivity, dispersion tolerance and so on.

Coherent Applications: DWDM Long-Haul Transmission

WDM System

The operating wavelength range is C-band (1530nm to 1565nm), and the fiber type is G.652D (prefered) or G.655. The key performance index is OSNR.

Error correction coding technology can jump out of the limitations of the physical layer of transmission, and compensate for all physical transmission impairments at the logic layer, especially the effects of nonlinear effects.

Coherent Applications

5G Middlehaul/Backhaul Network

In the 5G middlehaul scenario, 100G/200G DWDM system will be deployed, and the 100G CFP-DCO and 200G CFP2-DCO optical module can be used to implement the 80km scene application; the 400G DCO product is applied in the 5G backhaul scenario with distance less than 200km.

DCI

Whether the coherent communication will be used in the DCI field of 40km to 80km depends mainly depends on the commercial cost performance and whether the market capacity is large enough.

At the current 100G rate, products such as 100G ER with EML modulation are sufficient for the use; the 100G CFP-DCO ZR series will appear in the future.

Coherent Applications: Bandwidth by Speed

The OIF organization is developing a 400ZR specification that uses a combination of DWDM and coherent technology.

Andrew Schmitt, principal analyst at Cignal AI, said: “Coherent 400G will limit the development of existing 200G and 100G technologies by 2020, and new devices will maximize optical capacity without relying on coverage.” Foreseeable Yes, more and more 400ZR products will enter the market.

Summary

The coherent optical communication system is a more advanced and complex optical transmission system suitable for longer distance and larger capacity information transmission.

At present, coherent modules with the CFP form-factor are bulky and consume large power. Compact coherent modules will replace existing coherent products. The innovation of semiconductor technology and the improvement of chip technology will greatly promote the replacement of 400G coherent products.

In recent years, Gigalight, a global optical interconnect innovator, has increased its research and development of coherent modules and has achieved a series of achievements. In the next few years, it will strengthen cooperation with the industry and jointly promote the progress of related industries.

Source: Analysis of the Current Coherent Optical Module Market

QSFP-DD, OSFP, and CFP8: Which Is the Best for 400G?

There are three criteria for a successful form-factor: small size, low power consumption, and interoperability between all systems vendors. As we all know, the SFP/SFP+ and QSFP+/QSFP28 are successful form-factors for 1G/10G and 40G/100G networks. In fact, for 100G networks, there are 4 different form-factors: CFP, CFP2, CFP4, and QSFP28.

100G form-factors: CFP vs. CFP2 vs. CFP4 vs. QSFP28

100G form-factors: CFP vs. CFP2 vs. CFP4 vs. QSFP28

100G

The transmission departments in telecommunication networks need a pluggable transceiver able to cover long reach also using some dedicated technologies such as Coherent detection, while data centers need a small form-factor with the lowest power consumption and the lowest cost per unit due to their application is for short reach only (max 2km generally).

During the first instances of the 100G transceivers, the CFP form-factor was preferred because it was impossible to make a transceiver less than 12W power consumption, even for intermediate reach. Once the technology and components availability were better, it was then feasible to CFP2, and then CFP4. Still today, the Coherent technology for 100G and 200G is only available on CFP and CFP2 form-factors.

In parallel, the GAFA (Google, Apple, Facebook, and Amazon) with their phenomenal need for additional data center capacity, have pushed the QSFP28 form-factor for various short reach applications such as DAC, AOC, SR4, PSM4, and CWDM4.

Today, with the technology maturity and QSFP28 wide-adoption, most of the 100G applications are available on QSFP28 form-factor, with some exceptions for reach more than 40km, including Coherent detection.

400G

For 400G bit-rate, some essentials interrogations must be raised before going deeper into the subject:

  1. Who need the 400G transceivers?
  2. For which application?
  3. How about technology maturity?
  4. Any interoperability with former form-factors?

Following the market situation, 400G is a priority for the intra-connections in large data centers and at a lower scale for the transmission department in telecommunication networks. Because the 400G bit-rate requires PAM4 modulation, the reach is becoming more and more challenging and is limited to a few kilometers only. Longer reach will require Coherent detection technology and/or amplification, dispersion compensation, etc.

Again, we will observe a similar scenario: for 400G networks, a dedicated form-factor for the data center intra-connection (Intra-DC) and another one for transmission. However, thankfully it seems that “intermediate” form-factors won’t happen for 400G.

Intra-DC

400G is coming with 2 form-factors for Intra-DC: QSFP56-DD (QSFP-DD for QSFP Double Density) and OSFP (Octal SFP). Both form-factors are running 8 lanes of 50G PAM4 on the electrical side while the optical side can be either 8 lasers of 50G PAM4 or 4 lasers of 100G PAM4. In the 4-laser design, a “gearbox” is added to convert the PAM4 electrical signal from 8x50G to 4x100G.

The QSFP-DD is defined by the QSFP-DD MSA while the OSFP is defined by the OSFP MSA. They are similar but have three key differences:

  1. OSFP allows more power (15W) than QSFP-DD (12W) so that the OSFP allows an early adoption because it’s easier to release a technology designed for 15W than 12W.
  2. QSFP-DD port is backward compatible with QSFP including 40G QSFP+, 100G QSFP28, and 200G QSFP56, while OSFP port requires a QSFP to OSFP adapter.
  3. OSFP integrates thermal management directly into the form factor, but QSFP-DD does not.

400G form-factors: QSFP56-DD vs. OSFP

400G form-factors: QSFP56-DD vs. OSFP

Both QSFP-DD and OSFP are designed for intra-DC applications including DAC, AOC and optical connection up to 2km. Additional variants will come for other applications such as Data Center Interconnect (DCI) with longer reach and other technology like DWDM super channel.

Transmission

The CFP8 form-factor, defined by the CFP MSA, is radically different compared to QSFP-DD and OSFP as:

  1. It allows up 24W power consumption.
  2. It has 16x25G NRZ on the electrical side instead of 8x50G PAM4 for QSFP-DD and OSFP.
  3. It has an MDIO management interface instead of I2C for QSFP-DD and OSFP.

With its large space and max 24W power consumption, the CFP8 is intended for transmission application. Available in an initial version of 10km, it has 16 electrical lanes of 25G NRZ which are converted to 8 lanes of 50G PAM4.

However, other variants are coming for longer reach, including Coherent detection technology. A version called CFP8 ZR (80km) will come at a later stage but it also opens the door for a CFP8 800G! By using the 16 electrical lanes and apply a 50Gbps PAM4 signal, it is feasible to reach 800G; then adding a DSP, Coherent detection and multiplexing lasers will enable the optical transmission. Clearly, this is not for today yet.

400G form-factors: QSFP56-DD vs. OSFP vs. CFP8

400G form-factors: QSFP56-DD vs. OSFP vs. CFP8

For 400G applications, others form-factors than the one listed above are also available, but for dedicated applications. We can list the COBO (Consortium for On-Board Optics) and the CDFP for cable application enabling 16 electrical lanes of 25Gbps.

Originally published at QSFP-DD, OSFP, and CFP8: Which Is the Best for 400G?.

The Technologies of Next-Generation Optical Transceivers — PAM4 and 64QAM

PAM4 and 64QAM Technologies

PAM4 and 64QAM Technologies

The shift to cloud services and virtualized networks has put the data center in the middle of our world and meant that connectivity within data centers and between data centers has a huge impact on the delivery of business and personal services. Hyperscale data centers are being installed across the world and these all need connecting. To meet this demand, optical transceiver suppliers are delivering new solutions based on PAM4 and 64QAM, providing coherent modulation that will drive down the cost of connectivity and increase the bandwidth of each connection.

Connections to many servers are already 25G and links between switches in large data centers are already 100G. The introduction of SFP28 and QSFP28 transceivers integrating new technologies and built using efficient manufacturing techniques has driven down the cost of these connections and allowed massive growth in the market. The next stage is the introduction of 100G single lambda solutions and cost-effective 400G transceivers for links between switches. The PHY devices needed for this next step are already becoming available, 12.8T switch devices are in production, and the first 400G QSFP-DD and OSFP optical transceivers are sampling.

QSFP-DD

The rise of the hyperscale data center operator has dramatically changed the market. The switch to 25G and 100G from 10G and 40G has happened very quickly. The sheer scale and numbers of data centers being installed or upgraded means that the new technologies can be shipped in volume as soon as the price is right, the components have been qualified, and the production lines are operational. We are now seeing the first 400G PHY devices and optical transceivers for data centers becoming available and companies are vying for market position as we wait for the leading hyperscale operators to commit to large deployments.

Many of those companies that have benefited from 25G and 100G are putting their investments into single lambda PAM4 100G and 400G solutions for the data center. This has required new PAM4 PHY devices designed to meet the power constraints of 400G OSFP and QSFP-DD transceivers. A few companies have also invested in 50G and 200G PAM4 PHYs, enabling a cost-effective upgrade from 25G and 100G. 50G SFP56 and 200G QSFP56 transceivers are expected to be interim solutions, but it is unclear how widespread their use will be or for how long. 40G was an interim solution that lasted for many years.

Coherent technology, originally developed for 100G long-haul networks, is now widely used for long-haul connections, including subsea, metro networks, and Data Center Interconnect (DCI) between data centers. The market for DCI has grown rapidly, with many systems vendors offering solutions with 80km to 500km reach. For long-haul and metro applications, several leading equipment manufacturers continue to use in-house coherent Digital Signal Processor (DSP) designs. Coherent DSP solution is now available to optical transceiver vendors such as Gigalight that is going to ship 400G transceivers based on this design. The latest DSP ASICs are enabling 600G (64Gbaud 64QAM) solutions and CFP2-DCO transceivers. The next step is the introduction of the 7nm DSPs that will enable the cost-effective 400G ZR transceivers planned for 400G links up to 100km starting in 2020.

This continues to be a market in flux. Lumentum has completed the acquisition of Oclaro, Cisco has completed the acquisition of Luxtera, and several Chinese optical transceiver vendors have joined the charge to 400G in the data center. The PAM4 PHY devices required for 100G single lambda and 400G in the data center are proving to be very challenging to deliver. PAM4 PHY solutions in 28nm and 14/16nm technology have been sampling for more than six months and these are now being joined by 7nm solutions.

Related articles: PAM4 — The High-Speed Signal Interconnection Technology of Next-Generation Data Center

PAM4 — The High-Speed Signal Interconnection Technology of Next-Generation Data Center

What Is PAM4?

PAM4 (4-Level Pulse Amplitude Modulation) is one of PAM modulation technologies that uses 4 different signal levels for signal transmission. Each symbol period can represent 2 bits of logic information (0, 1, 2, 3), that is, four levels per unit time.

In the data center and short-distance optical fiber transmission, the modulation scheme of NRZ is still adopted, that is, the high and low signal levels are used to represent the (1, 0) information of the digital logic signal to be transmitted, and one bit of logical information can be transmitted per signal symbol period.

However, as the transmission rate evolves from 28Gb/s to a higher rate, the electrical signal transmission on the backplane will cause more severe loss to the high-frequency signal, and higher-order modulation can transmit more data in the same signal bandwidth. Therefore, the industry is increasingly calling for higher-order PAM4 modulation. The PAM4 signal uses four different signal levels for signal transmission, and each symbol period can represent 2 bits of logical information (0, 1, 2, 3). Since the PAM4 signal can transmit 2 bits of information per symbol period, to achieve the same signal transmission capability, the symbol rate of the PAM4 signal only needs to reach half of the NRZ signal, so the loss caused by the transmission channel is greatly reduced. With the development of future technologies, the possibility of using more levels of PAM8 or even PAM16 signals for information transmission is not ruled out.

NRZ vs. PAM4: The comparison of waveforms and eye diagrams between NRZ and PAM4 signals

And then, if the optical signal can also be transmitted by using the PAM4, the clock recovery and pre-emphasized PAM4 signal can be directly realized when the electro-optical transmitting is performed inside the optical module, therefore, the unnecessary step of converting the PAM4 signal into the NRZ signal of 2 times the baud rate and then performing related processing is eliminated, thereby saving the chip design cost.

Why PAM4?

The end-to-end transmission system includes fiber optic and fiber-optic transmission systems. Since the fiber transmission can easily reach the rate of 25Gbd so that the research progress of transmitting PAM4 on the fiber has been progressing slowly. For fiber-optic transmission systems, from NRZ moving to PAM4 is considered in terms of cost. If you do not need to consider the cost, there are other related modulation technologies can be used in the long-distance range, such as DP-QPSK, which can transmit the baud rate signal above 50Gbd for several thousand kilometers. However, in the data center field, the transmission distance is generally only 10km or less. If the optical transceiver using PAM4 technology is adopted, the cost can be greatly reduced.

For 400GE, the largest cost is expected to be optical components and related RF packages. PAM4 technology uses four different signal levels for signal transmission. It can transmit 2 bits of logic information per clock cycle and double the transmission bandwidth, thus effectively reducing transmission costs. For example, 50GE is based on a single 25G optical device, and the bandwidth is doubled through the electrical layer PAM4 technology, which effectively solves the problem of high cost while satisfying the bandwidth improvement. The 200GE/400GE adopts 4/8 channel 25G devices, and the bandwidth can be doubled by PAM4 technology.

For data center applications, reducing the application of the device can significantly reduce costs. The initial goal of adopting higher order modulation formats is to place more complex parts on the circuit side to reduce the optical performance requirements. The use of high-order modulation formats is an effective way to reduce the number of optics used, reduce the performance requirements of optics, and achieve a balance between performance, cost, power, and density in different applications.

In some application scenarios, high-order modulation formats have been used for several years on the line side. However, since the client side needs are different from the line side, so other considerations are needed.

For example, on the client side, the main consideration is the test cost, power consumption and density. On the line side, spectrum efficiency and performance are mainly considered, and cost reduction is not the most important consideration. By using linear components on the client side and the PAM4 modulation format that is directly detected, companies can greatly reduce test complexity and thus reduce costs. Among all high-order modulation formats, the lowest cost implementation is PAM4 modulation with a spectral efficiency of 2 bits/s/Hz.

PAM4

Conclusion

As a popular signal transmission technology for high-speed signal interconnection in next-generation data centers, PAM4 signals are widely used for electrical and optical signal transmission on 200G/400G interfaces. Gigalight has a first-class R&D team in the industry and has overcome the signal integrity design challenges of PAM4 modulation. Gigalight’s 200G/400G PAM4 products include 200G QSFP56 SR4, 200G QSFP56 AOC, 200G QSFP56 FR4, 400G QSFP56-DD SR8, 400G QSFP56-DD AOC, etc.

All of the PAM4 products from Gigalight can be divided into digital PAM4 products and analog PAM4 products. The digital PAM4 products adopt DSP solutions which can support a variety of complex and efficient modulation schemes. The electric port has strong adaptability and good photoelectric performance. And the analog PAM4 products simulate CDR with low power consumption and low cost. Gigalight always adheres to the concept of innovation, innovative technology, and overcomes difficulties. It invests a lot of human resources and material resources in the research and development of next-generation data center products.

Originally published at morph.tilda.ws

Which Is Better for 80km Links? PAM4 or Coherent Technology

A significant portion of Data Center Interconnections (DCIs) and telecom router-to-router interconnections rely on simple ZR or 80km transceivers. The former is mostly based on 100Gbps per 100GHz ITU-T window C-band DWDM transceivers, while the latter is mostly 10G or 100G grey wavelength transceivers. In DWDM links, the laser wavelength is fixed to a specified grid, so that with DWDM Mux and Demux 80 or more wavelength channels can be transported through a single fiber. Grey wavelengths are not fixed to a grid and can be anywhere in the C-Band, limiting capacity to one channel per fiber. DCI links tend to use DWDM because they have to utilize the optical fiber bandwidth as much as possible due to the extremely high-volume traffic between data centers.

Another emerging 80km market is the Multi-System Operator (MSO) or the CATV optical access networks. This need emerges because MSOs are running out of their access optical fibers and they need a transmission technology which would allow them to grow to a very large capacity by using the remaining fibers. For this reason they need to use DWDM wavelengths to pack more channels in a single fiber.

The majority of the 10G transceivers on 80km links will be replaced by 100G or 400G transceivers in the coming years. For that to happen, there are two modulation techniques to enable 80km 100G transceivers.

  • 50G PAM4 with two wavelengths in a 100G transceiver
  • Coherent 100G dual-polarization Quadrature Phase Shifted Keying (DP-QPSK)

Generally speaking, PAM4 is a low-cost solution but require active optical dispersion compensation (which could be a big headache as well as extra expense to data center operators) and extra optical amplification to compensate for the dispersion compensators. By contrast, Coherent approaches do not need any dispersion compensation and the price is coming down rapidly, especially when the same hardware can be configured to upgrade the transmission data rate per wavelength from 100G to 200G (by using DP-16QAM modulation).

When 400G per wavelength is needed in a DCI network within a 100GHz ITU-T window, coherent technology is the only cost-effective solution, because it will not be feasible for PAM4 to achieve the same high spectral efficiency of 4 bit/sec/Hz.

On the standards front, many standards organizations are adopting coherent technology for 80km transmission. The Optical Inter-networking Forum (OIF) will adopt coherent DP-16QAM modulation at up to 60Gbaud (400G per wavelength) in an implementation agreement on 400G ZR. This is initially for DCI applications with a transmission distance of more than 80km, and vendors may come up with various derivatives for longer transmission distances. Separately, CableLabs has published a specification document for 100G DP-QPSK coherent transmission over a distance of 80km aimed at MSO applications. In addition, IEEE802.3ct is in the process of adopting coherent technologies for 100G and 400G per wavelength transmissions over 80km.

As data rates increase from 100G to 400G and capacity requirements per fiber are driven by DCI needs, and assisted by volume driven cost reductions in coherent optics and in coherent DSPs, we expect coherent transmission to be the technology of choice for 80km links.

What is Data Center Interconnect/Interconnection?

Data Center Interconnection means the implements of Data center Interconnect (DCI) technology. With the DCI technology advances, better and cheaper options have become available and this has created a lot of confusion. This is compounded by the fact that a lot of companies are trying to enter this market because there is a lot of money to be made. This article is written to straighten out some of the confusion.

According to the different applications, there are two parts of data center interconnections. The first is intra-Data Center Interconnect (intra-DCI) which means connections within the data center. It can be within one building or between data center buildings on a campus. Connections can be a few meters up to 10km. The second is inter-Data Center Interconnect (inter-DCI) which means connections between data centers from 10km up to 80km. Of course, connections can be much longer but most of the market activity for inter-DCI is focused on 10km to 80km. Longer connections are considered Metro or Long-haul. For reference, please see the table below.

DCI Distance Fiber Type Optics Technology Optical Transceivers
intra-DCI 300m MMF NRZ/PAM4 QSFP28 SR4
500m SMF QSFP28 PSM4
2km QSFP28 CWDM4
10km QSFP28 LR4
inter-DCI 10km SMF Cohernet QSFP28 4WDM-10
20km QSFP28 4WDM-20
30km to 40km QSFP28 4WDM-40
80km to 2000km CFP2-ACO

Intra-DCI

The big bottlenecks are in the intra-DCI and therefore, the highest volume of optical transceivers are sold here generating the most revenue, however, it is low margin revenue because there is so much competition. In this space, may of the connections are less than 300m and Multi-Mode Fiber (MMF) is frequently used. MMF is thicker, and components are cheaper because the tolerances are not as tight, but the light disperses as it bounces around in the thick cable. Therefore, 300m is the limit for many types of high speed transmission that use MMF. There is a data center transceiver with a transmission distance up to 100m over OM4 MMF for example.

Gigalight 100GBASE-SR4 100m QSFP28 Optical Transceiver

100G QSFP28 SR4 for MMF up to 100m

In a data center, everything is connected to servers by routers and switches. Sometimes a data center can be one large building bigger than a football field and other times data centers are built on a campus of many buildings spanning many blocks. In the case of a campus, the fiber is brought to one hub and the connections are made there. Even if the building you want to connect to might be 200m away, the fiber runs to a hub, which can be more than 1km away, so this type of routing increases the fiber distance. Some of the distances between buildings can be 4km, requiring Single Mode Fiber (SMF), which has a much narrower core, making it more efficient, but also increasing the cost of all related components because the tolerances are tighter. Therefore, with data centers growing, so has the need for SMF as the connections get longer within the data center. With SMF you have the option to drive high bandwidth with coherent technology, and we’ll see more of this in the future. Previously coherent was only used for longer distances, but with cost reductions and greater efficiency versus other solutions, coherent is now being used for shorter reaches in the data center.

Gigalight 100GBASE-LR4 Lite 4km QSFP28 Optical Transceiver

100G QSFP28 LR4L for SMF up to 4km

500m is a new emerging market and because the distance is shorter, a new technology is emerging, and that is silicon photonics modulators. EMLs (Externally Modulated Lasers) perform modulation within the laser, but with silicon photonics, the modulator is outside the laser and it’s a good solutions for distances of 500m. In an EML, the modulator is integrated into the same chip, but is outside the laser cavity, and hence is “external”. For silicon photonics, the laser and modulator are on different chips and usually in different packages. Silicon photonics modulators are based on the CMOS manufacturing process that is high scale and low cost. A continuous wave laser with silicon photonic modulation is very good for 500m applications. EMLs are more suitable for longer reaches, such as 2-10km. Therefore, with data centers growing, so has the need for single mode fiber as the connections get longer within the data center. With SMF you have the option to drive high bandwidth with coherent technology, and we’ll see more of this in the future. Previously coherent was only used for longer distances, but with cost reductions and greater efficiency versus other solutions, coherent is now being used for shorter reaches in the data center.

100GE PSM4 2km QSFP28 Optical Transceiver

100G QSFP28 PSM4 for SMF up to 500m/2km

100GE CWDM4 2km QSFP28 Optical Transceiver

100G QSFP28 CWDM4 for SMF up to 2km

100GBASE-LR4 10km QSFP28 Optical Transceiver

100G QSFP28 LR4 for SMF up to 10km

Inter-DCI

Inter-DCI is typically between 10km and 80km, including 20km and 40km. Before we talk about data center connectivity, let’s talk about why data centers are set up the way they are and why 80km is such an important connection distance. While it is true that a data center in New York might backup to tape in a data center in Oregon, this is considered regular long-haul traffic. Some data centers are geographically situated to serve an entire continent and others are focused on a specific metro area. Currently, the throughput bottleneck is in the metro and this is where data centers and connectivity are most needed.

100GE 4WDM-20 20km QSFP28 Optical Transceiver

100G QSFP28 4WDM-20 for SMF up to 20km

100GE 4WDM-40 40km QSFP28 Optical Transceiver

100G QSFP28 4WDM-40 for SMF up to 40km

Say you have a Fortune 100 retailer and they are running thousands of transactions per second. The farther away a data center is, the more the data is secure because the data center is so far away and separate from natural disasters, but with the increased distance there are more “in flight” transactions are at risk of being lost due to latency. Therefore, for online transactions there might be a primary data center that is central to retail locations and a secondary data center that is around 80km away. It’s far enough away not to be affected by local power outages, tornadoes, etc, but close enough that there is only a few hundred milli-seconds of latency; therefore, in the worst case a small number of transactions would be at risk.

In another example of inter-DCI, as if a certain video is getting a lot of views, the video is not only kept in its central location, but copies of the video are pushed to metro data centers where access is quicker because it’s stored closer to the user, and the traffic doesn’t tie up long haul networks. Metro data centers can grow to a certain size until their sheer size becomes a liability with no additional scale advantage and thus they are broken up into clusters. Once again, to guard against natural disasters and power outages, data centers should be far away. Counterbalancing this, data centers need to have low latency communication between them, so they shouldn’t be too far away. There is a compromise and the magic distance is 80km for a secondary data center, so you’ll hear about 80km data center interconnect a lot.

It used to be that on-off keying could provide sufficient bandwidth between data centers, but now with 4K video and metro bottlenecks, coherent transmission is being used for shorter and shorter distances. Coherent is likely to take over the 10km DCI market. It has already taken over the 80km market but it might take time before coherent comes to 2km. The typical data center bottlenecks are 500m, 2km, and 80km. As coherent moves to shorter distances, this is where the confusion comes.

The optical transceiver modules that were only used within the data center are gaining reach, and they’re running up against coherent solutions that were formerly only used for long distances. Due to the increasing bandwidth and decreasing cost, coherent is being pulled closer into the data center.

The other thing to think about is installing fiber between data centers. Hopefully this is already done, because once you dig, it’s a fixed cost, so you put down as many fibers as you can. Digging just for installing fiber is extremely expensive. In France when they lay fiber, they use another economic driver. Whenever you put in train tracks, you put in fiber at the same time, even if it is not needed. It’s almost for free because they are digging anyway. Fibers are leased to data centers one at a time; therefore, data centers try to get as much bandwidth as possible onto each fiber (this is also a major theme in the industry). You might ask, why not own your own fiber? You need to have a lot of content to own your own fiber. The cost is prohibitive. In order to make the fiber network function, all the nodes need to use the same specification and this is hard. Therefore, carriers are usually the ones to install the full infrastructure.

Article Source: John Houghton, a Silicon Valley entrepreneur, technology innovator, and head of MobileCast Media.