Three outside services the overlay depends on
A WAN Edge that works in the lab often fails at a real branch for reasons outside SD-WAN. The branch sits behind a router or firewall that translates addresses, the Validator is given by name, and a firewall policy was written long before anyone had heard of the fabric. All three sit between the router and its peers. This lesson covers what each one changes and how to see it.
NAT and the public address
With NAT, the address on BR-01's interface is not the address that others see. Suppose its internet interface is 192.168.10.2, translated to 203.0.113.10 by the ISP's equipment. If BR-01 advertised 192.168.10.2, HUB-01 would send tunnel packets to an address it cannot reach. Instead, the fabric finds the translated address.
On small screens, swipe sideways or focus the diagram and use the arrow keys.
- BR-01 contacts the Validator. The Validator sees the source address and port after translation.
- The Validator reports it back. BR-01 now knows its public address and port.
- The TLOC carries both. BR-01 advertises its private and its public address in the TLOC route, as the TLOC lesson describes.
- Peers aim at the public address. For a public colour, HUB-01 sends tunnel packets to 203.0.113.10 and the port shown. The NAT device allows them in because BR-01's own traffic created the translation.
The translation is kept alive by traffic. If it expires, packets from peers no longer reach the router until BR-01 sends again; BFD packets in the tunnel normally keep it open. That is one reason tunnels over NAT are checked with BFD and not only with a ping.
On small screens, swipe sideways or focus the diagram and use the arrow keys.
DNS
DNS appears at the start of the connection. If the Validator is configured by name, the router resolves it through a DNS server reachable from the transport VPN, and every transport that is meant to bring up control connections needs a working resolver. If the Validator is given as an address, this step is skipped. Zero-touch onboarding also uses a name for a cloud redirection service; the onboarding guide gives the name and what has to be permitted, so check it for your release.
On small screens, swipe sideways or focus the diagram and use the arrow keys.
ip name-server 198.51.100.53
!
system
vbond vbond.example.netFragment of an IOS XE SD-WAN configuration for BR-01, shortened. The resolver address is a documentation example and vbond.example.net is a placeholder. Most networks push this from a Manager template or configuration group, and keywords and placement can differ by release.
BR-01#ping vbond.example.net Translating "vbond.example.net"...domain server (198.51.100.53) [OK] Type escape sequence to abort. Sending 5, 100-byte ICMP Echos to 198.51.100.40, timeout is 2 seconds: !!!!!
Also check time. Certificates have validity dates, so a router with a wrong clock can fail authentication even when DNS and transport are fine. Use NTP, and reach it before assuming a certificate fault.
Firewalls
A firewall in front of the WAN Edge, or the router's own protection on its transport interface, has two groups of traffic to permit.
On small screens, swipe sideways or focus the diagram and use the arrow keys.
On small screens, swipe sideways or focus the diagram and use the arrow keys.
The ports are not listed here because they depend on the release and on settings such as port offsets. Take them from the configuration guide for your version, and from the TLOC output for the tunnel ports in use.
The router also decides which services it answers on a transport interface. By default some are blocked, and the allowed services are a setting on the tunnel interface. Check your release for the defaults before relying on a service such as ICMP being open, since it affects both ping tests and what the other side can learn about the router.
BR-01#show sdwan control connections PEER PEER PEER STATE TYPE PROTOCOL SYSTEM IP vsmart dtls 10.255.0.11 connect vmanage dtls 10.255.0.10 connect
connect and do not reach up. When the name resolves and the address is reachable, that pattern points at something between the router and the controllers dropping the control protocol: a firewall rule, a missing return path or a port that is not open.Learn more: Transport-Side IP and ISP ReachabilityColour Semantics and Public/Private Transport DesignOrganization Name and Certificate Domain
Where this goes wrong
- Opening the firewall for the controllers but not for tunnels between branches, so control is up and BFD is empty.
- Allowing only one direction and expecting a stateful firewall to handle the rest, then losing the session when its timer expires.
- Testing with ping only. ICMP can be allowed while the control port is blocked, or the reverse.
- Forgetting DNS and time, then investigating certificates for hours.
Test yourself on NAT, DNS and firewalls
BR-01's internet interface is 192.168.10.2, translated by the ISP to 203.0.113.10. Which address should HUB-01 use for tunnel packets to BR-01 on a public colour?
A WAN Edge is configured with the Validator as a name. It has a default route and can ping outside addresses, but no control connection starts. Which check comes next?
Control connections are up, OMP routes are present, but BFD shows no sessions to the hub. The hub has a public address. Which cause fits best?